=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-746380 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E0316 17:42:11.257975 285633 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/functional-193375/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-746380 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 80 (6m9.297680244s)
-- stdout --
* [old-k8s-version-746380] minikube v1.32.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=18277
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18277-280225/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18277-280225/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
* Using the docker driver based on existing profile
* Starting "old-k8s-version-746380" primary control-plane node in "old-k8s-version-746380" cluster
* Pulling base image v0.0.42-1710284843-18375 ...
* Restarting existing docker container for "old-k8s-version-746380" ...
* Preparing Kubernetes v1.20.0 on containerd 1.6.28 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-746380 addons enable metrics-server
* Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
-- /stdout --
** stderr **
I0316 17:41:59.947289 481631 out.go:291] Setting OutFile to fd 1 ...
I0316 17:41:59.949283 481631 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0316 17:41:59.949301 481631 out.go:304] Setting ErrFile to fd 2...
I0316 17:41:59.949308 481631 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0316 17:41:59.949659 481631 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18277-280225/.minikube/bin
I0316 17:41:59.950119 481631 out.go:298] Setting JSON to false
I0316 17:41:59.951214 481631 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":12266,"bootTime":1710598654,"procs":211,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0316 17:41:59.951295 481631 start.go:139] virtualization:
I0316 17:41:59.957140 481631 out.go:177] * [old-k8s-version-746380] minikube v1.32.0 on Ubuntu 20.04 (arm64)
I0316 17:41:59.959256 481631 out.go:177] - MINIKUBE_LOCATION=18277
I0316 17:41:59.959291 481631 notify.go:220] Checking for updates...
I0316 17:41:59.963497 481631 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0316 17:41:59.965308 481631 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18277-280225/kubeconfig
I0316 17:41:59.966996 481631 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18277-280225/.minikube
I0316 17:41:59.968570 481631 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0316 17:41:59.970433 481631 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0316 17:41:59.972761 481631 config.go:182] Loaded profile config "old-k8s-version-746380": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0316 17:41:59.976200 481631 out.go:177] * Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
I0316 17:41:59.977948 481631 driver.go:392] Setting default libvirt URI to qemu:///system
I0316 17:42:00.021342 481631 docker.go:122] docker version: linux-25.0.4:Docker Engine - Community
I0316 17:42:00.021493 481631 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0316 17:42:00.141384 481631 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:54 OomKillDisable:true NGoroutines:71 SystemTime:2024-03-16 17:42:00.128290068 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0316 17:42:00.141514 481631 docker.go:295] overlay module found
I0316 17:42:00.144252 481631 out.go:177] * Using the docker driver based on existing profile
I0316 17:42:00.146362 481631 start.go:297] selected driver: docker
I0316 17:42:00.146396 481631 start.go:901] validating driver "docker" against &{Name:old-k8s-version-746380 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-746380 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0316 17:42:00.146526 481631 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0316 17:42:00.147348 481631 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0316 17:42:00.263731 481631 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:54 OomKillDisable:true NGoroutines:71 SystemTime:2024-03-16 17:42:00.248972727 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0316 17:42:00.264219 481631 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0316 17:42:00.264273 481631 cni.go:84] Creating CNI manager for ""
I0316 17:42:00.264284 481631 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0316 17:42:00.264362 481631 start.go:340] cluster config:
{Name:old-k8s-version-746380 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-746380 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0316 17:42:00.266711 481631 out.go:177] * Starting "old-k8s-version-746380" primary control-plane node in "old-k8s-version-746380" cluster
I0316 17:42:00.268864 481631 cache.go:121] Beginning downloading kic base image for docker with containerd
I0316 17:42:00.270836 481631 out.go:177] * Pulling base image v0.0.42-1710284843-18375 ...
I0316 17:42:00.273324 481631 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0316 17:42:00.273397 481631 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18277-280225/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0316 17:42:00.273410 481631 cache.go:56] Caching tarball of preloaded images
I0316 17:42:00.273516 481631 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f in local docker daemon
I0316 17:42:00.273859 481631 preload.go:173] Found /home/jenkins/minikube-integration/18277-280225/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0316 17:42:00.273879 481631 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0316 17:42:00.274007 481631 profile.go:142] Saving config to /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/old-k8s-version-746380/config.json ...
I0316 17:42:00.320537 481631 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f in local docker daemon, skipping pull
I0316 17:42:00.320563 481631 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f exists in daemon, skipping load
I0316 17:42:00.320584 481631 cache.go:194] Successfully downloaded all kic artifacts
I0316 17:42:00.320618 481631 start.go:360] acquireMachinesLock for old-k8s-version-746380: {Name:mk985aced683677a27cd625ddf73450fbe12b4d6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0316 17:42:00.320692 481631 start.go:364] duration metric: took 52.562µs to acquireMachinesLock for "old-k8s-version-746380"
I0316 17:42:00.320714 481631 start.go:96] Skipping create...Using existing machine configuration
I0316 17:42:00.320721 481631 fix.go:54] fixHost starting:
I0316 17:42:00.321031 481631 cli_runner.go:164] Run: docker container inspect old-k8s-version-746380 --format={{.State.Status}}
I0316 17:42:00.368190 481631 fix.go:112] recreateIfNeeded on old-k8s-version-746380: state=Stopped err=<nil>
W0316 17:42:00.368222 481631 fix.go:138] unexpected machine state, will restart: <nil>
I0316 17:42:00.370666 481631 out.go:177] * Restarting existing docker container for "old-k8s-version-746380" ...
I0316 17:42:00.372867 481631 cli_runner.go:164] Run: docker start old-k8s-version-746380
I0316 17:42:00.865439 481631 cli_runner.go:164] Run: docker container inspect old-k8s-version-746380 --format={{.State.Status}}
I0316 17:42:00.888731 481631 kic.go:430] container "old-k8s-version-746380" state is running.
I0316 17:42:00.889111 481631 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-746380
I0316 17:42:00.918622 481631 profile.go:142] Saving config to /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/old-k8s-version-746380/config.json ...
I0316 17:42:00.918883 481631 machine.go:94] provisionDockerMachine start ...
I0316 17:42:00.918951 481631 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-746380
I0316 17:42:00.958494 481631 main.go:141] libmachine: Using SSH client type: native
I0316 17:42:00.958784 481631 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 33440 <nil> <nil>}
I0316 17:42:00.958795 481631 main.go:141] libmachine: About to run SSH command:
hostname
I0316 17:42:00.959511 481631 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:33442->127.0.0.1:33440: read: connection reset by peer
I0316 17:42:04.103264 481631 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-746380
I0316 17:42:04.103344 481631 ubuntu.go:169] provisioning hostname "old-k8s-version-746380"
I0316 17:42:04.103448 481631 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-746380
I0316 17:42:04.127069 481631 main.go:141] libmachine: Using SSH client type: native
I0316 17:42:04.127315 481631 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 33440 <nil> <nil>}
I0316 17:42:04.127327 481631 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-746380 && echo "old-k8s-version-746380" | sudo tee /etc/hostname
I0316 17:42:04.289857 481631 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-746380
I0316 17:42:04.289937 481631 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-746380
I0316 17:42:04.310450 481631 main.go:141] libmachine: Using SSH client type: native
I0316 17:42:04.310716 481631 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 33440 <nil> <nil>}
I0316 17:42:04.310742 481631 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-746380' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-746380/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-746380' | sudo tee -a /etc/hosts;
fi
fi
I0316 17:42:04.471481 481631 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0316 17:42:04.471556 481631 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18277-280225/.minikube CaCertPath:/home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18277-280225/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18277-280225/.minikube}
I0316 17:42:04.471630 481631 ubuntu.go:177] setting up certificates
I0316 17:42:04.471667 481631 provision.go:84] configureAuth start
I0316 17:42:04.471755 481631 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-746380
I0316 17:42:04.504770 481631 provision.go:143] copyHostCerts
I0316 17:42:04.504840 481631 exec_runner.go:144] found /home/jenkins/minikube-integration/18277-280225/.minikube/ca.pem, removing ...
I0316 17:42:04.504857 481631 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18277-280225/.minikube/ca.pem
I0316 17:42:04.504940 481631 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18277-280225/.minikube/ca.pem (1078 bytes)
I0316 17:42:04.505031 481631 exec_runner.go:144] found /home/jenkins/minikube-integration/18277-280225/.minikube/cert.pem, removing ...
I0316 17:42:04.505037 481631 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18277-280225/.minikube/cert.pem
I0316 17:42:04.505061 481631 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18277-280225/.minikube/cert.pem (1123 bytes)
I0316 17:42:04.505114 481631 exec_runner.go:144] found /home/jenkins/minikube-integration/18277-280225/.minikube/key.pem, removing ...
I0316 17:42:04.505118 481631 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18277-280225/.minikube/key.pem
I0316 17:42:04.505141 481631 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18277-280225/.minikube/key.pem (1675 bytes)
I0316 17:42:04.505186 481631 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18277-280225/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-746380 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-746380]
I0316 17:42:04.670743 481631 provision.go:177] copyRemoteCerts
I0316 17:42:04.670863 481631 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0316 17:42:04.670941 481631 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-746380
I0316 17:42:04.696073 481631 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33440 SSHKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/old-k8s-version-746380/id_rsa Username:docker}
I0316 17:42:04.797362 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0316 17:42:04.827286 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0316 17:42:04.858577 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0316 17:42:04.890030 481631 provision.go:87] duration metric: took 418.335172ms to configureAuth
I0316 17:42:04.890058 481631 ubuntu.go:193] setting minikube options for container-runtime
I0316 17:42:04.890262 481631 config.go:182] Loaded profile config "old-k8s-version-746380": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0316 17:42:04.890272 481631 machine.go:97] duration metric: took 3.971372099s to provisionDockerMachine
I0316 17:42:04.890279 481631 start.go:293] postStartSetup for "old-k8s-version-746380" (driver="docker")
I0316 17:42:04.890290 481631 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0316 17:42:04.890355 481631 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0316 17:42:04.890399 481631 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-746380
I0316 17:42:04.910572 481631 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33440 SSHKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/old-k8s-version-746380/id_rsa Username:docker}
I0316 17:42:05.028326 481631 ssh_runner.go:195] Run: cat /etc/os-release
I0316 17:42:05.033266 481631 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0316 17:42:05.033306 481631 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0316 17:42:05.033317 481631 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0316 17:42:05.033324 481631 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0316 17:42:05.033336 481631 filesync.go:126] Scanning /home/jenkins/minikube-integration/18277-280225/.minikube/addons for local assets ...
I0316 17:42:05.033395 481631 filesync.go:126] Scanning /home/jenkins/minikube-integration/18277-280225/.minikube/files for local assets ...
I0316 17:42:05.033477 481631 filesync.go:149] local asset: /home/jenkins/minikube-integration/18277-280225/.minikube/files/etc/ssl/certs/2856332.pem -> 2856332.pem in /etc/ssl/certs
I0316 17:42:05.033606 481631 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0316 17:42:05.044055 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/files/etc/ssl/certs/2856332.pem --> /etc/ssl/certs/2856332.pem (1708 bytes)
I0316 17:42:05.074992 481631 start.go:296] duration metric: took 184.695146ms for postStartSetup
I0316 17:42:05.075090 481631 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0316 17:42:05.075137 481631 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-746380
I0316 17:42:05.093728 481631 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33440 SSHKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/old-k8s-version-746380/id_rsa Username:docker}
I0316 17:42:05.193559 481631 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0316 17:42:05.199699 481631 fix.go:56] duration metric: took 4.878971113s for fixHost
I0316 17:42:05.199767 481631 start.go:83] releasing machines lock for "old-k8s-version-746380", held for 4.879064618s
I0316 17:42:05.199873 481631 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-746380
I0316 17:42:05.229973 481631 ssh_runner.go:195] Run: cat /version.json
I0316 17:42:05.230019 481631 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-746380
I0316 17:42:05.230273 481631 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0316 17:42:05.230321 481631 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-746380
I0316 17:42:05.266834 481631 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33440 SSHKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/old-k8s-version-746380/id_rsa Username:docker}
I0316 17:42:05.270825 481631 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33440 SSHKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/old-k8s-version-746380/id_rsa Username:docker}
I0316 17:42:05.506148 481631 ssh_runner.go:195] Run: systemctl --version
I0316 17:42:05.512033 481631 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0316 17:42:05.521015 481631 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0316 17:42:05.541732 481631 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0316 17:42:05.541820 481631 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0316 17:42:05.552077 481631 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0316 17:42:05.552103 481631 start.go:494] detecting cgroup driver to use...
I0316 17:42:05.552137 481631 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0316 17:42:05.552199 481631 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0316 17:42:05.570834 481631 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0316 17:42:05.584229 481631 docker.go:217] disabling cri-docker service (if available) ...
I0316 17:42:05.584301 481631 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0316 17:42:05.597194 481631 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0316 17:42:05.608930 481631 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0316 17:42:05.701086 481631 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0316 17:42:05.781221 481631 docker.go:233] disabling docker service ...
I0316 17:42:05.781294 481631 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0316 17:42:05.794701 481631 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0316 17:42:05.806711 481631 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0316 17:42:05.936576 481631 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0316 17:42:06.056138 481631 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0316 17:42:06.071461 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0316 17:42:06.089357 481631 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0316 17:42:06.101536 481631 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0316 17:42:06.112899 481631 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0316 17:42:06.113007 481631 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0316 17:42:06.123515 481631 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0316 17:42:06.133962 481631 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0316 17:42:06.144219 481631 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0316 17:42:06.154141 481631 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0316 17:42:06.164357 481631 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0316 17:42:06.174785 481631 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0316 17:42:06.184210 481631 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0316 17:42:06.192984 481631 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0316 17:42:06.274363 481631 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0316 17:42:06.446630 481631 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0316 17:42:06.446774 481631 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0316 17:42:06.450646 481631 start.go:562] Will wait 60s for crictl version
I0316 17:42:06.450745 481631 ssh_runner.go:195] Run: which crictl
I0316 17:42:06.454115 481631 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0316 17:42:06.517143 481631 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.28
RuntimeApiVersion: v1
I0316 17:42:06.517256 481631 ssh_runner.go:195] Run: containerd --version
I0316 17:42:06.547342 481631 ssh_runner.go:195] Run: containerd --version
I0316 17:42:06.575851 481631 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.6.28 ...
I0316 17:42:06.577767 481631 cli_runner.go:164] Run: docker network inspect old-k8s-version-746380 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0316 17:42:06.593232 481631 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0316 17:42:06.596850 481631 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0316 17:42:06.607506 481631 kubeadm.go:877] updating cluster {Name:old-k8s-version-746380 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-746380 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0316 17:42:06.607683 481631 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0316 17:42:06.607753 481631 ssh_runner.go:195] Run: sudo crictl images --output json
I0316 17:42:06.644341 481631 containerd.go:612] all images are preloaded for containerd runtime.
I0316 17:42:06.644367 481631 containerd.go:519] Images already preloaded, skipping extraction
I0316 17:42:06.644432 481631 ssh_runner.go:195] Run: sudo crictl images --output json
I0316 17:42:06.684516 481631 containerd.go:612] all images are preloaded for containerd runtime.
I0316 17:42:06.684541 481631 cache_images.go:84] Images are preloaded, skipping loading
I0316 17:42:06.684550 481631 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I0316 17:42:06.684671 481631 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-746380 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-746380 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0316 17:42:06.684754 481631 ssh_runner.go:195] Run: sudo crictl info
I0316 17:42:06.730724 481631 cni.go:84] Creating CNI manager for ""
I0316 17:42:06.730759 481631 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0316 17:42:06.730770 481631 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0316 17:42:06.730791 481631 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-746380 NodeName:old-k8s-version-746380 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0316 17:42:06.730928 481631 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-746380"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0316 17:42:06.731007 481631 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0316 17:42:06.740573 481631 binaries.go:44] Found k8s binaries, skipping transfer
I0316 17:42:06.740670 481631 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0316 17:42:06.751215 481631 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0316 17:42:06.769820 481631 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0316 17:42:06.788048 481631 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0316 17:42:06.807472 481631 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0316 17:42:06.811094 481631 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0316 17:42:06.821748 481631 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0316 17:42:06.903012 481631 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0316 17:42:06.917358 481631 certs.go:68] Setting up /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/old-k8s-version-746380 for IP: 192.168.76.2
I0316 17:42:06.917391 481631 certs.go:194] generating shared ca certs ...
I0316 17:42:06.917408 481631 certs.go:226] acquiring lock for ca certs: {Name:mk6d455ecce74ad164a5c9d511b938033d09479f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 17:42:06.917582 481631 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18277-280225/.minikube/ca.key
I0316 17:42:06.917630 481631 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18277-280225/.minikube/proxy-client-ca.key
I0316 17:42:06.917639 481631 certs.go:256] generating profile certs ...
I0316 17:42:06.917729 481631 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/old-k8s-version-746380/client.key
I0316 17:42:06.917797 481631 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/old-k8s-version-746380/apiserver.key.2a1aaf52
I0316 17:42:06.917841 481631 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/old-k8s-version-746380/proxy-client.key
I0316 17:42:06.917947 481631 certs.go:484] found cert: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/285633.pem (1338 bytes)
W0316 17:42:06.917977 481631 certs.go:480] ignoring /home/jenkins/minikube-integration/18277-280225/.minikube/certs/285633_empty.pem, impossibly tiny 0 bytes
I0316 17:42:06.917985 481631 certs.go:484] found cert: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca-key.pem (1679 bytes)
I0316 17:42:06.918007 481631 certs.go:484] found cert: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca.pem (1078 bytes)
I0316 17:42:06.918027 481631 certs.go:484] found cert: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/cert.pem (1123 bytes)
I0316 17:42:06.918048 481631 certs.go:484] found cert: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/key.pem (1675 bytes)
I0316 17:42:06.918095 481631 certs.go:484] found cert: /home/jenkins/minikube-integration/18277-280225/.minikube/files/etc/ssl/certs/2856332.pem (1708 bytes)
I0316 17:42:06.918737 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0316 17:42:06.966657 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0316 17:42:06.995477 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0316 17:42:07.094701 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0316 17:42:07.123471 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/old-k8s-version-746380/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0316 17:42:07.149003 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/old-k8s-version-746380/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0316 17:42:07.174577 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/old-k8s-version-746380/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0316 17:42:07.201093 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/old-k8s-version-746380/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0316 17:42:07.226539 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/files/etc/ssl/certs/2856332.pem --> /usr/share/ca-certificates/2856332.pem (1708 bytes)
I0316 17:42:07.251159 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0316 17:42:07.275247 481631 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/certs/285633.pem --> /usr/share/ca-certificates/285633.pem (1338 bytes)
I0316 17:42:07.299398 481631 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0316 17:42:07.317996 481631 ssh_runner.go:195] Run: openssl version
I0316 17:42:07.323511 481631 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2856332.pem && ln -fs /usr/share/ca-certificates/2856332.pem /etc/ssl/certs/2856332.pem"
I0316 17:42:07.333278 481631 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2856332.pem
I0316 17:42:07.336759 481631 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 16 17:01 /usr/share/ca-certificates/2856332.pem
I0316 17:42:07.336837 481631 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2856332.pem
I0316 17:42:07.343869 481631 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/2856332.pem /etc/ssl/certs/3ec20f2e.0"
I0316 17:42:07.353021 481631 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0316 17:42:07.362700 481631 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0316 17:42:07.366289 481631 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 16 16:56 /usr/share/ca-certificates/minikubeCA.pem
I0316 17:42:07.366378 481631 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0316 17:42:07.374480 481631 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0316 17:42:07.383503 481631 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/285633.pem && ln -fs /usr/share/ca-certificates/285633.pem /etc/ssl/certs/285633.pem"
I0316 17:42:07.393247 481631 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/285633.pem
I0316 17:42:07.396665 481631 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 16 17:01 /usr/share/ca-certificates/285633.pem
I0316 17:42:07.396752 481631 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/285633.pem
I0316 17:42:07.403653 481631 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/285633.pem /etc/ssl/certs/51391683.0"
I0316 17:42:07.412429 481631 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0316 17:42:07.415915 481631 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0316 17:42:07.423039 481631 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0316 17:42:07.430112 481631 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0316 17:42:07.437039 481631 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0316 17:42:07.444390 481631 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0316 17:42:07.451124 481631 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0316 17:42:07.458230 481631 kubeadm.go:391] StartCluster: {Name:old-k8s-version-746380 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-746380 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0316 17:42:07.458350 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0316 17:42:07.458429 481631 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0316 17:42:07.516261 481631 cri.go:89] found id: "a7700f61f9427c51311df28b60dc3da67a68a1be40d1f17810185e95a656508c"
I0316 17:42:07.516302 481631 cri.go:89] found id: "7ceacd2ed17423521a1815859afffde0ddd075bf9bec82e50bae88c12f2e99e5"
I0316 17:42:07.516308 481631 cri.go:89] found id: "22beb4846f86e0b94f967a82643633bda14c92a967549166bf63c77fcd3a5673"
I0316 17:42:07.516311 481631 cri.go:89] found id: "ccbf82b14ebc82618a0db0f8cce371995c37bb4d2cd2b873a46ac53578fbec9b"
I0316 17:42:07.516315 481631 cri.go:89] found id: "bb9fc8b360819c7a19f5e182ffa90ecf3dc71344631dac019d43ec3d489bbb79"
I0316 17:42:07.516318 481631 cri.go:89] found id: "3ffcf3139cf08c2e735e53f3bed4469b3466bcbedc7c3cb0bba55d896472640b"
I0316 17:42:07.516321 481631 cri.go:89] found id: "0340e5ca0be60b47abce880f66d4c4e5fc876c20b19e0b5c769ec2a4f1b8547b"
I0316 17:42:07.516324 481631 cri.go:89] found id: "53e126d87d370fc7c40afb41dc1a7f49e87707a49e2d1486adf3a6445555d955"
I0316 17:42:07.516327 481631 cri.go:89] found id: ""
I0316 17:42:07.516389 481631 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0316 17:42:07.529407 481631 cri.go:116] JSON = null
W0316 17:42:07.529460 481631 kubeadm.go:398] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0316 17:42:07.529536 481631 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0316 17:42:07.538800 481631 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0316 17:42:07.538835 481631 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0316 17:42:07.538842 481631 kubeadm.go:587] restartPrimaryControlPlane start ...
I0316 17:42:07.538900 481631 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0316 17:42:07.553605 481631 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0316 17:42:07.554117 481631 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-746380" does not appear in /home/jenkins/minikube-integration/18277-280225/kubeconfig
I0316 17:42:07.554248 481631 kubeconfig.go:62] /home/jenkins/minikube-integration/18277-280225/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-746380" cluster setting kubeconfig missing "old-k8s-version-746380" context setting]
I0316 17:42:07.554630 481631 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18277-280225/kubeconfig: {Name:mk8864b14e2dcaa49893fcecc40453b6fe139389 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 17:42:07.556475 481631 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0316 17:42:07.567929 481631 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.76.2
I0316 17:42:07.567971 481631 kubeadm.go:591] duration metric: took 29.124354ms to restartPrimaryControlPlane
I0316 17:42:07.567980 481631 kubeadm.go:393] duration metric: took 109.759299ms to StartCluster
I0316 17:42:07.567995 481631 settings.go:142] acquiring lock: {Name:mkcd5f7504890e5ae44ee0b7a2caa6ef5c6c8fbc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 17:42:07.568064 481631 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18277-280225/kubeconfig
I0316 17:42:07.568760 481631 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18277-280225/kubeconfig: {Name:mk8864b14e2dcaa49893fcecc40453b6fe139389 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 17:42:07.568995 481631 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0316 17:42:07.571966 481631 out.go:177] * Verifying Kubernetes components...
I0316 17:42:07.569359 481631 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0316 17:42:07.569512 481631 config.go:182] Loaded profile config "old-k8s-version-746380": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0316 17:42:07.574387 481631 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-746380"
I0316 17:42:07.574411 481631 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-746380"
W0316 17:42:07.574419 481631 addons.go:243] addon storage-provisioner should already be in state true
I0316 17:42:07.574429 481631 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0316 17:42:07.574459 481631 host.go:66] Checking if "old-k8s-version-746380" exists ...
I0316 17:42:07.574544 481631 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-746380"
I0316 17:42:07.574574 481631 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-746380"
I0316 17:42:07.574895 481631 cli_runner.go:164] Run: docker container inspect old-k8s-version-746380 --format={{.State.Status}}
I0316 17:42:07.574906 481631 cli_runner.go:164] Run: docker container inspect old-k8s-version-746380 --format={{.State.Status}}
I0316 17:42:07.575271 481631 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-746380"
I0316 17:42:07.575300 481631 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-746380"
W0316 17:42:07.575307 481631 addons.go:243] addon metrics-server should already be in state true
I0316 17:42:07.575335 481631 host.go:66] Checking if "old-k8s-version-746380" exists ...
I0316 17:42:07.575357 481631 addons.go:69] Setting dashboard=true in profile "old-k8s-version-746380"
I0316 17:42:07.575417 481631 addons.go:234] Setting addon dashboard=true in "old-k8s-version-746380"
W0316 17:42:07.575449 481631 addons.go:243] addon dashboard should already be in state true
I0316 17:42:07.575500 481631 host.go:66] Checking if "old-k8s-version-746380" exists ...
I0316 17:42:07.575837 481631 cli_runner.go:164] Run: docker container inspect old-k8s-version-746380 --format={{.State.Status}}
I0316 17:42:07.576184 481631 cli_runner.go:164] Run: docker container inspect old-k8s-version-746380 --format={{.State.Status}}
I0316 17:42:07.613247 481631 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0316 17:42:07.621116 481631 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0316 17:42:07.621140 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0316 17:42:07.621205 481631 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-746380
I0316 17:42:07.637685 481631 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0316 17:42:07.643208 481631 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0316 17:42:07.640600 481631 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-746380"
I0316 17:42:07.646929 481631 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0316 17:42:07.645275 481631 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
W0316 17:42:07.645290 481631 addons.go:243] addon default-storageclass should already be in state true
I0316 17:42:07.648912 481631 host.go:66] Checking if "old-k8s-version-746380" exists ...
I0316 17:42:07.648938 481631 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0316 17:42:07.648955 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0316 17:42:07.649015 481631 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-746380
I0316 17:42:07.649377 481631 cli_runner.go:164] Run: docker container inspect old-k8s-version-746380 --format={{.State.Status}}
I0316 17:42:07.649666 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0316 17:42:07.649730 481631 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-746380
I0316 17:42:07.695739 481631 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33440 SSHKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/old-k8s-version-746380/id_rsa Username:docker}
I0316 17:42:07.697095 481631 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33440 SSHKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/old-k8s-version-746380/id_rsa Username:docker}
I0316 17:42:07.724377 481631 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33440 SSHKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/old-k8s-version-746380/id_rsa Username:docker}
I0316 17:42:07.730493 481631 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0316 17:42:07.730513 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0316 17:42:07.730577 481631 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-746380
I0316 17:42:07.740128 481631 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0316 17:42:07.763290 481631 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33440 SSHKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/old-k8s-version-746380/id_rsa Username:docker}
I0316 17:42:07.785988 481631 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-746380" to be "Ready" ...
I0316 17:42:07.852114 481631 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0316 17:42:07.852138 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0316 17:42:07.874441 481631 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0316 17:42:07.874509 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0316 17:42:07.877276 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0316 17:42:07.902505 481631 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0316 17:42:07.902570 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0316 17:42:07.906205 481631 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0316 17:42:07.906271 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0316 17:42:07.923257 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0316 17:42:07.951835 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0316 17:42:07.980873 481631 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0316 17:42:07.980902 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0316 17:42:08.073035 481631 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0316 17:42:08.073063 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0316 17:42:08.136815 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.136853 481631 retry.go:31] will retry after 179.654788ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.141049 481631 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0316 17:42:08.141075 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0316 17:42:08.144650 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.144681 481631 retry.go:31] will retry after 190.103906ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.160948 481631 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0316 17:42:08.160974 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0316 17:42:08.182599 481631 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0316 17:42:08.182625 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0316 17:42:08.202736 481631 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0316 17:42:08.202769 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
W0316 17:42:08.215669 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.215705 481631 retry.go:31] will retry after 320.347104ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.223284 481631 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0316 17:42:08.223314 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0316 17:42:08.242524 481631 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0316 17:42:08.242589 481631 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0316 17:42:08.261453 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0316 17:42:08.317232 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0316 17:42:08.335446 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0316 17:42:08.340646 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.340715 481631 retry.go:31] will retry after 128.141016ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0316 17:42:08.428854 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0316 17:42:08.428907 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.428935 481631 retry.go:31] will retry after 435.220523ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.428957 481631 retry.go:31] will retry after 287.290957ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.470052 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0316 17:42:08.536590 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0316 17:42:08.592022 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.592099 481631 retry.go:31] will retry after 280.350723ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0316 17:42:08.634636 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.634675 481631 retry.go:31] will retry after 198.626244ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.717005 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0316 17:42:08.795780 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.795813 481631 retry.go:31] will retry after 490.542891ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.834117 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0316 17:42:08.864589 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0316 17:42:08.872906 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0316 17:42:08.974766 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:08.974807 481631 retry.go:31] will retry after 714.630047ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0316 17:42:09.016327 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:09.016366 481631 retry.go:31] will retry after 754.198803ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0316 17:42:09.047216 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:09.047313 481631 retry.go:31] will retry after 416.687724ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:09.286823 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0316 17:42:09.361371 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:09.361404 481631 retry.go:31] will retry after 980.284155ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:09.464614 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0316 17:42:09.574679 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:09.574795 481631 retry.go:31] will retry after 446.126299ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:09.690107 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0316 17:42:09.765050 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:09.765084 481631 retry.go:31] will retry after 693.920365ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:09.771269 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0316 17:42:09.786856 481631 node_ready.go:53] error getting node "old-k8s-version-746380": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-746380": dial tcp 192.168.76.2:8443: connect: connection refused
W0316 17:42:09.846185 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:09.846218 481631 retry.go:31] will retry after 612.609863ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:10.021806 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0316 17:42:10.121711 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:10.121813 481631 retry.go:31] will retry after 1.192086834s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:10.342840 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0316 17:42:10.418840 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:10.418877 481631 retry.go:31] will retry after 873.814223ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:10.460040 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0316 17:42:10.460326 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0316 17:42:10.639028 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:10.639062 481631 retry.go:31] will retry after 1.753084596s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0316 17:42:10.639110 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:10.639122 481631 retry.go:31] will retry after 1.380638196s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:11.293819 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0316 17:42:11.314130 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0316 17:42:11.374599 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:11.374634 481631 retry.go:31] will retry after 2.459510127s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0316 17:42:11.408894 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:11.408928 481631 retry.go:31] will retry after 2.414414509s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:12.020870 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0316 17:42:12.105981 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:12.106012 481631 retry.go:31] will retry after 1.312651252s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:12.286756 481631 node_ready.go:53] error getting node "old-k8s-version-746380": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-746380": dial tcp 192.168.76.2:8443: connect: connection refused
I0316 17:42:12.392990 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0316 17:42:12.474768 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:12.474801 481631 retry.go:31] will retry after 2.448875106s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:13.419832 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0316 17:42:13.514403 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:13.514435 481631 retry.go:31] will retry after 1.571292698s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:13.823691 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0316 17:42:13.835027 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0316 17:42:13.927148 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:13.927253 481631 retry.go:31] will retry after 1.841493824s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0316 17:42:13.951547 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:13.951582 481631 retry.go:31] will retry after 3.059458316s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:14.287033 481631 node_ready.go:53] error getting node "old-k8s-version-746380": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-746380": dial tcp 192.168.76.2:8443: connect: connection refused
I0316 17:42:14.924097 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0316 17:42:15.041804 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:15.041882 481631 retry.go:31] will retry after 1.528249633s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:15.086043 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0316 17:42:15.172182 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:15.172217 481631 retry.go:31] will retry after 5.596650635s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:15.769278 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0316 17:42:15.846741 481631 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:15.846784 481631 retry.go:31] will retry after 3.704135029s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0316 17:42:16.287439 481631 node_ready.go:53] error getting node "old-k8s-version-746380": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-746380": dial tcp 192.168.76.2:8443: connect: connection refused
I0316 17:42:16.570807 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0316 17:42:17.011273 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0316 17:42:19.551066 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0316 17:42:20.769264 481631 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0316 17:42:27.041687 481631 node_ready.go:49] node "old-k8s-version-746380" has status "Ready":"True"
I0316 17:42:27.041727 481631 node_ready.go:38] duration metric: took 19.255705475s for node "old-k8s-version-746380" to be "Ready" ...
I0316 17:42:27.041738 481631 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0316 17:42:27.263520 481631 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-jcdh5" in "kube-system" namespace to be "Ready" ...
I0316 17:42:28.025210 481631 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (11.454364666s)
I0316 17:42:28.237051 481631 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (11.225739368s)
I0316 17:42:28.568185 481631 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.798881412s)
I0316 17:42:28.568225 481631 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-746380"
I0316 17:42:28.568329 481631 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (9.017227242s)
I0316 17:42:28.570417 481631 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-746380 addons enable metrics-server
I0316 17:42:28.572655 481631 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
I0316 17:42:28.574595 481631 addons.go:505] duration metric: took 21.005237526s for enable addons: enabled=[default-storageclass storage-provisioner metrics-server dashboard]
I0316 17:42:29.270360 481631 pod_ready.go:102] pod "coredns-74ff55c5b-jcdh5" in "kube-system" namespace has status "Ready":"False"
I0316 17:42:31.774385 481631 pod_ready.go:102] pod "coredns-74ff55c5b-jcdh5" in "kube-system" namespace has status "Ready":"False"
I0316 17:42:34.271184 481631 pod_ready.go:102] pod "coredns-74ff55c5b-jcdh5" in "kube-system" namespace has status "Ready":"False"
I0316 17:42:36.796678 481631 pod_ready.go:102] pod "coredns-74ff55c5b-jcdh5" in "kube-system" namespace has status "Ready":"False"
I0316 17:42:37.770464 481631 pod_ready.go:92] pod "coredns-74ff55c5b-jcdh5" in "kube-system" namespace has status "Ready":"True"
I0316 17:42:37.770491 481631 pod_ready.go:81] duration metric: took 10.506937341s for pod "coredns-74ff55c5b-jcdh5" in "kube-system" namespace to be "Ready" ...
I0316 17:42:37.770502 481631 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-746380" in "kube-system" namespace to be "Ready" ...
I0316 17:42:39.776868 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:42:41.777472 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:42:44.276680 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:42:46.353053 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:42:48.781326 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:42:51.277604 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:42:53.277911 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:42:55.776446 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:42:57.776991 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:00.291704 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:02.777069 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:05.280299 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:07.777800 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:10.278020 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:12.279412 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:14.787181 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:17.276159 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:19.276440 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:21.276706 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:23.277636 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:25.280954 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:27.786071 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:30.278286 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:32.280975 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:34.782296 481631 pod_ready.go:102] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:36.776109 481631 pod_ready.go:92] pod "etcd-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"True"
I0316 17:43:36.776134 481631 pod_ready.go:81] duration metric: took 59.005624808s for pod "etcd-old-k8s-version-746380" in "kube-system" namespace to be "Ready" ...
I0316 17:43:36.776148 481631 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-746380" in "kube-system" namespace to be "Ready" ...
I0316 17:43:36.780738 481631 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"True"
I0316 17:43:36.780761 481631 pod_ready.go:81] duration metric: took 4.604681ms for pod "kube-apiserver-old-k8s-version-746380" in "kube-system" namespace to be "Ready" ...
I0316 17:43:36.780772 481631 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-746380" in "kube-system" namespace to be "Ready" ...
I0316 17:43:36.786250 481631 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"True"
I0316 17:43:36.786272 481631 pod_ready.go:81] duration metric: took 5.493126ms for pod "kube-controller-manager-old-k8s-version-746380" in "kube-system" namespace to be "Ready" ...
I0316 17:43:36.786284 481631 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-x59w9" in "kube-system" namespace to be "Ready" ...
I0316 17:43:36.790728 481631 pod_ready.go:92] pod "kube-proxy-x59w9" in "kube-system" namespace has status "Ready":"True"
I0316 17:43:36.790753 481631 pod_ready.go:81] duration metric: took 4.46069ms for pod "kube-proxy-x59w9" in "kube-system" namespace to be "Ready" ...
I0316 17:43:36.790767 481631 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-746380" in "kube-system" namespace to be "Ready" ...
I0316 17:43:38.797163 481631 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:41.296756 481631 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:43.297411 481631 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:45.305559 481631 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:47.355391 481631 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:49.797601 481631 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:52.297729 481631 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:54.299980 481631 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"False"
I0316 17:43:56.796309 481631 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-746380" in "kube-system" namespace has status "Ready":"True"
I0316 17:43:56.796334 481631 pod_ready.go:81] duration metric: took 20.005558201s for pod "kube-scheduler-old-k8s-version-746380" in "kube-system" namespace to be "Ready" ...
I0316 17:43:56.796346 481631 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace to be "Ready" ...
I0316 17:43:58.802818 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:00.803336 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:02.804530 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:05.305326 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:07.803816 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:10.302851 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:12.303186 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:14.802367 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:17.302476 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:19.802626 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:22.302400 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:24.803426 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:27.302582 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:29.303164 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:31.801470 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:33.802696 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:36.303247 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:38.802080 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:41.303181 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:43.802323 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:46.302735 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:48.803261 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:51.302213 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:53.302998 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:55.310097 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:44:57.803197 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:00.326411 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:02.802450 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:05.306732 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:07.803416 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:09.804172 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:11.808200 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:14.303108 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:16.802246 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:18.803476 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:21.302365 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:23.802941 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:26.302747 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:28.302779 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:30.304040 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:32.803081 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:35.303213 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:37.803002 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:40.302451 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:42.302822 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:44.302872 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:46.303660 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:48.332094 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:50.801958 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:53.302665 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:55.306059 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:45:57.802678 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:00.305845 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:02.803115 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:05.307191 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:07.803138 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:10.302326 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:12.802055 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:14.802305 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:17.302568 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:19.801973 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:21.802381 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:24.302135 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:26.303008 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:28.303158 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:30.303388 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:32.802327 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:35.307148 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:37.802277 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:39.802369 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:41.802623 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:44.302354 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:46.302633 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:48.302691 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:50.302964 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:52.802027 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:54.802966 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:57.302711 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:46:59.802974 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:02.302136 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:04.302338 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:06.801928 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:08.803138 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:11.303226 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:13.802762 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:15.802895 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:18.312261 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:20.802737 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:22.803858 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:25.303996 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:27.801968 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:29.802192 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:32.301977 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:34.302883 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:36.303193 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:38.802675 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:40.802912 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:42.805838 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:45.313942 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:47.804246 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:50.303876 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:52.814958 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:55.305590 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:56.801819 481631 pod_ready.go:81] duration metric: took 4m0.005459581s for pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace to be "Ready" ...
E0316 17:47:56.801842 481631 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0316 17:47:56.801850 481631 pod_ready.go:38] duration metric: took 5m29.760095608s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0316 17:47:56.801864 481631 api_server.go:52] waiting for apiserver process to appear ...
I0316 17:47:56.801890 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0316 17:47:56.801947 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0316 17:47:56.846384 481631 cri.go:89] found id: "f6a137e8a3b1485dd10f52919de9c0fef41fc33d23e13d15ecd70b4ee918c6d5"
I0316 17:47:56.846404 481631 cri.go:89] found id: "0340e5ca0be60b47abce880f66d4c4e5fc876c20b19e0b5c769ec2a4f1b8547b"
I0316 17:47:56.846409 481631 cri.go:89] found id: ""
I0316 17:47:56.846417 481631 logs.go:276] 2 containers: [f6a137e8a3b1485dd10f52919de9c0fef41fc33d23e13d15ecd70b4ee918c6d5 0340e5ca0be60b47abce880f66d4c4e5fc876c20b19e0b5c769ec2a4f1b8547b]
I0316 17:47:56.846473 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:56.851464 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:56.855231 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0316 17:47:56.855291 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0316 17:47:56.900649 481631 cri.go:89] found id: "16d138fc440dd55f8a882b1a470bd88b116d89b1276ca648e106057f46db7677"
I0316 17:47:56.900668 481631 cri.go:89] found id: "53e126d87d370fc7c40afb41dc1a7f49e87707a49e2d1486adf3a6445555d955"
I0316 17:47:56.900673 481631 cri.go:89] found id: ""
I0316 17:47:56.900680 481631 logs.go:276] 2 containers: [16d138fc440dd55f8a882b1a470bd88b116d89b1276ca648e106057f46db7677 53e126d87d370fc7c40afb41dc1a7f49e87707a49e2d1486adf3a6445555d955]
I0316 17:47:56.900734 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:56.904641 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:56.908512 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0316 17:47:56.908579 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0316 17:47:56.958196 481631 cri.go:89] found id: "8dd0ee223c90f99d346db9114977e56c2bbfecb904aa1223b3e8e1109264981d"
I0316 17:47:56.958221 481631 cri.go:89] found id: "a7700f61f9427c51311df28b60dc3da67a68a1be40d1f17810185e95a656508c"
I0316 17:47:56.958227 481631 cri.go:89] found id: ""
I0316 17:47:56.958235 481631 logs.go:276] 2 containers: [8dd0ee223c90f99d346db9114977e56c2bbfecb904aa1223b3e8e1109264981d a7700f61f9427c51311df28b60dc3da67a68a1be40d1f17810185e95a656508c]
I0316 17:47:56.958356 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:56.962503 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:56.966137 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0316 17:47:56.966233 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0316 17:47:57.030461 481631 cri.go:89] found id: "bf0d1869cc0d68bb43a663a92a7a2eb950593536676cefca598146c6f602803e"
I0316 17:47:57.030487 481631 cri.go:89] found id: "bb9fc8b360819c7a19f5e182ffa90ecf3dc71344631dac019d43ec3d489bbb79"
I0316 17:47:57.030492 481631 cri.go:89] found id: ""
I0316 17:47:57.030499 481631 logs.go:276] 2 containers: [bf0d1869cc0d68bb43a663a92a7a2eb950593536676cefca598146c6f602803e bb9fc8b360819c7a19f5e182ffa90ecf3dc71344631dac019d43ec3d489bbb79]
I0316 17:47:57.030555 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.035500 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.040606 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0316 17:47:57.040685 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0316 17:47:57.088626 481631 cri.go:89] found id: "53266df997beffb4f7bfa6609d282d4f498bcdb315a85073da81dd740c85139f"
I0316 17:47:57.088650 481631 cri.go:89] found id: "ccbf82b14ebc82618a0db0f8cce371995c37bb4d2cd2b873a46ac53578fbec9b"
I0316 17:47:57.088655 481631 cri.go:89] found id: ""
I0316 17:47:57.088663 481631 logs.go:276] 2 containers: [53266df997beffb4f7bfa6609d282d4f498bcdb315a85073da81dd740c85139f ccbf82b14ebc82618a0db0f8cce371995c37bb4d2cd2b873a46ac53578fbec9b]
I0316 17:47:57.088727 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.093520 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.097632 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0316 17:47:57.097706 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0316 17:47:57.145155 481631 cri.go:89] found id: "c5661cb115eddb01bce4d502126d119b47c1c22da24660a5c5d57202fad6e10e"
I0316 17:47:57.145180 481631 cri.go:89] found id: "3ffcf3139cf08c2e735e53f3bed4469b3466bcbedc7c3cb0bba55d896472640b"
I0316 17:47:57.145184 481631 cri.go:89] found id: ""
I0316 17:47:57.145191 481631 logs.go:276] 2 containers: [c5661cb115eddb01bce4d502126d119b47c1c22da24660a5c5d57202fad6e10e 3ffcf3139cf08c2e735e53f3bed4469b3466bcbedc7c3cb0bba55d896472640b]
I0316 17:47:57.145246 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.149767 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.154500 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0316 17:47:57.154575 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0316 17:47:57.209384 481631 cri.go:89] found id: "137f2de59c6dc6edd43d77e791ff547f8b6673cd98d12a1046d38b593804d914"
I0316 17:47:57.209408 481631 cri.go:89] found id: "22beb4846f86e0b94f967a82643633bda14c92a967549166bf63c77fcd3a5673"
I0316 17:47:57.209413 481631 cri.go:89] found id: ""
I0316 17:47:57.209420 481631 logs.go:276] 2 containers: [137f2de59c6dc6edd43d77e791ff547f8b6673cd98d12a1046d38b593804d914 22beb4846f86e0b94f967a82643633bda14c92a967549166bf63c77fcd3a5673]
I0316 17:47:57.209516 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.213954 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.217759 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0316 17:47:57.217870 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0316 17:47:57.275699 481631 cri.go:89] found id: "747498059d66bf6a35719a49e025168cdec4e997bd41ff614c40cd4518774adb"
I0316 17:47:57.275725 481631 cri.go:89] found id: "c5196a521ea11d8df3329b51f670d2873b2e489ba1e6d7bad59e4d1a58567aaf"
I0316 17:47:57.275731 481631 cri.go:89] found id: ""
I0316 17:47:57.275762 481631 logs.go:276] 2 containers: [747498059d66bf6a35719a49e025168cdec4e997bd41ff614c40cd4518774adb c5196a521ea11d8df3329b51f670d2873b2e489ba1e6d7bad59e4d1a58567aaf]
I0316 17:47:57.275818 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.280001 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.283560 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0316 17:47:57.283668 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0316 17:47:57.325685 481631 cri.go:89] found id: "a8228ba39ff72ee5a9f0f601ff331405a3653e6a672688d3942fd43ebd1f5ff0"
I0316 17:47:57.325707 481631 cri.go:89] found id: ""
I0316 17:47:57.325715 481631 logs.go:276] 1 containers: [a8228ba39ff72ee5a9f0f601ff331405a3653e6a672688d3942fd43ebd1f5ff0]
I0316 17:47:57.325806 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.335361 481631 logs.go:123] Gathering logs for coredns [8dd0ee223c90f99d346db9114977e56c2bbfecb904aa1223b3e8e1109264981d] ...
I0316 17:47:57.335400 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8dd0ee223c90f99d346db9114977e56c2bbfecb904aa1223b3e8e1109264981d"
I0316 17:47:57.386271 481631 logs.go:123] Gathering logs for coredns [a7700f61f9427c51311df28b60dc3da67a68a1be40d1f17810185e95a656508c] ...
I0316 17:47:57.386305 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a7700f61f9427c51311df28b60dc3da67a68a1be40d1f17810185e95a656508c"
I0316 17:47:57.438268 481631 logs.go:123] Gathering logs for kube-scheduler [bb9fc8b360819c7a19f5e182ffa90ecf3dc71344631dac019d43ec3d489bbb79] ...
I0316 17:47:57.438345 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bb9fc8b360819c7a19f5e182ffa90ecf3dc71344631dac019d43ec3d489bbb79"
I0316 17:47:57.492639 481631 logs.go:123] Gathering logs for kube-controller-manager [3ffcf3139cf08c2e735e53f3bed4469b3466bcbedc7c3cb0bba55d896472640b] ...
I0316 17:47:57.492672 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3ffcf3139cf08c2e735e53f3bed4469b3466bcbedc7c3cb0bba55d896472640b"
I0316 17:47:57.622160 481631 logs.go:123] Gathering logs for containerd ...
I0316 17:47:57.622192 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0316 17:47:57.692049 481631 logs.go:123] Gathering logs for dmesg ...
I0316 17:47:57.692087 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0316 17:47:57.712218 481631 logs.go:123] Gathering logs for kube-apiserver [0340e5ca0be60b47abce880f66d4c4e5fc876c20b19e0b5c769ec2a4f1b8547b] ...
I0316 17:47:57.712297 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0340e5ca0be60b47abce880f66d4c4e5fc876c20b19e0b5c769ec2a4f1b8547b"
I0316 17:47:57.824470 481631 logs.go:123] Gathering logs for kube-scheduler [bf0d1869cc0d68bb43a663a92a7a2eb950593536676cefca598146c6f602803e] ...
I0316 17:47:57.824542 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bf0d1869cc0d68bb43a663a92a7a2eb950593536676cefca598146c6f602803e"
I0316 17:47:57.885521 481631 logs.go:123] Gathering logs for kubernetes-dashboard [a8228ba39ff72ee5a9f0f601ff331405a3653e6a672688d3942fd43ebd1f5ff0] ...
I0316 17:47:57.885543 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a8228ba39ff72ee5a9f0f601ff331405a3653e6a672688d3942fd43ebd1f5ff0"
I0316 17:47:57.936692 481631 logs.go:123] Gathering logs for etcd [16d138fc440dd55f8a882b1a470bd88b116d89b1276ca648e106057f46db7677] ...
I0316 17:47:57.936718 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 16d138fc440dd55f8a882b1a470bd88b116d89b1276ca648e106057f46db7677"
I0316 17:47:57.996243 481631 logs.go:123] Gathering logs for etcd [53e126d87d370fc7c40afb41dc1a7f49e87707a49e2d1486adf3a6445555d955] ...
I0316 17:47:57.996310 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 53e126d87d370fc7c40afb41dc1a7f49e87707a49e2d1486adf3a6445555d955"
I0316 17:47:58.069420 481631 logs.go:123] Gathering logs for kindnet [137f2de59c6dc6edd43d77e791ff547f8b6673cd98d12a1046d38b593804d914] ...
I0316 17:47:58.069492 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 137f2de59c6dc6edd43d77e791ff547f8b6673cd98d12a1046d38b593804d914"
I0316 17:47:58.140301 481631 logs.go:123] Gathering logs for kindnet [22beb4846f86e0b94f967a82643633bda14c92a967549166bf63c77fcd3a5673] ...
I0316 17:47:58.140388 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 22beb4846f86e0b94f967a82643633bda14c92a967549166bf63c77fcd3a5673"
I0316 17:47:58.195782 481631 logs.go:123] Gathering logs for storage-provisioner [747498059d66bf6a35719a49e025168cdec4e997bd41ff614c40cd4518774adb] ...
I0316 17:47:58.195811 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 747498059d66bf6a35719a49e025168cdec4e997bd41ff614c40cd4518774adb"
I0316 17:47:58.246786 481631 logs.go:123] Gathering logs for describe nodes ...
I0316 17:47:58.246854 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0316 17:47:58.533319 481631 logs.go:123] Gathering logs for kube-proxy [53266df997beffb4f7bfa6609d282d4f498bcdb315a85073da81dd740c85139f] ...
I0316 17:47:58.533350 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 53266df997beffb4f7bfa6609d282d4f498bcdb315a85073da81dd740c85139f"
I0316 17:47:58.581039 481631 logs.go:123] Gathering logs for kube-proxy [ccbf82b14ebc82618a0db0f8cce371995c37bb4d2cd2b873a46ac53578fbec9b] ...
I0316 17:47:58.581076 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ccbf82b14ebc82618a0db0f8cce371995c37bb4d2cd2b873a46ac53578fbec9b"
I0316 17:47:58.646782 481631 logs.go:123] Gathering logs for kube-controller-manager [c5661cb115eddb01bce4d502126d119b47c1c22da24660a5c5d57202fad6e10e] ...
I0316 17:47:58.646811 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c5661cb115eddb01bce4d502126d119b47c1c22da24660a5c5d57202fad6e10e"
I0316 17:47:58.728590 481631 logs.go:123] Gathering logs for storage-provisioner [c5196a521ea11d8df3329b51f670d2873b2e489ba1e6d7bad59e4d1a58567aaf] ...
I0316 17:47:58.728623 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c5196a521ea11d8df3329b51f670d2873b2e489ba1e6d7bad59e4d1a58567aaf"
I0316 17:47:58.804089 481631 logs.go:123] Gathering logs for container status ...
I0316 17:47:58.804118 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0316 17:47:58.878284 481631 logs.go:123] Gathering logs for kubelet ...
I0316 17:47:58.878312 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0316 17:47:58.937737 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973155 660 reflector.go:138] object-"kube-system"/"coredns-token-xmxt5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-xmxt5" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.937979 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973450 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-jg8md": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-jg8md" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.938253 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973508 660 reflector.go:138] object-"default"/"default-token-v8zz6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-v8zz6" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.938518 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973560 660 reflector.go:138] object-"kube-system"/"metrics-server-token-dlrz5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-dlrz5" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.938727 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973614 660 reflector.go:138] object-"kube-system"/"kindnet-token-79qtr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-79qtr" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.938945 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973660 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-nlbsf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-nlbsf" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.939153 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973717 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.939370 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973769 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.949987 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:28 old-k8s-version-746380 kubelet[660]: E0316 17:42:28.869550 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0316 17:47:58.951000 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:29 old-k8s-version-746380 kubelet[660]: E0316 17:42:29.787727 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.953849 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:43 old-k8s-version-746380 kubelet[660]: E0316 17:42:43.570004 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0316 17:47:58.955949 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:52 old-k8s-version-746380 kubelet[660]: E0316 17:42:52.887504 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.956321 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:53 old-k8s-version-746380 kubelet[660]: E0316 17:42:53.890811 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.956858 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:56 old-k8s-version-746380 kubelet[660]: E0316 17:42:56.557270 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.957184 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:58 old-k8s-version-746380 kubelet[660]: E0316 17:42:58.242491 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.957618 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:59 old-k8s-version-746380 kubelet[660]: E0316 17:42:59.906687 660 pod_workers.go:191] Error syncing pod 5f7e0b89-084e-48fe-9574-508fd681797d ("storage-provisioner_kube-system(5f7e0b89-084e-48fe-9574-508fd681797d)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(5f7e0b89-084e-48fe-9574-508fd681797d)"
W0316 17:47:58.960398 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:10 old-k8s-version-746380 kubelet[660]: E0316 17:43:10.576290 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0316 17:47:58.961045 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:11 old-k8s-version-746380 kubelet[660]: E0316 17:43:11.935923 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.961498 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:18 old-k8s-version-746380 kubelet[660]: E0316 17:43:18.243039 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.961677 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:24 old-k8s-version-746380 kubelet[660]: E0316 17:43:24.557141 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.961999 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:30 old-k8s-version-746380 kubelet[660]: E0316 17:43:30.556868 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.962183 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:36 old-k8s-version-746380 kubelet[660]: E0316 17:43:36.556932 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.962768 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:42 old-k8s-version-746380 kubelet[660]: E0316 17:43:42.043309 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.963089 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:48 old-k8s-version-746380 kubelet[660]: E0316 17:43:48.242956 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.965567 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:51 old-k8s-version-746380 kubelet[660]: E0316 17:43:51.580010 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0316 17:47:58.965917 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:59 old-k8s-version-746380 kubelet[660]: E0316 17:43:59.556848 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.966130 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:06 old-k8s-version-746380 kubelet[660]: E0316 17:44:06.561902 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.966483 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:11 old-k8s-version-746380 kubelet[660]: E0316 17:44:11.559395 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.966688 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:18 old-k8s-version-746380 kubelet[660]: E0316 17:44:18.557203 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.967294 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:27 old-k8s-version-746380 kubelet[660]: E0316 17:44:27.155323 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.967653 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:28 old-k8s-version-746380 kubelet[660]: E0316 17:44:28.242526 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.967940 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:29 old-k8s-version-746380 kubelet[660]: E0316 17:44:29.560438 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.968151 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:42 old-k8s-version-746380 kubelet[660]: E0316 17:44:42.557018 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.968507 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:43 old-k8s-version-746380 kubelet[660]: E0316 17:44:43.556890 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.968713 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:53 old-k8s-version-746380 kubelet[660]: E0316 17:44:53.559894 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.969060 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:54 old-k8s-version-746380 kubelet[660]: E0316 17:44:54.556687 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.969408 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:06 old-k8s-version-746380 kubelet[660]: E0316 17:45:06.556647 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.969612 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:07 old-k8s-version-746380 kubelet[660]: E0316 17:45:07.558766 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.969957 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:21 old-k8s-version-746380 kubelet[660]: E0316 17:45:21.557302 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.972422 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:22 old-k8s-version-746380 kubelet[660]: E0316 17:45:22.564132 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0316 17:47:58.972631 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:33 old-k8s-version-746380 kubelet[660]: E0316 17:45:33.558085 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.973000 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:34 old-k8s-version-746380 kubelet[660]: E0316 17:45:34.556860 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.973352 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:45 old-k8s-version-746380 kubelet[660]: E0316 17:45:45.557389 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.973640 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:46 old-k8s-version-746380 kubelet[660]: E0316 17:45:46.567889 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.974263 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:57 old-k8s-version-746380 kubelet[660]: E0316 17:45:57.379216 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.974623 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:58 old-k8s-version-746380 kubelet[660]: E0316 17:45:58.382607 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.974831 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:58 old-k8s-version-746380 kubelet[660]: E0316 17:45:58.557215 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.975036 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:10 old-k8s-version-746380 kubelet[660]: E0316 17:46:10.556961 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.975387 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:13 old-k8s-version-746380 kubelet[660]: E0316 17:46:13.557158 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.975590 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:21 old-k8s-version-746380 kubelet[660]: E0316 17:46:21.557267 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.975952 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:25 old-k8s-version-746380 kubelet[660]: E0316 17:46:25.557644 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.976163 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:34 old-k8s-version-746380 kubelet[660]: E0316 17:46:34.556981 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.976517 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:39 old-k8s-version-746380 kubelet[660]: E0316 17:46:39.559649 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.976723 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:49 old-k8s-version-746380 kubelet[660]: E0316 17:46:49.557008 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.977046 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:53 old-k8s-version-746380 kubelet[660]: E0316 17:46:53.557338 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.977225 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:04 old-k8s-version-746380 kubelet[660]: E0316 17:47:04.557220 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.977547 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:05 old-k8s-version-746380 kubelet[660]: E0316 17:47:05.557240 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.977868 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:16 old-k8s-version-746380 kubelet[660]: E0316 17:47:16.557143 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.978047 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:16 old-k8s-version-746380 kubelet[660]: E0316 17:47:16.557232 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.978383 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:27 old-k8s-version-746380 kubelet[660]: E0316 17:47:27.560424 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.978563 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:27 old-k8s-version-746380 kubelet[660]: E0316 17:47:27.561727 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.978884 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:39 old-k8s-version-746380 kubelet[660]: E0316 17:47:39.565385 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.979063 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:42 old-k8s-version-746380 kubelet[660]: E0316 17:47:42.561108 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.979382 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:50 old-k8s-version-746380 kubelet[660]: E0316 17:47:50.556652 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.979563 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:56 old-k8s-version-746380 kubelet[660]: E0316 17:47:56.557033 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0316 17:47:58.979570 481631 logs.go:123] Gathering logs for kube-apiserver [f6a137e8a3b1485dd10f52919de9c0fef41fc33d23e13d15ecd70b4ee918c6d5] ...
I0316 17:47:58.979583 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f6a137e8a3b1485dd10f52919de9c0fef41fc33d23e13d15ecd70b4ee918c6d5"
I0316 17:47:59.125053 481631 out.go:304] Setting ErrFile to fd 2...
I0316 17:47:59.125091 481631 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0316 17:47:59.125167 481631 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0316 17:47:59.125176 481631 out.go:239] Mar 16 17:47:27 old-k8s-version-746380 kubelet[660]: E0316 17:47:27.561727 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 16 17:47:27 old-k8s-version-746380 kubelet[660]: E0316 17:47:27.561727 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:59.125185 481631 out.go:239] Mar 16 17:47:39 old-k8s-version-746380 kubelet[660]: E0316 17:47:39.565385 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
Mar 16 17:47:39 old-k8s-version-746380 kubelet[660]: E0316 17:47:39.565385 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:59.125193 481631 out.go:239] Mar 16 17:47:42 old-k8s-version-746380 kubelet[660]: E0316 17:47:42.561108 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 16 17:47:42 old-k8s-version-746380 kubelet[660]: E0316 17:47:42.561108 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:59.125239 481631 out.go:239] Mar 16 17:47:50 old-k8s-version-746380 kubelet[660]: E0316 17:47:50.556652 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
Mar 16 17:47:50 old-k8s-version-746380 kubelet[660]: E0316 17:47:50.556652 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:59.125249 481631 out.go:239] Mar 16 17:47:56 old-k8s-version-746380 kubelet[660]: E0316 17:47:56.557033 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 16 17:47:56 old-k8s-version-746380 kubelet[660]: E0316 17:47:56.557033 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0316 17:47:59.125261 481631 out.go:304] Setting ErrFile to fd 2...
I0316 17:47:59.125272 481631 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0316 17:48:09.125999 481631 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0316 17:48:09.141689 481631 api_server.go:72] duration metric: took 6m1.572659285s to wait for apiserver process to appear ...
I0316 17:48:09.141715 481631 api_server.go:88] waiting for apiserver healthz status ...
I0316 17:48:09.144420 481631 out.go:177]
W0316 17:48:09.146305 481631 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W0316 17:48:09.146326 481631 out.go:239] *
*
W0316 17:48:09.147294 481631 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0316 17:48:09.148762 481631 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-746380 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-746380
helpers_test.go:235: (dbg) docker inspect old-k8s-version-746380:
-- stdout --
[
{
"Id": "3df96bd4b9a513ed385047c4bc628f54de78a740c0b01e71bbf8e603d0db7657",
"Created": "2024-03-16T17:38:54.559814149Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 481810,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-03-16T17:42:00.858127848Z",
"FinishedAt": "2024-03-16T17:41:59.099110284Z"
},
"Image": "sha256:db62270b4bb0cfcde696782f7a6322baca275275e31814ce9fd8998407bf461e",
"ResolvConfPath": "/var/lib/docker/containers/3df96bd4b9a513ed385047c4bc628f54de78a740c0b01e71bbf8e603d0db7657/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/3df96bd4b9a513ed385047c4bc628f54de78a740c0b01e71bbf8e603d0db7657/hostname",
"HostsPath": "/var/lib/docker/containers/3df96bd4b9a513ed385047c4bc628f54de78a740c0b01e71bbf8e603d0db7657/hosts",
"LogPath": "/var/lib/docker/containers/3df96bd4b9a513ed385047c4bc628f54de78a740c0b01e71bbf8e603d0db7657/3df96bd4b9a513ed385047c4bc628f54de78a740c0b01e71bbf8e603d0db7657-json.log",
"Name": "/old-k8s-version-746380",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-746380:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-746380",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/593dc9613e021fdc448be608010898ac76ea854f055e8cba3c931a43285e6e11-init/diff:/var/lib/docker/overlay2/8d60f86c085005efdbad22ffe73f1ce0b89f9b32800c71896e407b2a86b69166/diff",
"MergedDir": "/var/lib/docker/overlay2/593dc9613e021fdc448be608010898ac76ea854f055e8cba3c931a43285e6e11/merged",
"UpperDir": "/var/lib/docker/overlay2/593dc9613e021fdc448be608010898ac76ea854f055e8cba3c931a43285e6e11/diff",
"WorkDir": "/var/lib/docker/overlay2/593dc9613e021fdc448be608010898ac76ea854f055e8cba3c931a43285e6e11/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "old-k8s-version-746380",
"Source": "/var/lib/docker/volumes/old-k8s-version-746380/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "old-k8s-version-746380",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-746380",
"name.minikube.sigs.k8s.io": "old-k8s-version-746380",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "eb8bb4b963a5334e1b7db5e50823c7afc7bbefb75133e1ab661206fd721fa505",
"SandboxKey": "/var/run/docker/netns/eb8bb4b963a5",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33440"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33439"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33436"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33438"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33437"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-746380": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"3df96bd4b9a5",
"old-k8s-version-746380"
],
"MacAddress": "02:42:c0:a8:4c:02",
"NetworkID": "b4e11c559a07d47b4de668fba703728b5545d960541591975a5d5d658b179fcb",
"EndpointID": "7b541ff716b68ecf3626e9a9a903c5d9f80c7f1454e6fcdb1a51281e173aa16e",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-746380",
"3df96bd4b9a5"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-746380 -n old-k8s-version-746380
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-746380 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-746380 logs -n 25: (2.531436908s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| start | -p cert-expiration-906495 | cert-expiration-906495 | jenkins | v1.32.0 | 16 Mar 24 17:37 UTC | 16 Mar 24 17:38 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-682017 | force-systemd-env-682017 | jenkins | v1.32.0 | 16 Mar 24 17:38 UTC | 16 Mar 24 17:38 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-682017 | force-systemd-env-682017 | jenkins | v1.32.0 | 16 Mar 24 17:38 UTC | 16 Mar 24 17:38 UTC |
| start | -p cert-options-380412 | cert-options-380412 | jenkins | v1.32.0 | 16 Mar 24 17:38 UTC | 16 Mar 24 17:38 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-380412 ssh | cert-options-380412 | jenkins | v1.32.0 | 16 Mar 24 17:38 UTC | 16 Mar 24 17:38 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-380412 -- sudo | cert-options-380412 | jenkins | v1.32.0 | 16 Mar 24 17:38 UTC | 16 Mar 24 17:38 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-380412 | cert-options-380412 | jenkins | v1.32.0 | 16 Mar 24 17:38 UTC | 16 Mar 24 17:38 UTC |
| start | -p old-k8s-version-746380 | old-k8s-version-746380 | jenkins | v1.32.0 | 16 Mar 24 17:38 UTC | 16 Mar 24 17:41 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-906495 | cert-expiration-906495 | jenkins | v1.32.0 | 16 Mar 24 17:41 UTC | 16 Mar 24 17:41 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-906495 | cert-expiration-906495 | jenkins | v1.32.0 | 16 Mar 24 17:41 UTC | 16 Mar 24 17:41 UTC |
| start | -p no-preload-308593 | no-preload-308593 | jenkins | v1.32.0 | 16 Mar 24 17:41 UTC | 16 Mar 24 17:42 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| addons | enable metrics-server -p old-k8s-version-746380 | old-k8s-version-746380 | jenkins | v1.32.0 | 16 Mar 24 17:41 UTC | 16 Mar 24 17:41 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-746380 | old-k8s-version-746380 | jenkins | v1.32.0 | 16 Mar 24 17:41 UTC | 16 Mar 24 17:41 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-746380 | old-k8s-version-746380 | jenkins | v1.32.0 | 16 Mar 24 17:41 UTC | 16 Mar 24 17:41 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-746380 | old-k8s-version-746380 | jenkins | v1.32.0 | 16 Mar 24 17:41 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-308593 | no-preload-308593 | jenkins | v1.32.0 | 16 Mar 24 17:42 UTC | 16 Mar 24 17:42 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-308593 | no-preload-308593 | jenkins | v1.32.0 | 16 Mar 24 17:42 UTC | 16 Mar 24 17:42 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-308593 | no-preload-308593 | jenkins | v1.32.0 | 16 Mar 24 17:42 UTC | 16 Mar 24 17:42 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-308593 | no-preload-308593 | jenkins | v1.32.0 | 16 Mar 24 17:42 UTC | 16 Mar 24 17:47 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| image | no-preload-308593 image list | no-preload-308593 | jenkins | v1.32.0 | 16 Mar 24 17:47 UTC | 16 Mar 24 17:47 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-308593 | no-preload-308593 | jenkins | v1.32.0 | 16 Mar 24 17:47 UTC | 16 Mar 24 17:47 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-308593 | no-preload-308593 | jenkins | v1.32.0 | 16 Mar 24 17:47 UTC | 16 Mar 24 17:47 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-308593 | no-preload-308593 | jenkins | v1.32.0 | 16 Mar 24 17:47 UTC | 16 Mar 24 17:47 UTC |
| delete | -p no-preload-308593 | no-preload-308593 | jenkins | v1.32.0 | 16 Mar 24 17:47 UTC | 16 Mar 24 17:47 UTC |
| start | -p embed-certs-126148 | embed-certs-126148 | jenkins | v1.32.0 | 16 Mar 24 17:47 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/03/16 17:47:46
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.1 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0316 17:47:46.089160 491570 out.go:291] Setting OutFile to fd 1 ...
I0316 17:47:46.089949 491570 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0316 17:47:46.090000 491570 out.go:304] Setting ErrFile to fd 2...
I0316 17:47:46.090020 491570 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0316 17:47:46.090434 491570 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18277-280225/.minikube/bin
I0316 17:47:46.091980 491570 out.go:298] Setting JSON to false
I0316 17:47:46.095748 491570 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":12612,"bootTime":1710598654,"procs":234,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0316 17:47:46.095871 491570 start.go:139] virtualization:
I0316 17:47:46.099235 491570 out.go:177] * [embed-certs-126148] minikube v1.32.0 on Ubuntu 20.04 (arm64)
I0316 17:47:46.101397 491570 out.go:177] - MINIKUBE_LOCATION=18277
I0316 17:47:46.103677 491570 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0316 17:47:46.101549 491570 notify.go:220] Checking for updates...
I0316 17:47:46.108497 491570 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18277-280225/kubeconfig
I0316 17:47:46.111148 491570 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18277-280225/.minikube
I0316 17:47:46.113255 491570 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0316 17:47:46.115215 491570 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0316 17:47:46.118378 491570 config.go:182] Loaded profile config "old-k8s-version-746380": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0316 17:47:46.118477 491570 driver.go:392] Setting default libvirt URI to qemu:///system
I0316 17:47:46.139771 491570 docker.go:122] docker version: linux-25.0.4:Docker Engine - Community
I0316 17:47:46.139898 491570 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0316 17:47:46.205117 491570 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:56 SystemTime:2024-03-16 17:47:46.19461967 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0316 17:47:46.205226 491570 docker.go:295] overlay module found
I0316 17:47:46.208582 491570 out.go:177] * Using the docker driver based on user configuration
I0316 17:47:46.210311 491570 start.go:297] selected driver: docker
I0316 17:47:46.210326 491570 start.go:901] validating driver "docker" against <nil>
I0316 17:47:46.210346 491570 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0316 17:47:46.211039 491570 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0316 17:47:46.264775 491570 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:56 SystemTime:2024-03-16 17:47:46.256049731 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0316 17:47:46.265007 491570 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0316 17:47:46.265255 491570 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0316 17:47:46.267512 491570 out.go:177] * Using Docker driver with root privileges
I0316 17:47:46.269317 491570 cni.go:84] Creating CNI manager for ""
I0316 17:47:46.269341 491570 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0316 17:47:46.269352 491570 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0316 17:47:46.269436 491570 start.go:340] cluster config:
{Name:embed-certs-126148 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-126148 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0316 17:47:46.273027 491570 out.go:177] * Starting "embed-certs-126148" primary control-plane node in "embed-certs-126148" cluster
I0316 17:47:46.274779 491570 cache.go:121] Beginning downloading kic base image for docker with containerd
I0316 17:47:46.276695 491570 out.go:177] * Pulling base image v0.0.42-1710284843-18375 ...
I0316 17:47:46.278438 491570 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime containerd
I0316 17:47:46.278482 491570 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f in local docker daemon
I0316 17:47:46.278491 491570 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18277-280225/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-containerd-overlay2-arm64.tar.lz4
I0316 17:47:46.278502 491570 cache.go:56] Caching tarball of preloaded images
I0316 17:47:46.278585 491570 preload.go:173] Found /home/jenkins/minikube-integration/18277-280225/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0316 17:47:46.278595 491570 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on containerd
I0316 17:47:46.278824 491570 profile.go:142] Saving config to /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/config.json ...
I0316 17:47:46.278856 491570 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/config.json: {Name:mk0f07087c2fdffcc63e8e3772483f53d0e5d42b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 17:47:46.295222 491570 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f in local docker daemon, skipping pull
I0316 17:47:46.295244 491570 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f exists in daemon, skipping load
I0316 17:47:46.295318 491570 cache.go:194] Successfully downloaded all kic artifacts
I0316 17:47:46.295351 491570 start.go:360] acquireMachinesLock for embed-certs-126148: {Name:mk0e2a1c1540ab83d29859b84f6b13ae26b17a9a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0316 17:47:46.295476 491570 start.go:364] duration metric: took 107.003µs to acquireMachinesLock for "embed-certs-126148"
I0316 17:47:46.295502 491570 start.go:93] Provisioning new machine with config: &{Name:embed-certs-126148 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-126148 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0316 17:47:46.295589 491570 start.go:125] createHost starting for "" (driver="docker")
I0316 17:47:45.313942 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:47.804246 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:46.298670 491570 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0316 17:47:46.299191 491570 start.go:159] libmachine.API.Create for "embed-certs-126148" (driver="docker")
I0316 17:47:46.300233 491570 client.go:168] LocalClient.Create starting
I0316 17:47:46.300378 491570 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca.pem
I0316 17:47:46.300416 491570 main.go:141] libmachine: Decoding PEM data...
I0316 17:47:46.300433 491570 main.go:141] libmachine: Parsing certificate...
I0316 17:47:46.300485 491570 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18277-280225/.minikube/certs/cert.pem
I0316 17:47:46.300568 491570 main.go:141] libmachine: Decoding PEM data...
I0316 17:47:46.300610 491570 main.go:141] libmachine: Parsing certificate...
I0316 17:47:46.302078 491570 cli_runner.go:164] Run: docker network inspect embed-certs-126148 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0316 17:47:46.319267 491570 cli_runner.go:211] docker network inspect embed-certs-126148 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0316 17:47:46.319357 491570 network_create.go:281] running [docker network inspect embed-certs-126148] to gather additional debugging logs...
I0316 17:47:46.319372 491570 cli_runner.go:164] Run: docker network inspect embed-certs-126148
W0316 17:47:46.337706 491570 cli_runner.go:211] docker network inspect embed-certs-126148 returned with exit code 1
I0316 17:47:46.337734 491570 network_create.go:284] error running [docker network inspect embed-certs-126148]: docker network inspect embed-certs-126148: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-126148 not found
I0316 17:47:46.337759 491570 network_create.go:286] output of [docker network inspect embed-certs-126148]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-126148 not found
** /stderr **
I0316 17:47:46.337852 491570 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0316 17:47:46.356689 491570 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-5c9a54818105 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:67:2f:dd:3c} reservation:<nil>}
I0316 17:47:46.357080 491570 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-d82c29a3afed IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:ff:93:07:95} reservation:<nil>}
I0316 17:47:46.357612 491570 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-50c055c19ff8 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:85:33:e8:ad} reservation:<nil>}
I0316 17:47:46.358204 491570 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-b4e11c559a07 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:a3:2e:e8:a5} reservation:<nil>}
I0316 17:47:46.358823 491570 network.go:206] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40025a1240}
I0316 17:47:46.358852 491570 network_create.go:124] attempt to create docker network embed-certs-126148 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I0316 17:47:46.358925 491570 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-126148 embed-certs-126148
I0316 17:47:46.421147 491570 network_create.go:108] docker network embed-certs-126148 192.168.85.0/24 created
I0316 17:47:46.421177 491570 kic.go:121] calculated static IP "192.168.85.2" for the "embed-certs-126148" container
I0316 17:47:46.421247 491570 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0316 17:47:46.437466 491570 cli_runner.go:164] Run: docker volume create embed-certs-126148 --label name.minikube.sigs.k8s.io=embed-certs-126148 --label created_by.minikube.sigs.k8s.io=true
I0316 17:47:46.460344 491570 oci.go:103] Successfully created a docker volume embed-certs-126148
I0316 17:47:46.460427 491570 cli_runner.go:164] Run: docker run --rm --name embed-certs-126148-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-126148 --entrypoint /usr/bin/test -v embed-certs-126148:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f -d /var/lib
I0316 17:47:47.135567 491570 oci.go:107] Successfully prepared a docker volume embed-certs-126148
I0316 17:47:47.135644 491570 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime containerd
I0316 17:47:47.135664 491570 kic.go:194] Starting extracting preloaded images to volume ...
I0316 17:47:47.135767 491570 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18277-280225/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-126148:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f -I lz4 -xf /preloaded.tar -C /extractDir
I0316 17:47:50.303876 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:52.814958 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:52.909655 491570 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18277-280225/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-126148:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f -I lz4 -xf /preloaded.tar -C /extractDir: (5.773847416s)
I0316 17:47:52.909686 491570 kic.go:203] duration metric: took 5.774018614s to extract preloaded images to volume ...
W0316 17:47:52.909828 491570 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0316 17:47:52.909951 491570 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0316 17:47:52.968169 491570 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-126148 --name embed-certs-126148 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-126148 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-126148 --network embed-certs-126148 --ip 192.168.85.2 --volume embed-certs-126148:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f
I0316 17:47:53.285983 491570 cli_runner.go:164] Run: docker container inspect embed-certs-126148 --format={{.State.Running}}
I0316 17:47:53.310332 491570 cli_runner.go:164] Run: docker container inspect embed-certs-126148 --format={{.State.Status}}
I0316 17:47:53.338451 491570 cli_runner.go:164] Run: docker exec embed-certs-126148 stat /var/lib/dpkg/alternatives/iptables
I0316 17:47:53.410276 491570 oci.go:144] the created container "embed-certs-126148" has a running status.
I0316 17:47:53.410315 491570 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/18277-280225/.minikube/machines/embed-certs-126148/id_rsa...
I0316 17:47:53.912907 491570 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/18277-280225/.minikube/machines/embed-certs-126148/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0316 17:47:53.948219 491570 cli_runner.go:164] Run: docker container inspect embed-certs-126148 --format={{.State.Status}}
I0316 17:47:53.980235 491570 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0316 17:47:53.980256 491570 kic_runner.go:114] Args: [docker exec --privileged embed-certs-126148 chown docker:docker /home/docker/.ssh/authorized_keys]
I0316 17:47:54.062660 491570 cli_runner.go:164] Run: docker container inspect embed-certs-126148 --format={{.State.Status}}
I0316 17:47:54.086525 491570 machine.go:94] provisionDockerMachine start ...
I0316 17:47:54.086625 491570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-126148
I0316 17:47:54.113976 491570 main.go:141] libmachine: Using SSH client type: native
I0316 17:47:54.114262 491570 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 33450 <nil> <nil>}
I0316 17:47:54.114273 491570 main.go:141] libmachine: About to run SSH command:
hostname
I0316 17:47:54.279741 491570 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-126148
I0316 17:47:54.279768 491570 ubuntu.go:169] provisioning hostname "embed-certs-126148"
I0316 17:47:54.279833 491570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-126148
I0316 17:47:54.322300 491570 main.go:141] libmachine: Using SSH client type: native
I0316 17:47:54.322575 491570 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 33450 <nil> <nil>}
I0316 17:47:54.322595 491570 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-126148 && echo "embed-certs-126148" | sudo tee /etc/hostname
I0316 17:47:54.480079 491570 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-126148
I0316 17:47:54.480184 491570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-126148
I0316 17:47:54.500096 491570 main.go:141] libmachine: Using SSH client type: native
I0316 17:47:54.500347 491570 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 33450 <nil> <nil>}
I0316 17:47:54.500370 491570 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-126148' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-126148/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-126148' | sudo tee -a /etc/hosts;
fi
fi
I0316 17:47:54.647986 491570 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0316 17:47:54.648015 491570 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18277-280225/.minikube CaCertPath:/home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18277-280225/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18277-280225/.minikube}
I0316 17:47:54.648042 491570 ubuntu.go:177] setting up certificates
I0316 17:47:54.648063 491570 provision.go:84] configureAuth start
I0316 17:47:54.648124 491570 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-126148
I0316 17:47:54.667147 491570 provision.go:143] copyHostCerts
I0316 17:47:54.667221 491570 exec_runner.go:144] found /home/jenkins/minikube-integration/18277-280225/.minikube/cert.pem, removing ...
I0316 17:47:54.667236 491570 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18277-280225/.minikube/cert.pem
I0316 17:47:54.667313 491570 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18277-280225/.minikube/cert.pem (1123 bytes)
I0316 17:47:54.667407 491570 exec_runner.go:144] found /home/jenkins/minikube-integration/18277-280225/.minikube/key.pem, removing ...
I0316 17:47:54.667417 491570 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18277-280225/.minikube/key.pem
I0316 17:47:54.667444 491570 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18277-280225/.minikube/key.pem (1675 bytes)
I0316 17:47:54.667506 491570 exec_runner.go:144] found /home/jenkins/minikube-integration/18277-280225/.minikube/ca.pem, removing ...
I0316 17:47:54.667516 491570 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18277-280225/.minikube/ca.pem
I0316 17:47:54.667541 491570 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18277-280225/.minikube/ca.pem (1078 bytes)
I0316 17:47:54.667590 491570 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18277-280225/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca-key.pem org=jenkins.embed-certs-126148 san=[127.0.0.1 192.168.85.2 embed-certs-126148 localhost minikube]
I0316 17:47:55.161665 491570 provision.go:177] copyRemoteCerts
I0316 17:47:55.161764 491570 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0316 17:47:55.161825 491570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-126148
I0316 17:47:55.179743 491570 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33450 SSHKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/embed-certs-126148/id_rsa Username:docker}
I0316 17:47:55.280629 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0316 17:47:55.319945 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0316 17:47:55.344866 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0316 17:47:55.369706 491570 provision.go:87] duration metric: took 721.628169ms to configureAuth
I0316 17:47:55.369736 491570 ubuntu.go:193] setting minikube options for container-runtime
I0316 17:47:55.369918 491570 config.go:182] Loaded profile config "embed-certs-126148": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.4
I0316 17:47:55.369934 491570 machine.go:97] duration metric: took 1.283385449s to provisionDockerMachine
I0316 17:47:55.369940 491570 client.go:171] duration metric: took 9.069693389s to LocalClient.Create
I0316 17:47:55.369959 491570 start.go:167] duration metric: took 9.070768531s to libmachine.API.Create "embed-certs-126148"
I0316 17:47:55.369969 491570 start.go:293] postStartSetup for "embed-certs-126148" (driver="docker")
I0316 17:47:55.369979 491570 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0316 17:47:55.370037 491570 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0316 17:47:55.370088 491570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-126148
I0316 17:47:55.385909 491570 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33450 SSHKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/embed-certs-126148/id_rsa Username:docker}
I0316 17:47:55.484656 491570 ssh_runner.go:195] Run: cat /etc/os-release
I0316 17:47:55.487783 491570 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0316 17:47:55.487823 491570 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0316 17:47:55.487834 491570 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0316 17:47:55.487841 491570 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0316 17:47:55.487852 491570 filesync.go:126] Scanning /home/jenkins/minikube-integration/18277-280225/.minikube/addons for local assets ...
I0316 17:47:55.487912 491570 filesync.go:126] Scanning /home/jenkins/minikube-integration/18277-280225/.minikube/files for local assets ...
I0316 17:47:55.487998 491570 filesync.go:149] local asset: /home/jenkins/minikube-integration/18277-280225/.minikube/files/etc/ssl/certs/2856332.pem -> 2856332.pem in /etc/ssl/certs
I0316 17:47:55.488106 491570 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0316 17:47:55.496886 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/files/etc/ssl/certs/2856332.pem --> /etc/ssl/certs/2856332.pem (1708 bytes)
I0316 17:47:55.522057 491570 start.go:296] duration metric: took 152.072423ms for postStartSetup
I0316 17:47:55.522461 491570 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-126148
I0316 17:47:55.537875 491570 profile.go:142] Saving config to /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/config.json ...
I0316 17:47:55.538158 491570 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0316 17:47:55.538251 491570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-126148
I0316 17:47:55.554216 491570 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33450 SSHKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/embed-certs-126148/id_rsa Username:docker}
I0316 17:47:55.656489 491570 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0316 17:47:55.661555 491570 start.go:128] duration metric: took 9.365914328s to createHost
I0316 17:47:55.661578 491570 start.go:83] releasing machines lock for "embed-certs-126148", held for 9.366092674s
I0316 17:47:55.661649 491570 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-126148
I0316 17:47:55.677812 491570 ssh_runner.go:195] Run: cat /version.json
I0316 17:47:55.677864 491570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-126148
I0316 17:47:55.678174 491570 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0316 17:47:55.678223 491570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-126148
I0316 17:47:55.696456 491570 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33450 SSHKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/embed-certs-126148/id_rsa Username:docker}
I0316 17:47:55.709105 491570 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33450 SSHKeyPath:/home/jenkins/minikube-integration/18277-280225/.minikube/machines/embed-certs-126148/id_rsa Username:docker}
I0316 17:47:55.924986 491570 ssh_runner.go:195] Run: systemctl --version
I0316 17:47:55.929976 491570 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0316 17:47:55.934726 491570 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0316 17:47:55.961758 491570 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0316 17:47:55.961875 491570 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0316 17:47:55.991404 491570 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0316 17:47:55.991429 491570 start.go:494] detecting cgroup driver to use...
I0316 17:47:55.991496 491570 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0316 17:47:55.991573 491570 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0316 17:47:56.007569 491570 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0316 17:47:56.021020 491570 docker.go:217] disabling cri-docker service (if available) ...
I0316 17:47:56.021115 491570 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0316 17:47:56.035546 491570 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0316 17:47:56.052762 491570 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0316 17:47:56.144966 491570 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0316 17:47:56.232513 491570 docker.go:233] disabling docker service ...
I0316 17:47:56.232609 491570 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0316 17:47:56.257826 491570 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0316 17:47:56.270033 491570 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0316 17:47:56.365339 491570 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0316 17:47:56.463236 491570 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0316 17:47:56.475374 491570 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0316 17:47:56.492237 491570 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0316 17:47:56.502575 491570 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0316 17:47:56.515736 491570 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0316 17:47:56.515811 491570 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0316 17:47:56.529830 491570 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0316 17:47:56.540174 491570 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0316 17:47:56.551142 491570 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0316 17:47:56.563706 491570 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0316 17:47:56.574223 491570 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0316 17:47:56.584074 491570 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0316 17:47:56.592715 491570 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0316 17:47:56.601606 491570 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0316 17:47:56.691983 491570 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0316 17:47:56.842720 491570 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0316 17:47:56.842793 491570 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0316 17:47:56.849973 491570 start.go:562] Will wait 60s for crictl version
I0316 17:47:56.850080 491570 ssh_runner.go:195] Run: which crictl
I0316 17:47:56.856458 491570 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0316 17:47:56.910850 491570 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.28
RuntimeApiVersion: v1
I0316 17:47:56.910915 491570 ssh_runner.go:195] Run: containerd --version
I0316 17:47:56.942035 491570 ssh_runner.go:195] Run: containerd --version
I0316 17:47:56.975254 491570 out.go:177] * Preparing Kubernetes v1.28.4 on containerd 1.6.28 ...
I0316 17:47:55.305590 481631 pod_ready.go:102] pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace has status "Ready":"False"
I0316 17:47:56.801819 481631 pod_ready.go:81] duration metric: took 4m0.005459581s for pod "metrics-server-9975d5f86-s65lt" in "kube-system" namespace to be "Ready" ...
E0316 17:47:56.801842 481631 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0316 17:47:56.801850 481631 pod_ready.go:38] duration metric: took 5m29.760095608s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0316 17:47:56.801864 481631 api_server.go:52] waiting for apiserver process to appear ...
I0316 17:47:56.801890 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0316 17:47:56.801947 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0316 17:47:56.846384 481631 cri.go:89] found id: "f6a137e8a3b1485dd10f52919de9c0fef41fc33d23e13d15ecd70b4ee918c6d5"
I0316 17:47:56.846404 481631 cri.go:89] found id: "0340e5ca0be60b47abce880f66d4c4e5fc876c20b19e0b5c769ec2a4f1b8547b"
I0316 17:47:56.846409 481631 cri.go:89] found id: ""
I0316 17:47:56.846417 481631 logs.go:276] 2 containers: [f6a137e8a3b1485dd10f52919de9c0fef41fc33d23e13d15ecd70b4ee918c6d5 0340e5ca0be60b47abce880f66d4c4e5fc876c20b19e0b5c769ec2a4f1b8547b]
I0316 17:47:56.846473 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:56.851464 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:56.855231 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0316 17:47:56.855291 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0316 17:47:56.900649 481631 cri.go:89] found id: "16d138fc440dd55f8a882b1a470bd88b116d89b1276ca648e106057f46db7677"
I0316 17:47:56.900668 481631 cri.go:89] found id: "53e126d87d370fc7c40afb41dc1a7f49e87707a49e2d1486adf3a6445555d955"
I0316 17:47:56.900673 481631 cri.go:89] found id: ""
I0316 17:47:56.900680 481631 logs.go:276] 2 containers: [16d138fc440dd55f8a882b1a470bd88b116d89b1276ca648e106057f46db7677 53e126d87d370fc7c40afb41dc1a7f49e87707a49e2d1486adf3a6445555d955]
I0316 17:47:56.900734 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:56.904641 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:56.908512 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0316 17:47:56.908579 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0316 17:47:56.958196 481631 cri.go:89] found id: "8dd0ee223c90f99d346db9114977e56c2bbfecb904aa1223b3e8e1109264981d"
I0316 17:47:56.958221 481631 cri.go:89] found id: "a7700f61f9427c51311df28b60dc3da67a68a1be40d1f17810185e95a656508c"
I0316 17:47:56.958227 481631 cri.go:89] found id: ""
I0316 17:47:56.958235 481631 logs.go:276] 2 containers: [8dd0ee223c90f99d346db9114977e56c2bbfecb904aa1223b3e8e1109264981d a7700f61f9427c51311df28b60dc3da67a68a1be40d1f17810185e95a656508c]
I0316 17:47:56.958356 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:56.962503 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:56.966137 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0316 17:47:56.966233 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0316 17:47:57.030461 481631 cri.go:89] found id: "bf0d1869cc0d68bb43a663a92a7a2eb950593536676cefca598146c6f602803e"
I0316 17:47:57.030487 481631 cri.go:89] found id: "bb9fc8b360819c7a19f5e182ffa90ecf3dc71344631dac019d43ec3d489bbb79"
I0316 17:47:57.030492 481631 cri.go:89] found id: ""
I0316 17:47:57.030499 481631 logs.go:276] 2 containers: [bf0d1869cc0d68bb43a663a92a7a2eb950593536676cefca598146c6f602803e bb9fc8b360819c7a19f5e182ffa90ecf3dc71344631dac019d43ec3d489bbb79]
I0316 17:47:57.030555 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.035500 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.040606 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0316 17:47:57.040685 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0316 17:47:57.088626 481631 cri.go:89] found id: "53266df997beffb4f7bfa6609d282d4f498bcdb315a85073da81dd740c85139f"
I0316 17:47:57.088650 481631 cri.go:89] found id: "ccbf82b14ebc82618a0db0f8cce371995c37bb4d2cd2b873a46ac53578fbec9b"
I0316 17:47:57.088655 481631 cri.go:89] found id: ""
I0316 17:47:57.088663 481631 logs.go:276] 2 containers: [53266df997beffb4f7bfa6609d282d4f498bcdb315a85073da81dd740c85139f ccbf82b14ebc82618a0db0f8cce371995c37bb4d2cd2b873a46ac53578fbec9b]
I0316 17:47:57.088727 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.093520 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.097632 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0316 17:47:57.097706 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0316 17:47:57.145155 481631 cri.go:89] found id: "c5661cb115eddb01bce4d502126d119b47c1c22da24660a5c5d57202fad6e10e"
I0316 17:47:57.145180 481631 cri.go:89] found id: "3ffcf3139cf08c2e735e53f3bed4469b3466bcbedc7c3cb0bba55d896472640b"
I0316 17:47:57.145184 481631 cri.go:89] found id: ""
I0316 17:47:57.145191 481631 logs.go:276] 2 containers: [c5661cb115eddb01bce4d502126d119b47c1c22da24660a5c5d57202fad6e10e 3ffcf3139cf08c2e735e53f3bed4469b3466bcbedc7c3cb0bba55d896472640b]
I0316 17:47:57.145246 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.149767 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.154500 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0316 17:47:57.154575 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0316 17:47:57.209384 481631 cri.go:89] found id: "137f2de59c6dc6edd43d77e791ff547f8b6673cd98d12a1046d38b593804d914"
I0316 17:47:57.209408 481631 cri.go:89] found id: "22beb4846f86e0b94f967a82643633bda14c92a967549166bf63c77fcd3a5673"
I0316 17:47:57.209413 481631 cri.go:89] found id: ""
I0316 17:47:57.209420 481631 logs.go:276] 2 containers: [137f2de59c6dc6edd43d77e791ff547f8b6673cd98d12a1046d38b593804d914 22beb4846f86e0b94f967a82643633bda14c92a967549166bf63c77fcd3a5673]
I0316 17:47:57.209516 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.213954 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.217759 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0316 17:47:57.217870 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0316 17:47:57.275699 481631 cri.go:89] found id: "747498059d66bf6a35719a49e025168cdec4e997bd41ff614c40cd4518774adb"
I0316 17:47:57.275725 481631 cri.go:89] found id: "c5196a521ea11d8df3329b51f670d2873b2e489ba1e6d7bad59e4d1a58567aaf"
I0316 17:47:57.275731 481631 cri.go:89] found id: ""
I0316 17:47:57.275762 481631 logs.go:276] 2 containers: [747498059d66bf6a35719a49e025168cdec4e997bd41ff614c40cd4518774adb c5196a521ea11d8df3329b51f670d2873b2e489ba1e6d7bad59e4d1a58567aaf]
I0316 17:47:57.275818 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.280001 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.283560 481631 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0316 17:47:57.283668 481631 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0316 17:47:57.325685 481631 cri.go:89] found id: "a8228ba39ff72ee5a9f0f601ff331405a3653e6a672688d3942fd43ebd1f5ff0"
I0316 17:47:57.325707 481631 cri.go:89] found id: ""
I0316 17:47:57.325715 481631 logs.go:276] 1 containers: [a8228ba39ff72ee5a9f0f601ff331405a3653e6a672688d3942fd43ebd1f5ff0]
I0316 17:47:57.325806 481631 ssh_runner.go:195] Run: which crictl
I0316 17:47:57.335361 481631 logs.go:123] Gathering logs for coredns [8dd0ee223c90f99d346db9114977e56c2bbfecb904aa1223b3e8e1109264981d] ...
I0316 17:47:57.335400 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8dd0ee223c90f99d346db9114977e56c2bbfecb904aa1223b3e8e1109264981d"
I0316 17:47:57.386271 481631 logs.go:123] Gathering logs for coredns [a7700f61f9427c51311df28b60dc3da67a68a1be40d1f17810185e95a656508c] ...
I0316 17:47:57.386305 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a7700f61f9427c51311df28b60dc3da67a68a1be40d1f17810185e95a656508c"
I0316 17:47:57.438268 481631 logs.go:123] Gathering logs for kube-scheduler [bb9fc8b360819c7a19f5e182ffa90ecf3dc71344631dac019d43ec3d489bbb79] ...
I0316 17:47:57.438345 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bb9fc8b360819c7a19f5e182ffa90ecf3dc71344631dac019d43ec3d489bbb79"
I0316 17:47:57.492639 481631 logs.go:123] Gathering logs for kube-controller-manager [3ffcf3139cf08c2e735e53f3bed4469b3466bcbedc7c3cb0bba55d896472640b] ...
I0316 17:47:57.492672 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3ffcf3139cf08c2e735e53f3bed4469b3466bcbedc7c3cb0bba55d896472640b"
I0316 17:47:57.622160 481631 logs.go:123] Gathering logs for containerd ...
I0316 17:47:57.622192 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0316 17:47:57.692049 481631 logs.go:123] Gathering logs for dmesg ...
I0316 17:47:57.692087 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0316 17:47:57.712218 481631 logs.go:123] Gathering logs for kube-apiserver [0340e5ca0be60b47abce880f66d4c4e5fc876c20b19e0b5c769ec2a4f1b8547b] ...
I0316 17:47:57.712297 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0340e5ca0be60b47abce880f66d4c4e5fc876c20b19e0b5c769ec2a4f1b8547b"
I0316 17:47:57.824470 481631 logs.go:123] Gathering logs for kube-scheduler [bf0d1869cc0d68bb43a663a92a7a2eb950593536676cefca598146c6f602803e] ...
I0316 17:47:57.824542 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bf0d1869cc0d68bb43a663a92a7a2eb950593536676cefca598146c6f602803e"
I0316 17:47:57.885521 481631 logs.go:123] Gathering logs for kubernetes-dashboard [a8228ba39ff72ee5a9f0f601ff331405a3653e6a672688d3942fd43ebd1f5ff0] ...
I0316 17:47:57.885543 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a8228ba39ff72ee5a9f0f601ff331405a3653e6a672688d3942fd43ebd1f5ff0"
I0316 17:47:57.936692 481631 logs.go:123] Gathering logs for etcd [16d138fc440dd55f8a882b1a470bd88b116d89b1276ca648e106057f46db7677] ...
I0316 17:47:57.936718 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 16d138fc440dd55f8a882b1a470bd88b116d89b1276ca648e106057f46db7677"
I0316 17:47:57.996243 481631 logs.go:123] Gathering logs for etcd [53e126d87d370fc7c40afb41dc1a7f49e87707a49e2d1486adf3a6445555d955] ...
I0316 17:47:57.996310 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 53e126d87d370fc7c40afb41dc1a7f49e87707a49e2d1486adf3a6445555d955"
I0316 17:47:58.069420 481631 logs.go:123] Gathering logs for kindnet [137f2de59c6dc6edd43d77e791ff547f8b6673cd98d12a1046d38b593804d914] ...
I0316 17:47:58.069492 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 137f2de59c6dc6edd43d77e791ff547f8b6673cd98d12a1046d38b593804d914"
I0316 17:47:58.140301 481631 logs.go:123] Gathering logs for kindnet [22beb4846f86e0b94f967a82643633bda14c92a967549166bf63c77fcd3a5673] ...
I0316 17:47:58.140388 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 22beb4846f86e0b94f967a82643633bda14c92a967549166bf63c77fcd3a5673"
I0316 17:47:58.195782 481631 logs.go:123] Gathering logs for storage-provisioner [747498059d66bf6a35719a49e025168cdec4e997bd41ff614c40cd4518774adb] ...
I0316 17:47:58.195811 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 747498059d66bf6a35719a49e025168cdec4e997bd41ff614c40cd4518774adb"
I0316 17:47:58.246786 481631 logs.go:123] Gathering logs for describe nodes ...
I0316 17:47:58.246854 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0316 17:47:58.533319 481631 logs.go:123] Gathering logs for kube-proxy [53266df997beffb4f7bfa6609d282d4f498bcdb315a85073da81dd740c85139f] ...
I0316 17:47:58.533350 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 53266df997beffb4f7bfa6609d282d4f498bcdb315a85073da81dd740c85139f"
I0316 17:47:58.581039 481631 logs.go:123] Gathering logs for kube-proxy [ccbf82b14ebc82618a0db0f8cce371995c37bb4d2cd2b873a46ac53578fbec9b] ...
I0316 17:47:58.581076 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ccbf82b14ebc82618a0db0f8cce371995c37bb4d2cd2b873a46ac53578fbec9b"
I0316 17:47:58.646782 481631 logs.go:123] Gathering logs for kube-controller-manager [c5661cb115eddb01bce4d502126d119b47c1c22da24660a5c5d57202fad6e10e] ...
I0316 17:47:58.646811 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c5661cb115eddb01bce4d502126d119b47c1c22da24660a5c5d57202fad6e10e"
I0316 17:47:58.728590 481631 logs.go:123] Gathering logs for storage-provisioner [c5196a521ea11d8df3329b51f670d2873b2e489ba1e6d7bad59e4d1a58567aaf] ...
I0316 17:47:58.728623 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c5196a521ea11d8df3329b51f670d2873b2e489ba1e6d7bad59e4d1a58567aaf"
I0316 17:47:58.804089 481631 logs.go:123] Gathering logs for container status ...
I0316 17:47:58.804118 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0316 17:47:58.878284 481631 logs.go:123] Gathering logs for kubelet ...
I0316 17:47:58.878312 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0316 17:47:58.937737 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973155 660 reflector.go:138] object-"kube-system"/"coredns-token-xmxt5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-xmxt5" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.937979 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973450 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-jg8md": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-jg8md" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.938253 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973508 660 reflector.go:138] object-"default"/"default-token-v8zz6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-v8zz6" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.938518 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973560 660 reflector.go:138] object-"kube-system"/"metrics-server-token-dlrz5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-dlrz5" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.938727 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973614 660 reflector.go:138] object-"kube-system"/"kindnet-token-79qtr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-79qtr" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.938945 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973660 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-nlbsf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-nlbsf" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.939153 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973717 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.939370 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:26 old-k8s-version-746380 kubelet[660]: E0316 17:42:26.973769 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-746380" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-746380' and this object
W0316 17:47:58.949987 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:28 old-k8s-version-746380 kubelet[660]: E0316 17:42:28.869550 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0316 17:47:58.951000 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:29 old-k8s-version-746380 kubelet[660]: E0316 17:42:29.787727 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.953849 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:43 old-k8s-version-746380 kubelet[660]: E0316 17:42:43.570004 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0316 17:47:58.955949 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:52 old-k8s-version-746380 kubelet[660]: E0316 17:42:52.887504 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.956321 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:53 old-k8s-version-746380 kubelet[660]: E0316 17:42:53.890811 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.956858 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:56 old-k8s-version-746380 kubelet[660]: E0316 17:42:56.557270 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.957184 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:58 old-k8s-version-746380 kubelet[660]: E0316 17:42:58.242491 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.957618 481631 logs.go:138] Found kubelet problem: Mar 16 17:42:59 old-k8s-version-746380 kubelet[660]: E0316 17:42:59.906687 660 pod_workers.go:191] Error syncing pod 5f7e0b89-084e-48fe-9574-508fd681797d ("storage-provisioner_kube-system(5f7e0b89-084e-48fe-9574-508fd681797d)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(5f7e0b89-084e-48fe-9574-508fd681797d)"
W0316 17:47:58.960398 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:10 old-k8s-version-746380 kubelet[660]: E0316 17:43:10.576290 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0316 17:47:58.961045 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:11 old-k8s-version-746380 kubelet[660]: E0316 17:43:11.935923 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.961498 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:18 old-k8s-version-746380 kubelet[660]: E0316 17:43:18.243039 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.961677 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:24 old-k8s-version-746380 kubelet[660]: E0316 17:43:24.557141 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.961999 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:30 old-k8s-version-746380 kubelet[660]: E0316 17:43:30.556868 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.962183 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:36 old-k8s-version-746380 kubelet[660]: E0316 17:43:36.556932 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.962768 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:42 old-k8s-version-746380 kubelet[660]: E0316 17:43:42.043309 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.963089 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:48 old-k8s-version-746380 kubelet[660]: E0316 17:43:48.242956 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.965567 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:51 old-k8s-version-746380 kubelet[660]: E0316 17:43:51.580010 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0316 17:47:58.965917 481631 logs.go:138] Found kubelet problem: Mar 16 17:43:59 old-k8s-version-746380 kubelet[660]: E0316 17:43:59.556848 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.966130 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:06 old-k8s-version-746380 kubelet[660]: E0316 17:44:06.561902 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.966483 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:11 old-k8s-version-746380 kubelet[660]: E0316 17:44:11.559395 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.966688 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:18 old-k8s-version-746380 kubelet[660]: E0316 17:44:18.557203 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.967294 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:27 old-k8s-version-746380 kubelet[660]: E0316 17:44:27.155323 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.967653 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:28 old-k8s-version-746380 kubelet[660]: E0316 17:44:28.242526 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.967940 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:29 old-k8s-version-746380 kubelet[660]: E0316 17:44:29.560438 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.968151 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:42 old-k8s-version-746380 kubelet[660]: E0316 17:44:42.557018 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.968507 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:43 old-k8s-version-746380 kubelet[660]: E0316 17:44:43.556890 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.968713 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:53 old-k8s-version-746380 kubelet[660]: E0316 17:44:53.559894 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.969060 481631 logs.go:138] Found kubelet problem: Mar 16 17:44:54 old-k8s-version-746380 kubelet[660]: E0316 17:44:54.556687 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.969408 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:06 old-k8s-version-746380 kubelet[660]: E0316 17:45:06.556647 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.969612 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:07 old-k8s-version-746380 kubelet[660]: E0316 17:45:07.558766 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.969957 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:21 old-k8s-version-746380 kubelet[660]: E0316 17:45:21.557302 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.972422 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:22 old-k8s-version-746380 kubelet[660]: E0316 17:45:22.564132 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0316 17:47:58.972631 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:33 old-k8s-version-746380 kubelet[660]: E0316 17:45:33.558085 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.973000 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:34 old-k8s-version-746380 kubelet[660]: E0316 17:45:34.556860 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.973352 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:45 old-k8s-version-746380 kubelet[660]: E0316 17:45:45.557389 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.973640 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:46 old-k8s-version-746380 kubelet[660]: E0316 17:45:46.567889 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.974263 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:57 old-k8s-version-746380 kubelet[660]: E0316 17:45:57.379216 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.974623 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:58 old-k8s-version-746380 kubelet[660]: E0316 17:45:58.382607 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.974831 481631 logs.go:138] Found kubelet problem: Mar 16 17:45:58 old-k8s-version-746380 kubelet[660]: E0316 17:45:58.557215 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.975036 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:10 old-k8s-version-746380 kubelet[660]: E0316 17:46:10.556961 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.975387 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:13 old-k8s-version-746380 kubelet[660]: E0316 17:46:13.557158 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.975590 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:21 old-k8s-version-746380 kubelet[660]: E0316 17:46:21.557267 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.975952 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:25 old-k8s-version-746380 kubelet[660]: E0316 17:46:25.557644 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.976163 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:34 old-k8s-version-746380 kubelet[660]: E0316 17:46:34.556981 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.976517 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:39 old-k8s-version-746380 kubelet[660]: E0316 17:46:39.559649 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.976723 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:49 old-k8s-version-746380 kubelet[660]: E0316 17:46:49.557008 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.977046 481631 logs.go:138] Found kubelet problem: Mar 16 17:46:53 old-k8s-version-746380 kubelet[660]: E0316 17:46:53.557338 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.977225 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:04 old-k8s-version-746380 kubelet[660]: E0316 17:47:04.557220 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.977547 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:05 old-k8s-version-746380 kubelet[660]: E0316 17:47:05.557240 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.977868 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:16 old-k8s-version-746380 kubelet[660]: E0316 17:47:16.557143 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.978047 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:16 old-k8s-version-746380 kubelet[660]: E0316 17:47:16.557232 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.978383 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:27 old-k8s-version-746380 kubelet[660]: E0316 17:47:27.560424 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.978563 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:27 old-k8s-version-746380 kubelet[660]: E0316 17:47:27.561727 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.978884 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:39 old-k8s-version-746380 kubelet[660]: E0316 17:47:39.565385 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.979063 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:42 old-k8s-version-746380 kubelet[660]: E0316 17:47:42.561108 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:58.979382 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:50 old-k8s-version-746380 kubelet[660]: E0316 17:47:50.556652 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:58.979563 481631 logs.go:138] Found kubelet problem: Mar 16 17:47:56 old-k8s-version-746380 kubelet[660]: E0316 17:47:56.557033 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0316 17:47:58.979570 481631 logs.go:123] Gathering logs for kube-apiserver [f6a137e8a3b1485dd10f52919de9c0fef41fc33d23e13d15ecd70b4ee918c6d5] ...
I0316 17:47:58.979583 481631 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f6a137e8a3b1485dd10f52919de9c0fef41fc33d23e13d15ecd70b4ee918c6d5"
I0316 17:47:59.125053 481631 out.go:304] Setting ErrFile to fd 2...
I0316 17:47:59.125091 481631 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0316 17:47:59.125167 481631 out.go:239] X Problems detected in kubelet:
W0316 17:47:59.125176 481631 out.go:239] Mar 16 17:47:27 old-k8s-version-746380 kubelet[660]: E0316 17:47:27.561727 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:59.125185 481631 out.go:239] Mar 16 17:47:39 old-k8s-version-746380 kubelet[660]: E0316 17:47:39.565385 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:59.125193 481631 out.go:239] Mar 16 17:47:42 old-k8s-version-746380 kubelet[660]: E0316 17:47:42.561108 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0316 17:47:59.125239 481631 out.go:239] Mar 16 17:47:50 old-k8s-version-746380 kubelet[660]: E0316 17:47:50.556652 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
W0316 17:47:59.125249 481631 out.go:239] Mar 16 17:47:56 old-k8s-version-746380 kubelet[660]: E0316 17:47:56.557033 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0316 17:47:59.125261 481631 out.go:304] Setting ErrFile to fd 2...
I0316 17:47:59.125272 481631 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0316 17:47:56.977041 491570 cli_runner.go:164] Run: docker network inspect embed-certs-126148 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0316 17:47:56.994512 491570 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0316 17:47:56.999303 491570 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0316 17:47:57.019696 491570 kubeadm.go:877] updating cluster {Name:embed-certs-126148 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-126148 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0316 17:47:57.019827 491570 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime containerd
I0316 17:47:57.019915 491570 ssh_runner.go:195] Run: sudo crictl images --output json
I0316 17:47:57.077558 491570 containerd.go:612] all images are preloaded for containerd runtime.
I0316 17:47:57.077580 491570 containerd.go:519] Images already preloaded, skipping extraction
I0316 17:47:57.077649 491570 ssh_runner.go:195] Run: sudo crictl images --output json
I0316 17:47:57.133213 491570 containerd.go:612] all images are preloaded for containerd runtime.
I0316 17:47:57.133233 491570 cache_images.go:84] Images are preloaded, skipping loading
I0316 17:47:57.133241 491570 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.28.4 containerd true true} ...
I0316 17:47:57.133335 491570 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-126148 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:embed-certs-126148 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0316 17:47:57.133403 491570 ssh_runner.go:195] Run: sudo crictl info
I0316 17:47:57.187761 491570 cni.go:84] Creating CNI manager for ""
I0316 17:47:57.187833 491570 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0316 17:47:57.187859 491570 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0316 17:47:57.187902 491570 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-126148 NodeName:embed-certs-126148 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0316 17:47:57.188056 491570 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "embed-certs-126148"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0316 17:47:57.188146 491570 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0316 17:47:57.199396 491570 binaries.go:44] Found k8s binaries, skipping transfer
I0316 17:47:57.199461 491570 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0316 17:47:57.209401 491570 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
I0316 17:47:57.231714 491570 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0316 17:47:57.253246 491570 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes)
I0316 17:47:57.274189 491570 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0316 17:47:57.278452 491570 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0316 17:47:57.291414 491570 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0316 17:47:57.407058 491570 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0316 17:47:57.434428 491570 certs.go:68] Setting up /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148 for IP: 192.168.85.2
I0316 17:47:57.434484 491570 certs.go:194] generating shared ca certs ...
I0316 17:47:57.434514 491570 certs.go:226] acquiring lock for ca certs: {Name:mk6d455ecce74ad164a5c9d511b938033d09479f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 17:47:57.434658 491570 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18277-280225/.minikube/ca.key
I0316 17:47:57.434749 491570 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18277-280225/.minikube/proxy-client-ca.key
I0316 17:47:57.434784 491570 certs.go:256] generating profile certs ...
I0316 17:47:57.434860 491570 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/client.key
I0316 17:47:57.434892 491570 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/client.crt with IP's: []
I0316 17:47:58.239924 491570 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/client.crt ...
I0316 17:47:58.239958 491570 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/client.crt: {Name:mk8c577b3361820b2fc7bb62eaff66babd82ad7f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 17:47:58.240769 491570 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/client.key ...
I0316 17:47:58.240789 491570 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/client.key: {Name:mke32d2a4481f6429eb296745fccb71bd0d6bdf3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 17:47:58.240909 491570 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/apiserver.key.6b08b102
I0316 17:47:58.240930 491570 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/apiserver.crt.6b08b102 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.85.2]
I0316 17:47:58.581474 491570 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/apiserver.crt.6b08b102 ...
I0316 17:47:58.581518 491570 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/apiserver.crt.6b08b102: {Name:mkbff8a1083c4ab9c0b19af81274692e40b4f1ef Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 17:47:58.581701 491570 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/apiserver.key.6b08b102 ...
I0316 17:47:58.581739 491570 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/apiserver.key.6b08b102: {Name:mke59123d5a6aaf7b087bbe74858f403d08edb3f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 17:47:58.581845 491570 certs.go:381] copying /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/apiserver.crt.6b08b102 -> /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/apiserver.crt
I0316 17:47:58.582039 491570 certs.go:385] copying /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/apiserver.key.6b08b102 -> /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/apiserver.key
I0316 17:47:58.582140 491570 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/proxy-client.key
I0316 17:47:58.582176 491570 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/proxy-client.crt with IP's: []
I0316 17:47:59.578910 491570 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/proxy-client.crt ...
I0316 17:47:59.578987 491570 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/proxy-client.crt: {Name:mk815d2cad2be4f2c38ddacc512c9fd92f0ae508 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 17:47:59.579199 491570 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/proxy-client.key ...
I0316 17:47:59.579253 491570 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/proxy-client.key: {Name:mkd24c9dc6e99a7f1d1781091995932a1a11d177 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0316 17:47:59.579492 491570 certs.go:484] found cert: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/285633.pem (1338 bytes)
W0316 17:47:59.579591 491570 certs.go:480] ignoring /home/jenkins/minikube-integration/18277-280225/.minikube/certs/285633_empty.pem, impossibly tiny 0 bytes
I0316 17:47:59.579656 491570 certs.go:484] found cert: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca-key.pem (1679 bytes)
I0316 17:47:59.579716 491570 certs.go:484] found cert: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/ca.pem (1078 bytes)
I0316 17:47:59.579779 491570 certs.go:484] found cert: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/cert.pem (1123 bytes)
I0316 17:47:59.579840 491570 certs.go:484] found cert: /home/jenkins/minikube-integration/18277-280225/.minikube/certs/key.pem (1675 bytes)
I0316 17:47:59.579909 491570 certs.go:484] found cert: /home/jenkins/minikube-integration/18277-280225/.minikube/files/etc/ssl/certs/2856332.pem (1708 bytes)
I0316 17:47:59.580600 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0316 17:47:59.608231 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0316 17:47:59.642962 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0316 17:47:59.669169 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0316 17:47:59.699661 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0316 17:47:59.727238 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0316 17:47:59.753907 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0316 17:47:59.782256 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/profiles/embed-certs-126148/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0316 17:47:59.811894 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/files/etc/ssl/certs/2856332.pem --> /usr/share/ca-certificates/2856332.pem (1708 bytes)
I0316 17:47:59.838601 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0316 17:47:59.870341 491570 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18277-280225/.minikube/certs/285633.pem --> /usr/share/ca-certificates/285633.pem (1338 bytes)
I0316 17:47:59.896056 491570 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0316 17:47:59.915413 491570 ssh_runner.go:195] Run: openssl version
I0316 17:47:59.921343 491570 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2856332.pem && ln -fs /usr/share/ca-certificates/2856332.pem /etc/ssl/certs/2856332.pem"
I0316 17:47:59.932117 491570 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2856332.pem
I0316 17:47:59.935935 491570 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 16 17:01 /usr/share/ca-certificates/2856332.pem
I0316 17:47:59.936002 491570 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2856332.pem
I0316 17:47:59.943163 491570 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/2856332.pem /etc/ssl/certs/3ec20f2e.0"
I0316 17:47:59.953505 491570 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0316 17:47:59.963236 491570 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0316 17:47:59.966960 491570 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 16 16:56 /usr/share/ca-certificates/minikubeCA.pem
I0316 17:47:59.967027 491570 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0316 17:47:59.974780 491570 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0316 17:47:59.984658 491570 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/285633.pem && ln -fs /usr/share/ca-certificates/285633.pem /etc/ssl/certs/285633.pem"
I0316 17:47:59.993990 491570 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/285633.pem
I0316 17:47:59.997467 491570 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 16 17:01 /usr/share/ca-certificates/285633.pem
I0316 17:47:59.997535 491570 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/285633.pem
I0316 17:48:00.009615 491570 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/285633.pem /etc/ssl/certs/51391683.0"
I0316 17:48:00.039761 491570 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0316 17:48:00.059899 491570 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0316 17:48:00.059989 491570 kubeadm.go:391] StartCluster: {Name:embed-certs-126148 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-126148 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fal
se CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0316 17:48:00.060089 491570 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0316 17:48:00.060176 491570 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0316 17:48:00.206620 491570 cri.go:89] found id: ""
I0316 17:48:00.206805 491570 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0316 17:48:00.273976 491570 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0316 17:48:00.347521 491570 kubeadm.go:213] ignoring SystemVerification for kubeadm because of docker driver
I0316 17:48:00.347859 491570 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0316 17:48:00.373618 491570 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0316 17:48:00.373642 491570 kubeadm.go:156] found existing configuration files:
I0316 17:48:00.373709 491570 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0316 17:48:00.391788 491570 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0316 17:48:00.391885 491570 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0316 17:48:00.422215 491570 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0316 17:48:00.450654 491570 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0316 17:48:00.450736 491570 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0316 17:48:00.466479 491570 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0316 17:48:00.479511 491570 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0316 17:48:00.479719 491570 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0316 17:48:00.490869 491570 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0316 17:48:00.503307 491570 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0316 17:48:00.503479 491570 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0316 17:48:00.515242 491570 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0316 17:48:00.585618 491570 kubeadm.go:309] [init] Using Kubernetes version: v1.28.4
I0316 17:48:00.586029 491570 kubeadm.go:309] [preflight] Running pre-flight checks
I0316 17:48:00.645904 491570 kubeadm.go:309] [preflight] The system verification failed. Printing the output from the verification:
I0316 17:48:00.645978 491570 kubeadm.go:309] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1055-aws[0m
I0316 17:48:00.646018 491570 kubeadm.go:309] [0;37mOS[0m: [0;32mLinux[0m
I0316 17:48:00.646073 491570 kubeadm.go:309] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0316 17:48:00.646124 491570 kubeadm.go:309] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0316 17:48:00.646173 491570 kubeadm.go:309] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0316 17:48:00.646225 491570 kubeadm.go:309] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0316 17:48:00.646283 491570 kubeadm.go:309] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0316 17:48:00.646336 491570 kubeadm.go:309] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0316 17:48:00.646386 491570 kubeadm.go:309] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0316 17:48:00.646436 491570 kubeadm.go:309] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0316 17:48:00.646487 491570 kubeadm.go:309] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0316 17:48:00.729198 491570 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0316 17:48:00.729414 491570 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0316 17:48:00.729562 491570 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0316 17:48:00.991046 491570 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0316 17:48:00.994821 491570 out.go:204] - Generating certificates and keys ...
I0316 17:48:00.994939 491570 kubeadm.go:309] [certs] Using existing ca certificate authority
I0316 17:48:00.995022 491570 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0316 17:48:01.707733 491570 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0316 17:48:02.493386 491570 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0316 17:48:03.211640 491570 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0316 17:48:03.631761 491570 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0316 17:48:03.882525 491570 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0316 17:48:03.882844 491570 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [embed-certs-126148 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
I0316 17:48:04.530357 491570 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0316 17:48:04.530762 491570 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [embed-certs-126148 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
I0316 17:48:05.271500 491570 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0316 17:48:06.724886 491570 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0316 17:48:06.936549 491570 kubeadm.go:309] [certs] Generating "sa" key and public key
I0316 17:48:06.936828 491570 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0316 17:48:07.999116 491570 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0316 17:48:08.377392 491570 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0316 17:48:08.583452 491570 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0316 17:48:09.033090 491570 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0316 17:48:09.033704 491570 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0316 17:48:09.036398 491570 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0316 17:48:09.125999 481631 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0316 17:48:09.141689 481631 api_server.go:72] duration metric: took 6m1.572659285s to wait for apiserver process to appear ...
I0316 17:48:09.141715 481631 api_server.go:88] waiting for apiserver healthz status ...
I0316 17:48:09.144420 481631 out.go:177]
W0316 17:48:09.146305 481631 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W0316 17:48:09.146326 481631 out.go:239] *
W0316 17:48:09.147294 481631 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0316 17:48:09.148762 481631 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
9d15622a91ad5 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 ca2c282a6a69f dashboard-metrics-scraper-8d5bb5db8-6p6nb
747498059d66b ba04bb24b9575 4 minutes ago Running storage-provisioner 2 e85771003bd10 storage-provisioner
a8228ba39ff72 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 21dee6330880f kubernetes-dashboard-cd95d586-pcqp6
8dd0ee223c90f db91994f4ee8f 5 minutes ago Running coredns 1 75f94f5b07827 coredns-74ff55c5b-jcdh5
53266df997bef 25a5233254979 5 minutes ago Running kube-proxy 1 d2a0df3a84ee3 kube-proxy-x59w9
137f2de59c6dc 4740c1948d3fc 5 minutes ago Running kindnet-cni 1 96958cbba0bfc kindnet-6v5gx
b1af79071c039 1611cd07b61d5 5 minutes ago Running busybox 1 3a2aa814d9e17 busybox
c5196a521ea11 ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 e85771003bd10 storage-provisioner
16d138fc440dd 05b738aa1bc63 5 minutes ago Running etcd 1 d1630cb829798 etcd-old-k8s-version-746380
bf0d1869cc0d6 e7605f88f17d6 5 minutes ago Running kube-scheduler 1 a2f8c2e49c69c kube-scheduler-old-k8s-version-746380
f6a137e8a3b14 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 7f8eada883dc1 kube-apiserver-old-k8s-version-746380
c5661cb115edd 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 9bbef602e7a9a kube-controller-manager-old-k8s-version-746380
a9fb41035bdee 1611cd07b61d5 6 minutes ago Exited busybox 0 ab899972b2b6f busybox
a7700f61f9427 db91994f4ee8f 7 minutes ago Exited coredns 0 4dc5a976c2666 coredns-74ff55c5b-jcdh5
22beb4846f86e 4740c1948d3fc 8 minutes ago Exited kindnet-cni 0 7fdbc246b6e97 kindnet-6v5gx
ccbf82b14ebc8 25a5233254979 8 minutes ago Exited kube-proxy 0 71a0c35093042 kube-proxy-x59w9
bb9fc8b360819 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 b52041f140091 kube-scheduler-old-k8s-version-746380
3ffcf3139cf08 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 cb2999b55a22c kube-controller-manager-old-k8s-version-746380
0340e5ca0be60 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 aa9abb7c07a37 kube-apiserver-old-k8s-version-746380
53e126d87d370 05b738aa1bc63 8 minutes ago Exited etcd 0 d6972a0d90ecc etcd-old-k8s-version-746380
==> containerd <==
Mar 16 17:44:26 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:44:26.596728755Z" level=info msg="CreateContainer within sandbox \"ca2c282a6a69f74cfde71c4496b45f06ca7e9ccfcdbfeb0e04e3f775bb75f900\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:4,} returns container id \"280e8899dc39a0e9718ee33b23f3d654702396a83c542fdaf765d262983984f2\""
Mar 16 17:44:26 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:44:26.597400389Z" level=info msg="StartContainer for \"280e8899dc39a0e9718ee33b23f3d654702396a83c542fdaf765d262983984f2\""
Mar 16 17:44:26 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:44:26.688951180Z" level=info msg="StartContainer for \"280e8899dc39a0e9718ee33b23f3d654702396a83c542fdaf765d262983984f2\" returns successfully"
Mar 16 17:44:26 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:44:26.725010672Z" level=info msg="shim disconnected" id=280e8899dc39a0e9718ee33b23f3d654702396a83c542fdaf765d262983984f2
Mar 16 17:44:26 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:44:26.725292352Z" level=warning msg="cleaning up after shim disconnected" id=280e8899dc39a0e9718ee33b23f3d654702396a83c542fdaf765d262983984f2 namespace=k8s.io
Mar 16 17:44:26 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:44:26.725373664Z" level=info msg="cleaning up dead shim"
Mar 16 17:44:26 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:44:26.738660961Z" level=warning msg="cleanup warnings time=\"2024-03-16T17:44:26Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2972 runtime=io.containerd.runc.v2\n"
Mar 16 17:44:27 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:44:27.155740667Z" level=info msg="RemoveContainer for \"cfc50a9c42f1aae764252c7e7375d1626102f8178e5d27ee752c6ef9f55c3153\""
Mar 16 17:44:27 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:44:27.161875323Z" level=info msg="RemoveContainer for \"cfc50a9c42f1aae764252c7e7375d1626102f8178e5d27ee752c6ef9f55c3153\" returns successfully"
Mar 16 17:45:22 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:45:22.557318591Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 16 17:45:22 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:45:22.562131674Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Mar 16 17:45:22 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:45:22.563559323Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Mar 16 17:45:56 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:45:56.559363479Z" level=info msg="CreateContainer within sandbox \"ca2c282a6a69f74cfde71c4496b45f06ca7e9ccfcdbfeb0e04e3f775bb75f900\" for container &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,}"
Mar 16 17:45:56 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:45:56.574296223Z" level=info msg="CreateContainer within sandbox \"ca2c282a6a69f74cfde71c4496b45f06ca7e9ccfcdbfeb0e04e3f775bb75f900\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,} returns container id \"9d15622a91ad5295d0628c1803fdd4c3e1328c9b796d7ba9c433b24c393af343\""
Mar 16 17:45:56 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:45:56.575178719Z" level=info msg="StartContainer for \"9d15622a91ad5295d0628c1803fdd4c3e1328c9b796d7ba9c433b24c393af343\""
Mar 16 17:45:56 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:45:56.649725483Z" level=info msg="StartContainer for \"9d15622a91ad5295d0628c1803fdd4c3e1328c9b796d7ba9c433b24c393af343\" returns successfully"
Mar 16 17:45:56 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:45:56.676411336Z" level=info msg="shim disconnected" id=9d15622a91ad5295d0628c1803fdd4c3e1328c9b796d7ba9c433b24c393af343
Mar 16 17:45:56 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:45:56.676472061Z" level=warning msg="cleaning up after shim disconnected" id=9d15622a91ad5295d0628c1803fdd4c3e1328c9b796d7ba9c433b24c393af343 namespace=k8s.io
Mar 16 17:45:56 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:45:56.676483622Z" level=info msg="cleaning up dead shim"
Mar 16 17:45:56 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:45:56.685577789Z" level=warning msg="cleanup warnings time=\"2024-03-16T17:45:56Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3202 runtime=io.containerd.runc.v2\n"
Mar 16 17:45:57 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:45:57.381011007Z" level=info msg="RemoveContainer for \"280e8899dc39a0e9718ee33b23f3d654702396a83c542fdaf765d262983984f2\""
Mar 16 17:45:57 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:45:57.386327701Z" level=info msg="RemoveContainer for \"280e8899dc39a0e9718ee33b23f3d654702396a83c542fdaf765d262983984f2\" returns successfully"
Mar 16 17:48:09 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:48:09.572392973Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 16 17:48:09 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:48:09.597966176Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Mar 16 17:48:09 old-k8s-version-746380 containerd[567]: time="2024-03-16T17:48:09.600142620Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
==> coredns [8dd0ee223c90f99d346db9114977e56c2bbfecb904aa1223b3e8e1109264981d] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:35796 - 42710 "HINFO IN 8387435654806112351.8133578058127294849. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.032282996s
==> coredns [a7700f61f9427c51311df28b60dc3da67a68a1be40d1f17810185e95a656508c] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:51658 - 57749 "HINFO IN 4747854361398744785.3658144349413447401. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.032130341s
==> describe nodes <==
Name: old-k8s-version-746380
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-746380
kubernetes.io/os=linux
minikube.k8s.io/commit=dcb7bcec19ba52ac09364e1139fb2071215a1bc6
minikube.k8s.io/name=old-k8s-version-746380
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_03_16T17_39_32_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 16 Mar 2024 17:39:28 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-746380
AcquireTime: <unset>
RenewTime: Sat, 16 Mar 2024 17:48:09 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 16 Mar 2024 17:43:17 +0000 Sat, 16 Mar 2024 17:39:21 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 16 Mar 2024 17:43:17 +0000 Sat, 16 Mar 2024 17:39:21 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 16 Mar 2024 17:43:17 +0000 Sat, 16 Mar 2024 17:39:21 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 16 Mar 2024 17:43:17 +0000 Sat, 16 Mar 2024 17:39:48 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-746380
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022496Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022496Ki
pods: 110
System Info:
Machine ID: 82df2265139b4222a7d1497411fe78d4
System UUID: 2c5fbd87-0f9a-4cbf-9852-773b036b7168
Boot ID: 183b8861-7db8-4da8-9969-d0fd94fbc14e
Kernel Version: 5.15.0-1055-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.6.28
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m36s
kube-system coredns-74ff55c5b-jcdh5 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m23s
kube-system etcd-old-k8s-version-746380 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m31s
kube-system kindnet-6v5gx 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m23s
kube-system kube-apiserver-old-k8s-version-746380 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m31s
kube-system kube-controller-manager-old-k8s-version-746380 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m31s
kube-system kube-proxy-x59w9 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m23s
kube-system kube-scheduler-old-k8s-version-746380 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m31s
kube-system metrics-server-9975d5f86-s65lt 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m24s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m21s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-6p6nb 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m25s
kubernetes-dashboard kubernetes-dashboard-cd95d586-pcqp6 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m25s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m51s (x4 over 8m51s) kubelet Node old-k8s-version-746380 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m51s (x4 over 8m51s) kubelet Node old-k8s-version-746380 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m51s (x4 over 8m51s) kubelet Node old-k8s-version-746380 status is now: NodeHasSufficientPID
Normal Starting 8m32s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m31s kubelet Node old-k8s-version-746380 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m31s kubelet Node old-k8s-version-746380 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m31s kubelet Node old-k8s-version-746380 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m31s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m23s kubelet Node old-k8s-version-746380 status is now: NodeReady
Normal Starting 8m22s kube-proxy Starting kube-proxy.
Normal Starting 5m56s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m56s (x8 over 5m56s) kubelet Node old-k8s-version-746380 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m56s (x8 over 5m56s) kubelet Node old-k8s-version-746380 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m56s (x7 over 5m56s) kubelet Node old-k8s-version-746380 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m56s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m42s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.001177] FS-Cache: O-key=[8] 'e03a5c0100000000'
[ +0.000780] FS-Cache: N-cookie c=0000001e [p=00000015 fl=2 nc=0 na=1]
[ +0.001022] FS-Cache: N-cookie d=00000000bd90532f{9p.inode} n=00000000ea5f5674
[ +0.001095] FS-Cache: N-key=[8] 'e03a5c0100000000'
[ +0.003573] FS-Cache: Duplicate cookie detected
[ +0.000861] FS-Cache: O-cookie c=00000018 [p=00000015 fl=226 nc=0 na=1]
[ +0.001171] FS-Cache: O-cookie d=00000000bd90532f{9p.inode} n=0000000042287ac7
[ +0.001177] FS-Cache: O-key=[8] 'e03a5c0100000000'
[ +0.000754] FS-Cache: N-cookie c=0000001f [p=00000015 fl=2 nc=0 na=1]
[ +0.001056] FS-Cache: N-cookie d=00000000bd90532f{9p.inode} n=00000000f962ef30
[ +0.001144] FS-Cache: N-key=[8] 'e03a5c0100000000'
[ +2.779373] FS-Cache: Duplicate cookie detected
[ +0.000767] FS-Cache: O-cookie c=00000016 [p=00000015 fl=226 nc=0 na=1]
[ +0.000951] FS-Cache: O-cookie d=00000000bd90532f{9p.inode} n=00000000f905028d
[ +0.001067] FS-Cache: O-key=[8] 'df3a5c0100000000'
[ +0.000705] FS-Cache: N-cookie c=00000021 [p=00000015 fl=2 nc=0 na=1]
[ +0.001087] FS-Cache: N-cookie d=00000000bd90532f{9p.inode} n=00000000ea5f5674
[ +0.001053] FS-Cache: N-key=[8] 'df3a5c0100000000'
[ +0.347499] FS-Cache: Duplicate cookie detected
[ +0.000798] FS-Cache: O-cookie c=0000001b [p=00000015 fl=226 nc=0 na=1]
[ +0.001036] FS-Cache: O-cookie d=00000000bd90532f{9p.inode} n=000000006a03c990
[ +0.001196] FS-Cache: O-key=[8] 'e53a5c0100000000'
[ +0.000764] FS-Cache: N-cookie c=00000022 [p=00000015 fl=2 nc=0 na=1]
[ +0.000985] FS-Cache: N-cookie d=00000000bd90532f{9p.inode} n=00000000f2586d18
[ +0.001131] FS-Cache: N-key=[8] 'e53a5c0100000000'
==> etcd [16d138fc440dd55f8a882b1a470bd88b116d89b1276ca648e106057f46db7677] <==
2024-03-16 17:44:10.343145 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:44:20.343196 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:44:30.343268 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:44:40.343311 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:44:50.343326 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:45:00.351906 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:45:10.343301 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:45:20.343196 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:45:30.343186 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:45:40.343052 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:45:50.343215 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:46:00.345181 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:46:10.343258 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:46:20.343171 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:46:30.343175 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:46:40.343073 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:46:50.343343 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:47:00.349019 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:47:10.343243 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:47:20.343145 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:47:30.343303 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:47:40.343327 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:47:50.343182 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:48:00.346512 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:48:10.343984 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [53e126d87d370fc7c40afb41dc1a7f49e87707a49e2d1486adf3a6445555d955] <==
raft2024/03/16 17:39:21 INFO: ea7e25599daad906 became candidate at term 2
raft2024/03/16 17:39:21 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/03/16 17:39:21 INFO: ea7e25599daad906 became leader at term 2
raft2024/03/16 17:39:21 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-03-16 17:39:21.721487 I | etcdserver: setting up the initial cluster version to 3.4
2024-03-16 17:39:21.723886 N | etcdserver/membership: set the initial cluster version to 3.4
2024-03-16 17:39:21.724048 I | etcdserver/api: enabled capabilities for version 3.4
2024-03-16 17:39:21.724149 I | etcdserver: published {Name:old-k8s-version-746380 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-03-16 17:39:21.724233 I | embed: ready to serve client requests
2024-03-16 17:39:21.726092 I | embed: serving client requests on 127.0.0.1:2379
2024-03-16 17:39:21.726289 I | embed: ready to serve client requests
2024-03-16 17:39:21.736100 I | embed: serving client requests on 192.168.76.2:2379
2024-03-16 17:39:42.213925 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:39:50.341098 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:40:00.341768 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:40:10.340019 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:40:20.339936 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:40:30.339925 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:40:40.339998 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:40:50.340106 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:41:00.340231 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:41:10.340212 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:41:20.339918 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:41:30.340128 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-16 17:41:40.340073 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
17:48:11 up 3:30, 0 users, load average: 1.25, 1.87, 2.37
Linux old-k8s-version-746380 5.15.0-1055-aws #60~20.04.1-Ubuntu SMP Thu Feb 22 15:54:21 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [137f2de59c6dc6edd43d77e791ff547f8b6673cd98d12a1046d38b593804d914] <==
I0316 17:46:10.916403 1 main.go:227] handling current node
I0316 17:46:20.923718 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:46:20.923745 1 main.go:227] handling current node
I0316 17:46:30.934538 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:46:30.934564 1 main.go:227] handling current node
I0316 17:46:40.952436 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:46:40.952465 1 main.go:227] handling current node
I0316 17:46:50.959080 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:46:50.959108 1 main.go:227] handling current node
I0316 17:47:00.978727 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:47:00.979037 1 main.go:227] handling current node
I0316 17:47:10.988969 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:47:10.989000 1 main.go:227] handling current node
I0316 17:47:21.006746 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:47:21.006777 1 main.go:227] handling current node
I0316 17:47:31.027875 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:47:31.027906 1 main.go:227] handling current node
I0316 17:47:41.045164 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:47:41.045391 1 main.go:227] handling current node
I0316 17:47:51.055638 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:47:51.055667 1 main.go:227] handling current node
I0316 17:48:01.069718 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:48:01.069746 1 main.go:227] handling current node
I0316 17:48:11.080770 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:48:11.080804 1 main.go:227] handling current node
==> kindnet [22beb4846f86e0b94f967a82643633bda14c92a967549166bf63c77fcd3a5673] <==
I0316 17:39:49.426779 1 main.go:102] connected to apiserver: https://10.96.0.1:443
I0316 17:39:49.426893 1 main.go:107] hostIP = 192.168.76.2
podIP = 192.168.76.2
I0316 17:39:49.427025 1 main.go:116] setting mtu 1500 for CNI
I0316 17:39:49.427039 1 main.go:146] kindnetd IP family: "ipv4"
I0316 17:39:49.427051 1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
I0316 17:40:19.648082 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: i/o timeout
I0316 17:40:19.662556 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:40:19.662587 1 main.go:227] handling current node
I0316 17:40:29.679987 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:40:29.680014 1 main.go:227] handling current node
I0316 17:40:39.693128 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:40:39.693156 1 main.go:227] handling current node
I0316 17:40:49.705625 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:40:49.705653 1 main.go:227] handling current node
I0316 17:40:59.711818 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:40:59.711847 1 main.go:227] handling current node
I0316 17:41:09.724055 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:41:09.724084 1 main.go:227] handling current node
I0316 17:41:19.749078 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:41:19.749313 1 main.go:227] handling current node
I0316 17:41:29.844971 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:41:29.845089 1 main.go:227] handling current node
I0316 17:41:39.913050 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0316 17:41:39.913077 1 main.go:227] handling current node
==> kube-apiserver [0340e5ca0be60b47abce880f66d4c4e5fc876c20b19e0b5c769ec2a4f1b8547b] <==
I0316 17:39:29.449233 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0316 17:39:29.449271 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0316 17:39:29.456257 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0316 17:39:29.461762 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0316 17:39:29.461782 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0316 17:39:29.958240 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0316 17:39:29.998725 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0316 17:39:30.140919 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I0316 17:39:30.142621 1 controller.go:606] quota admission added evaluator for: endpoints
I0316 17:39:30.149729 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0316 17:39:31.128644 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0316 17:39:31.521766 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0316 17:39:31.614025 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0316 17:39:39.944915 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0316 17:39:48.247550 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0316 17:39:48.497244 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0316 17:40:06.753299 1 client.go:360] parsed scheme: "passthrough"
I0316 17:40:06.753387 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0316 17:40:06.753404 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0316 17:40:49.529160 1 client.go:360] parsed scheme: "passthrough"
I0316 17:40:49.529203 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0316 17:40:49.529214 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0316 17:41:20.441946 1 client.go:360] parsed scheme: "passthrough"
I0316 17:41:20.441989 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0316 17:41:20.441997 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [f6a137e8a3b1485dd10f52919de9c0fef41fc33d23e13d15ecd70b4ee918c6d5] <==
I0316 17:44:45.271648 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0316 17:44:45.271687 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0316 17:45:29.672540 1 handler_proxy.go:102] no RequestInfo found in the context
E0316 17:45:29.672611 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0316 17:45:29.672620 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0316 17:45:29.980181 1 client.go:360] parsed scheme: "passthrough"
I0316 17:45:29.980234 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0316 17:45:29.980243 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0316 17:46:07.058528 1 client.go:360] parsed scheme: "passthrough"
I0316 17:46:07.058571 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0316 17:46:07.058580 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0316 17:46:45.815561 1 client.go:360] parsed scheme: "passthrough"
I0316 17:46:45.815672 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0316 17:46:45.815692 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0316 17:47:19.228406 1 client.go:360] parsed scheme: "passthrough"
I0316 17:47:19.228450 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0316 17:47:19.228458 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0316 17:47:27.749333 1 handler_proxy.go:102] no RequestInfo found in the context
E0316 17:47:27.749417 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0316 17:47:27.749428 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0316 17:47:57.958156 1 client.go:360] parsed scheme: "passthrough"
I0316 17:47:57.958198 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0316 17:47:57.958205 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [3ffcf3139cf08c2e735e53f3bed4469b3466bcbedc7c3cb0bba55d896472640b] <==
I0316 17:39:48.304683 1 shared_informer.go:247] Caches are synced for disruption
I0316 17:39:48.304889 1 disruption.go:339] Sending events to api server.
I0316 17:39:48.354788 1 shared_informer.go:247] Caches are synced for bootstrap_signer
I0316 17:39:48.408015 1 shared_informer.go:247] Caches are synced for job
I0316 17:39:48.441215 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-4bzb6"
I0316 17:39:48.448936 1 shared_informer.go:247] Caches are synced for crt configmap
I0316 17:39:48.460322 1 shared_informer.go:247] Caches are synced for daemon sets
I0316 17:39:48.465526 1 shared_informer.go:247] Caches are synced for taint
I0316 17:39:48.465598 1 node_lifecycle_controller.go:1429] Initializing eviction metric for zone:
W0316 17:39:48.465660 1 node_lifecycle_controller.go:1044] Missing timestamp for Node old-k8s-version-746380. Assuming now as a timestamp.
I0316 17:39:48.465698 1 node_lifecycle_controller.go:1245] Controller detected that zone is now in state Normal.
I0316 17:39:48.465980 1 taint_manager.go:187] Starting NoExecuteTaintManager
I0316 17:39:48.470113 1 event.go:291] "Event occurred" object="old-k8s-version-746380" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-746380 event: Registered Node old-k8s-version-746380 in Controller"
I0316 17:39:48.471445 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-jcdh5"
I0316 17:39:48.487772 1 shared_informer.go:247] Caches are synced for resource quota
I0316 17:39:48.505781 1 shared_informer.go:247] Caches are synced for resource quota
I0316 17:39:48.542624 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-6v5gx"
I0316 17:39:48.542650 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-x59w9"
I0316 17:39:48.655799 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0316 17:39:48.873407 1 shared_informer.go:247] Caches are synced for garbage collector
I0316 17:39:48.889678 1 shared_informer.go:247] Caches are synced for garbage collector
I0316 17:39:48.889699 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0316 17:39:50.129088 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0316 17:39:50.193310 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-4bzb6"
I0316 17:41:46.400400 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
==> kube-controller-manager [c5661cb115eddb01bce4d502126d119b47c1c22da24660a5c5d57202fad6e10e] <==
W0316 17:43:51.915144 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0316 17:44:17.884065 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0316 17:44:23.565796 1 request.go:655] Throttling request took 1.048139043s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0316 17:44:24.417312 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0316 17:44:48.385949 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0316 17:44:56.067706 1 request.go:655] Throttling request took 1.046771291s, request: GET:https://192.168.76.2:8443/apis/authentication.k8s.io/v1?timeout=32s
W0316 17:44:56.919212 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0316 17:45:18.887899 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0316 17:45:28.569920 1 request.go:655] Throttling request took 1.048355944s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0316 17:45:29.421501 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0316 17:45:49.389743 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0316 17:46:01.072026 1 request.go:655] Throttling request took 1.042577648s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0316 17:46:01.923532 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0316 17:46:19.891642 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0316 17:46:33.574019 1 request.go:655] Throttling request took 1.048502492s, request: GET:https://192.168.76.2:8443/apis/certificates.k8s.io/v1?timeout=32s
W0316 17:46:34.425887 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0316 17:46:50.394179 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0316 17:47:06.076336 1 request.go:655] Throttling request took 1.047954981s, request: GET:https://192.168.76.2:8443/apis/batch/v1?timeout=32s
W0316 17:47:06.927930 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0316 17:47:20.896482 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0316 17:47:38.578373 1 request.go:655] Throttling request took 1.048372265s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0316 17:47:39.429915 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0316 17:47:51.398447 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0316 17:48:11.083713 1 request.go:655] Throttling request took 1.046522305s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0316 17:48:11.935468 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [53266df997beffb4f7bfa6609d282d4f498bcdb315a85073da81dd740c85139f] <==
I0316 17:42:29.975117 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0316 17:42:29.975196 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0316 17:42:29.992855 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0316 17:42:29.992947 1 server_others.go:185] Using iptables Proxier.
I0316 17:42:29.993163 1 server.go:650] Version: v1.20.0
I0316 17:42:29.996616 1 config.go:315] Starting service config controller
I0316 17:42:29.996671 1 shared_informer.go:240] Waiting for caches to sync for service config
I0316 17:42:29.996957 1 config.go:224] Starting endpoint slice config controller
I0316 17:42:29.996986 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0316 17:42:30.097090 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0316 17:42:30.097145 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [ccbf82b14ebc82618a0db0f8cce371995c37bb4d2cd2b873a46ac53578fbec9b] <==
I0316 17:39:49.427473 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0316 17:39:49.427801 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0316 17:39:49.483797 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0316 17:39:49.484286 1 server_others.go:185] Using iptables Proxier.
I0316 17:39:49.484528 1 server.go:650] Version: v1.20.0
I0316 17:39:49.485943 1 config.go:315] Starting service config controller
I0316 17:39:49.485966 1 shared_informer.go:240] Waiting for caches to sync for service config
I0316 17:39:49.486002 1 config.go:224] Starting endpoint slice config controller
I0316 17:39:49.486009 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0316 17:39:49.589448 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0316 17:39:49.589506 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [bb9fc8b360819c7a19f5e182ffa90ecf3dc71344631dac019d43ec3d489bbb79] <==
W0316 17:39:28.634042 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0316 17:39:28.634069 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0316 17:39:28.634082 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0316 17:39:28.634088 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0316 17:39:28.725235 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0316 17:39:28.725329 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0316 17:39:28.725344 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0316 17:39:28.725358 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0316 17:39:28.733406 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0316 17:39:28.739452 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0316 17:39:28.739731 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0316 17:39:28.739852 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0316 17:39:28.740336 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0316 17:39:28.750910 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0316 17:39:28.751454 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0316 17:39:28.751954 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0316 17:39:28.752192 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0316 17:39:28.755357 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0316 17:39:28.755447 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0316 17:39:28.755512 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0316 17:39:29.546204 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0316 17:39:29.621441 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0316 17:39:29.624648 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0316 17:39:29.791867 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0316 17:39:32.525484 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [bf0d1869cc0d68bb43a663a92a7a2eb950593536676cefca598146c6f602803e] <==
I0316 17:42:20.648199 1 serving.go:331] Generated self-signed cert in-memory
W0316 17:42:26.728420 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0316 17:42:26.728464 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0316 17:42:26.728475 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0316 17:42:26.728498 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0316 17:42:27.035875 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0316 17:42:27.035917 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0316 17:42:27.047264 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0316 17:42:27.047352 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0316 17:42:27.241237 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Mar 16 17:46:39 old-k8s-version-746380 kubelet[660]: E0316 17:46:39.559649 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
Mar 16 17:46:49 old-k8s-version-746380 kubelet[660]: E0316 17:46:49.557008 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 16 17:46:53 old-k8s-version-746380 kubelet[660]: I0316 17:46:53.556478 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 9d15622a91ad5295d0628c1803fdd4c3e1328c9b796d7ba9c433b24c393af343
Mar 16 17:46:53 old-k8s-version-746380 kubelet[660]: E0316 17:46:53.557338 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
Mar 16 17:47:04 old-k8s-version-746380 kubelet[660]: E0316 17:47:04.557220 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 16 17:47:05 old-k8s-version-746380 kubelet[660]: I0316 17:47:05.556850 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 9d15622a91ad5295d0628c1803fdd4c3e1328c9b796d7ba9c433b24c393af343
Mar 16 17:47:05 old-k8s-version-746380 kubelet[660]: E0316 17:47:05.557240 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
Mar 16 17:47:16 old-k8s-version-746380 kubelet[660]: I0316 17:47:16.556350 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 9d15622a91ad5295d0628c1803fdd4c3e1328c9b796d7ba9c433b24c393af343
Mar 16 17:47:16 old-k8s-version-746380 kubelet[660]: E0316 17:47:16.557143 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
Mar 16 17:47:16 old-k8s-version-746380 kubelet[660]: E0316 17:47:16.557232 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 16 17:47:27 old-k8s-version-746380 kubelet[660]: I0316 17:47:27.560101 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 9d15622a91ad5295d0628c1803fdd4c3e1328c9b796d7ba9c433b24c393af343
Mar 16 17:47:27 old-k8s-version-746380 kubelet[660]: E0316 17:47:27.560424 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
Mar 16 17:47:27 old-k8s-version-746380 kubelet[660]: E0316 17:47:27.561727 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 16 17:47:39 old-k8s-version-746380 kubelet[660]: I0316 17:47:39.564973 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 9d15622a91ad5295d0628c1803fdd4c3e1328c9b796d7ba9c433b24c393af343
Mar 16 17:47:39 old-k8s-version-746380 kubelet[660]: E0316 17:47:39.565385 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
Mar 16 17:47:42 old-k8s-version-746380 kubelet[660]: E0316 17:47:42.561108 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 16 17:47:50 old-k8s-version-746380 kubelet[660]: I0316 17:47:50.556317 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 9d15622a91ad5295d0628c1803fdd4c3e1328c9b796d7ba9c433b24c393af343
Mar 16 17:47:50 old-k8s-version-746380 kubelet[660]: E0316 17:47:50.556652 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
Mar 16 17:47:56 old-k8s-version-746380 kubelet[660]: E0316 17:47:56.557033 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 16 17:48:01 old-k8s-version-746380 kubelet[660]: I0316 17:48:01.556497 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 9d15622a91ad5295d0628c1803fdd4c3e1328c9b796d7ba9c433b24c393af343
Mar 16 17:48:01 old-k8s-version-746380 kubelet[660]: E0316 17:48:01.556851 660 pod_workers.go:191] Error syncing pod 44cccf23-c5b3-46c9-b387-cc05351e79ed ("dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6p6nb_kubernetes-dashboard(44cccf23-c5b3-46c9-b387-cc05351e79ed)"
Mar 16 17:48:09 old-k8s-version-746380 kubelet[660]: E0316 17:48:09.601900 660 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Mar 16 17:48:09 old-k8s-version-746380 kubelet[660]: E0316 17:48:09.601946 660 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Mar 16 17:48:09 old-k8s-version-746380 kubelet[660]: E0316 17:48:09.602076 660 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-dlrz5,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-s65lt_kube-system(cd17aa5
7-4a12-49cf-9cb2-d519126a78d2): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Mar 16 17:48:09 old-k8s-version-746380 kubelet[660]: E0316 17:48:09.602113 660 pod_workers.go:191] Error syncing pod cd17aa57-4a12-49cf-9cb2-d519126a78d2 ("metrics-server-9975d5f86-s65lt_kube-system(cd17aa57-4a12-49cf-9cb2-d519126a78d2)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
==> kubernetes-dashboard [a8228ba39ff72ee5a9f0f601ff331405a3653e6a672688d3942fd43ebd1f5ff0] <==
2024/03/16 17:42:54 Using namespace: kubernetes-dashboard
2024/03/16 17:42:54 Using in-cluster config to connect to apiserver
2024/03/16 17:42:54 Using secret token for csrf signing
2024/03/16 17:42:54 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/03/16 17:42:54 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/03/16 17:42:54 Successful initial request to the apiserver, version: v1.20.0
2024/03/16 17:42:54 Generating JWE encryption key
2024/03/16 17:42:54 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/03/16 17:42:54 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/03/16 17:42:54 Initializing JWE encryption key from synchronized object
2024/03/16 17:42:54 Creating in-cluster Sidecar client
2024/03/16 17:42:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/16 17:42:54 Serving insecurely on HTTP port: 9090
2024/03/16 17:43:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/16 17:43:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/16 17:44:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/16 17:44:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/16 17:45:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/16 17:45:55 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/16 17:46:25 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/16 17:46:55 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/16 17:47:25 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/16 17:47:55 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/16 17:42:54 Starting overwatch
==> storage-provisioner [747498059d66bf6a35719a49e025168cdec4e997bd41ff614c40cd4518774adb] <==
I0316 17:43:14.746165 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0316 17:43:14.789948 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0316 17:43:14.789994 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0316 17:43:32.281193 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0316 17:43:32.293473 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"4b2da0b3-9354-4bad-a6d0-4e47b2355ece", APIVersion:"v1", ResourceVersion:"840", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-746380_1a016025-a0ae-47a3-bddb-c524cc02d728 became leader
I0316 17:43:32.293721 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-746380_1a016025-a0ae-47a3-bddb-c524cc02d728!
I0316 17:43:32.400786 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-746380_1a016025-a0ae-47a3-bddb-c524cc02d728!
==> storage-provisioner [c5196a521ea11d8df3329b51f670d2873b2e489ba1e6d7bad59e4d1a58567aaf] <==
I0316 17:42:28.946914 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0316 17:42:58.948972 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-746380 -n old-k8s-version-746380
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-746380 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-s65lt
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-746380 describe pod metrics-server-9975d5f86-s65lt
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-746380 describe pod metrics-server-9975d5f86-s65lt: exit status 1 (221.225282ms)
** stderr **
E0316 17:48:13.525042 494404 memcache.go:287] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0316 17:48:13.556303 494404 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0316 17:48:13.566594 494404 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0316 17:48:13.570012 494404 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0316 17:48:13.583362 494404 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0316 17:48:13.587895 494404 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Error from server (NotFound): pods "metrics-server-9975d5f86-s65lt" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-746380 describe pod metrics-server-9975d5f86-s65lt: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (373.73s)