=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-675414 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E0804 00:53:12.280103 1479137 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19370-1473734/.minikube/profiles/functional-145444/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-675414 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m12.932864853s)
-- stdout --
* [old-k8s-version-675414] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19370
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19370-1473734/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19370-1473734/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
* Using the docker driver based on existing profile
* Starting "old-k8s-version-675414" primary control-plane node in "old-k8s-version-675414" cluster
* Pulling base image v0.0.44-1721902582-19326 ...
* Restarting existing docker container for "old-k8s-version-675414" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
* Verifying Kubernetes components...
- Using image registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-675414 addons enable metrics-server
* Enabled addons: storage-provisioner, dashboard, default-storageclass, metrics-server
-- /stdout --
** stderr **
I0804 00:52:11.976343 1684495 out.go:291] Setting OutFile to fd 1 ...
I0804 00:52:11.977422 1684495 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0804 00:52:11.977455 1684495 out.go:304] Setting ErrFile to fd 2...
I0804 00:52:11.977474 1684495 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0804 00:52:11.977792 1684495 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19370-1473734/.minikube/bin
I0804 00:52:11.978312 1684495 out.go:298] Setting JSON to false
I0804 00:52:11.979607 1684495 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":34477,"bootTime":1722698255,"procs":222,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0804 00:52:11.979706 1684495 start.go:139] virtualization:
I0804 00:52:11.982917 1684495 out.go:177] * [old-k8s-version-675414] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0804 00:52:11.986406 1684495 out.go:177] - MINIKUBE_LOCATION=19370
I0804 00:52:11.986526 1684495 notify.go:220] Checking for updates...
I0804 00:52:11.990515 1684495 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0804 00:52:11.992896 1684495 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19370-1473734/kubeconfig
I0804 00:52:11.994907 1684495 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19370-1473734/.minikube
I0804 00:52:11.997003 1684495 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0804 00:52:11.999337 1684495 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0804 00:52:12.002087 1684495 config.go:182] Loaded profile config "old-k8s-version-675414": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0804 00:52:12.004645 1684495 out.go:177] * Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
I0804 00:52:12.011401 1684495 driver.go:392] Setting default libvirt URI to qemu:///system
I0804 00:52:12.078095 1684495 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0804 00:52:12.078217 1684495 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0804 00:52:12.279206 1684495 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:52 OomKillDisable:true NGoroutines:68 SystemTime:2024-08-04 00:52:12.266638854 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0804 00:52:12.279871 1684495 docker.go:307] overlay module found
I0804 00:52:12.284274 1684495 out.go:177] * Using the docker driver based on existing profile
I0804 00:52:12.287919 1684495 start.go:297] selected driver: docker
I0804 00:52:12.287944 1684495 start.go:901] validating driver "docker" against &{Name:old-k8s-version-675414 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-675414 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0804 00:52:12.288109 1684495 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0804 00:52:12.289691 1684495 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0804 00:52:12.417110 1684495 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:52 OomKillDisable:true NGoroutines:68 SystemTime:2024-08-04 00:52:12.397566521 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0804 00:52:12.417459 1684495 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0804 00:52:12.417490 1684495 cni.go:84] Creating CNI manager for ""
I0804 00:52:12.417498 1684495 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0804 00:52:12.417546 1684495 start.go:340] cluster config:
{Name:old-k8s-version-675414 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-675414 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0804 00:52:12.420057 1684495 out.go:177] * Starting "old-k8s-version-675414" primary control-plane node in "old-k8s-version-675414" cluster
I0804 00:52:12.421872 1684495 cache.go:121] Beginning downloading kic base image for docker with containerd
I0804 00:52:12.423647 1684495 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0804 00:52:12.425364 1684495 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0804 00:52:12.425421 1684495 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19370-1473734/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0804 00:52:12.425440 1684495 cache.go:56] Caching tarball of preloaded images
I0804 00:52:12.425525 1684495 preload.go:172] Found /home/jenkins/minikube-integration/19370-1473734/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0804 00:52:12.425539 1684495 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0804 00:52:12.425658 1684495 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-1473734/.minikube/profiles/old-k8s-version-675414/config.json ...
I0804 00:52:12.425860 1684495 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
W0804 00:52:12.473298 1684495 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
I0804 00:52:12.473327 1684495 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0804 00:52:12.473402 1684495 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0804 00:52:12.473426 1684495 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0804 00:52:12.473434 1684495 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0804 00:52:12.473442 1684495 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0804 00:52:12.473447 1684495 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0804 00:52:12.622488 1684495 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0804 00:52:12.622519 1684495 cache.go:194] Successfully downloaded all kic artifacts
I0804 00:52:12.622556 1684495 start.go:360] acquireMachinesLock for old-k8s-version-675414: {Name:mkd5d2247bdc0e236ad1ddea78bfca63d1acb6cb Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0804 00:52:12.622627 1684495 start.go:364] duration metric: took 50.748µs to acquireMachinesLock for "old-k8s-version-675414"
I0804 00:52:12.622647 1684495 start.go:96] Skipping create...Using existing machine configuration
I0804 00:52:12.622657 1684495 fix.go:54] fixHost starting:
I0804 00:52:12.622916 1684495 cli_runner.go:164] Run: docker container inspect old-k8s-version-675414 --format={{.State.Status}}
I0804 00:52:12.699770 1684495 fix.go:112] recreateIfNeeded on old-k8s-version-675414: state=Stopped err=<nil>
W0804 00:52:12.699806 1684495 fix.go:138] unexpected machine state, will restart: <nil>
I0804 00:52:12.702296 1684495 out.go:177] * Restarting existing docker container for "old-k8s-version-675414" ...
I0804 00:52:12.704567 1684495 cli_runner.go:164] Run: docker start old-k8s-version-675414
I0804 00:52:13.168331 1684495 cli_runner.go:164] Run: docker container inspect old-k8s-version-675414 --format={{.State.Status}}
I0804 00:52:13.203383 1684495 kic.go:430] container "old-k8s-version-675414" state is running.
I0804 00:52:13.203754 1684495 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-675414
I0804 00:52:13.230543 1684495 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-1473734/.minikube/profiles/old-k8s-version-675414/config.json ...
I0804 00:52:13.230796 1684495 machine.go:94] provisionDockerMachine start ...
I0804 00:52:13.230860 1684495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-675414
I0804 00:52:13.267796 1684495 main.go:141] libmachine: Using SSH client type: native
I0804 00:52:13.268059 1684495 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34920 <nil> <nil>}
I0804 00:52:13.268074 1684495 main.go:141] libmachine: About to run SSH command:
hostname
I0804 00:52:13.268849 1684495 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0804 00:52:16.408516 1684495 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-675414
I0804 00:52:16.408542 1684495 ubuntu.go:169] provisioning hostname "old-k8s-version-675414"
I0804 00:52:16.408616 1684495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-675414
I0804 00:52:16.443902 1684495 main.go:141] libmachine: Using SSH client type: native
I0804 00:52:16.444155 1684495 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34920 <nil> <nil>}
I0804 00:52:16.444172 1684495 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-675414 && echo "old-k8s-version-675414" | sudo tee /etc/hostname
I0804 00:52:16.600393 1684495 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-675414
I0804 00:52:16.600501 1684495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-675414
I0804 00:52:16.628656 1684495 main.go:141] libmachine: Using SSH client type: native
I0804 00:52:16.629032 1684495 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34920 <nil> <nil>}
I0804 00:52:16.629059 1684495 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-675414' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-675414/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-675414' | sudo tee -a /etc/hosts;
fi
fi
I0804 00:52:16.777991 1684495 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0804 00:52:16.778043 1684495 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19370-1473734/.minikube CaCertPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19370-1473734/.minikube}
I0804 00:52:16.778072 1684495 ubuntu.go:177] setting up certificates
I0804 00:52:16.778082 1684495 provision.go:84] configureAuth start
I0804 00:52:16.778194 1684495 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-675414
I0804 00:52:16.794842 1684495 provision.go:143] copyHostCerts
I0804 00:52:16.794922 1684495 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-1473734/.minikube/ca.pem, removing ...
I0804 00:52:16.794939 1684495 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-1473734/.minikube/ca.pem
I0804 00:52:16.795012 1684495 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-1473734/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19370-1473734/.minikube/ca.pem (1082 bytes)
I0804 00:52:16.795122 1684495 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-1473734/.minikube/cert.pem, removing ...
I0804 00:52:16.795128 1684495 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-1473734/.minikube/cert.pem
I0804 00:52:16.795167 1684495 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-1473734/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19370-1473734/.minikube/cert.pem (1123 bytes)
I0804 00:52:16.795236 1684495 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-1473734/.minikube/key.pem, removing ...
I0804 00:52:16.795240 1684495 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-1473734/.minikube/key.pem
I0804 00:52:16.795267 1684495 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-1473734/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19370-1473734/.minikube/key.pem (1679 bytes)
I0804 00:52:16.795353 1684495 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19370-1473734/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19370-1473734/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19370-1473734/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-675414 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-675414]
I0804 00:52:17.718411 1684495 provision.go:177] copyRemoteCerts
I0804 00:52:17.718534 1684495 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0804 00:52:17.718609 1684495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-675414
I0804 00:52:17.735820 1684495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34920 SSHKeyPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/machines/old-k8s-version-675414/id_rsa Username:docker}
I0804 00:52:17.834832 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0804 00:52:17.862252 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0804 00:52:17.889943 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0804 00:52:17.917522 1684495 provision.go:87] duration metric: took 1.139417999s to configureAuth
I0804 00:52:17.917557 1684495 ubuntu.go:193] setting minikube options for container-runtime
I0804 00:52:17.917788 1684495 config.go:182] Loaded profile config "old-k8s-version-675414": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0804 00:52:17.917803 1684495 machine.go:97] duration metric: took 4.686991566s to provisionDockerMachine
I0804 00:52:17.917812 1684495 start.go:293] postStartSetup for "old-k8s-version-675414" (driver="docker")
I0804 00:52:17.917823 1684495 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0804 00:52:17.917889 1684495 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0804 00:52:17.917942 1684495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-675414
I0804 00:52:17.943261 1684495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34920 SSHKeyPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/machines/old-k8s-version-675414/id_rsa Username:docker}
I0804 00:52:18.039123 1684495 ssh_runner.go:195] Run: cat /etc/os-release
I0804 00:52:18.043505 1684495 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0804 00:52:18.043540 1684495 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0804 00:52:18.043551 1684495 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0804 00:52:18.043558 1684495 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0804 00:52:18.043569 1684495 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-1473734/.minikube/addons for local assets ...
I0804 00:52:18.043627 1684495 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-1473734/.minikube/files for local assets ...
I0804 00:52:18.043721 1684495 filesync.go:149] local asset: /home/jenkins/minikube-integration/19370-1473734/.minikube/files/etc/ssl/certs/14791372.pem -> 14791372.pem in /etc/ssl/certs
I0804 00:52:18.043833 1684495 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0804 00:52:18.053666 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/files/etc/ssl/certs/14791372.pem --> /etc/ssl/certs/14791372.pem (1708 bytes)
I0804 00:52:18.087989 1684495 start.go:296] duration metric: took 170.144654ms for postStartSetup
I0804 00:52:18.088153 1684495 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0804 00:52:18.088249 1684495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-675414
I0804 00:52:18.110903 1684495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34920 SSHKeyPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/machines/old-k8s-version-675414/id_rsa Username:docker}
I0804 00:52:18.202184 1684495 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0804 00:52:18.208428 1684495 fix.go:56] duration metric: took 5.585765999s for fixHost
I0804 00:52:18.208452 1684495 start.go:83] releasing machines lock for "old-k8s-version-675414", held for 5.585816739s
I0804 00:52:18.208530 1684495 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-675414
I0804 00:52:18.226602 1684495 ssh_runner.go:195] Run: cat /version.json
I0804 00:52:18.226702 1684495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-675414
I0804 00:52:18.226932 1684495 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0804 00:52:18.226985 1684495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-675414
I0804 00:52:18.264945 1684495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34920 SSHKeyPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/machines/old-k8s-version-675414/id_rsa Username:docker}
I0804 00:52:18.269810 1684495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34920 SSHKeyPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/machines/old-k8s-version-675414/id_rsa Username:docker}
I0804 00:52:18.497415 1684495 ssh_runner.go:195] Run: systemctl --version
I0804 00:52:18.502023 1684495 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0804 00:52:18.506569 1684495 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0804 00:52:18.529638 1684495 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0804 00:52:18.529716 1684495 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0804 00:52:18.539931 1684495 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0804 00:52:18.539956 1684495 start.go:495] detecting cgroup driver to use...
I0804 00:52:18.539988 1684495 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0804 00:52:18.540036 1684495 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0804 00:52:18.555829 1684495 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0804 00:52:18.571971 1684495 docker.go:217] disabling cri-docker service (if available) ...
I0804 00:52:18.572041 1684495 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0804 00:52:18.587652 1684495 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0804 00:52:18.600735 1684495 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0804 00:52:18.722974 1684495 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0804 00:52:18.832009 1684495 docker.go:233] disabling docker service ...
I0804 00:52:18.832082 1684495 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0804 00:52:18.848209 1684495 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0804 00:52:18.864545 1684495 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0804 00:52:18.971346 1684495 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0804 00:52:19.084825 1684495 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0804 00:52:19.097735 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0804 00:52:19.116120 1684495 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0804 00:52:19.129060 1684495 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0804 00:52:19.140397 1684495 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0804 00:52:19.140542 1684495 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0804 00:52:19.152870 1684495 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0804 00:52:19.164107 1684495 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0804 00:52:19.176214 1684495 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0804 00:52:19.187429 1684495 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0804 00:52:19.198470 1684495 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0804 00:52:19.209087 1684495 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0804 00:52:19.218996 1684495 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0804 00:52:19.228701 1684495 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0804 00:52:19.342310 1684495 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0804 00:52:19.605598 1684495 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0804 00:52:19.605718 1684495 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0804 00:52:19.614332 1684495 start.go:563] Will wait 60s for crictl version
I0804 00:52:19.614418 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:52:19.621506 1684495 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0804 00:52:19.672661 1684495 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.19
RuntimeApiVersion: v1
I0804 00:52:19.672764 1684495 ssh_runner.go:195] Run: containerd --version
I0804 00:52:19.695025 1684495 ssh_runner.go:195] Run: containerd --version
I0804 00:52:19.723189 1684495 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
I0804 00:52:19.725344 1684495 cli_runner.go:164] Run: docker network inspect old-k8s-version-675414 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0804 00:52:19.748581 1684495 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0804 00:52:19.752339 1684495 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0804 00:52:19.764472 1684495 kubeadm.go:883] updating cluster {Name:old-k8s-version-675414 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-675414 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0804 00:52:19.764591 1684495 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0804 00:52:19.764657 1684495 ssh_runner.go:195] Run: sudo crictl images --output json
I0804 00:52:19.815583 1684495 containerd.go:627] all images are preloaded for containerd runtime.
I0804 00:52:19.815604 1684495 containerd.go:534] Images already preloaded, skipping extraction
I0804 00:52:19.815663 1684495 ssh_runner.go:195] Run: sudo crictl images --output json
I0804 00:52:19.864347 1684495 containerd.go:627] all images are preloaded for containerd runtime.
I0804 00:52:19.864414 1684495 cache_images.go:84] Images are preloaded, skipping loading
I0804 00:52:19.864436 1684495 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I0804 00:52:19.864597 1684495 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-675414 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-675414 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0804 00:52:19.864697 1684495 ssh_runner.go:195] Run: sudo crictl info
I0804 00:52:19.909085 1684495 cni.go:84] Creating CNI manager for ""
I0804 00:52:19.909105 1684495 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0804 00:52:19.909114 1684495 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0804 00:52:19.909134 1684495 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-675414 NodeName:old-k8s-version-675414 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0804 00:52:19.909254 1684495 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-675414"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0804 00:52:19.909320 1684495 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0804 00:52:19.919203 1684495 binaries.go:44] Found k8s binaries, skipping transfer
I0804 00:52:19.919293 1684495 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0804 00:52:19.928017 1684495 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0804 00:52:19.946181 1684495 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0804 00:52:19.964338 1684495 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0804 00:52:19.995010 1684495 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0804 00:52:20.001975 1684495 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0804 00:52:20.024808 1684495 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0804 00:52:20.157158 1684495 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0804 00:52:20.176912 1684495 certs.go:68] Setting up /home/jenkins/minikube-integration/19370-1473734/.minikube/profiles/old-k8s-version-675414 for IP: 192.168.76.2
I0804 00:52:20.176938 1684495 certs.go:194] generating shared ca certs ...
I0804 00:52:20.176955 1684495 certs.go:226] acquiring lock for ca certs: {Name:mk2d20f3e6c520aa5e70e9098b9ab738af85e9ad Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0804 00:52:20.177098 1684495 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19370-1473734/.minikube/ca.key
I0804 00:52:20.177145 1684495 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19370-1473734/.minikube/proxy-client-ca.key
I0804 00:52:20.177157 1684495 certs.go:256] generating profile certs ...
I0804 00:52:20.177253 1684495 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19370-1473734/.minikube/profiles/old-k8s-version-675414/client.key
I0804 00:52:20.177335 1684495 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19370-1473734/.minikube/profiles/old-k8s-version-675414/apiserver.key.b2414c8a
I0804 00:52:20.177381 1684495 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19370-1473734/.minikube/profiles/old-k8s-version-675414/proxy-client.key
I0804 00:52:20.177528 1684495 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-1473734/.minikube/certs/1479137.pem (1338 bytes)
W0804 00:52:20.177564 1684495 certs.go:480] ignoring /home/jenkins/minikube-integration/19370-1473734/.minikube/certs/1479137_empty.pem, impossibly tiny 0 bytes
I0804 00:52:20.177577 1684495 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-1473734/.minikube/certs/ca-key.pem (1679 bytes)
I0804 00:52:20.177602 1684495 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-1473734/.minikube/certs/ca.pem (1082 bytes)
I0804 00:52:20.177629 1684495 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-1473734/.minikube/certs/cert.pem (1123 bytes)
I0804 00:52:20.177657 1684495 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-1473734/.minikube/certs/key.pem (1679 bytes)
I0804 00:52:20.177705 1684495 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-1473734/.minikube/files/etc/ssl/certs/14791372.pem (1708 bytes)
I0804 00:52:20.178336 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0804 00:52:20.236322 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0804 00:52:20.285044 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0804 00:52:20.312551 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0804 00:52:20.384533 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/profiles/old-k8s-version-675414/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0804 00:52:20.438289 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/profiles/old-k8s-version-675414/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0804 00:52:20.466493 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/profiles/old-k8s-version-675414/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0804 00:52:20.496307 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/profiles/old-k8s-version-675414/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0804 00:52:20.526492 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/certs/1479137.pem --> /usr/share/ca-certificates/1479137.pem (1338 bytes)
I0804 00:52:20.561224 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/files/etc/ssl/certs/14791372.pem --> /usr/share/ca-certificates/14791372.pem (1708 bytes)
I0804 00:52:20.587175 1684495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-1473734/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0804 00:52:20.623343 1684495 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0804 00:52:20.646739 1684495 ssh_runner.go:195] Run: openssl version
I0804 00:52:20.654136 1684495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14791372.pem && ln -fs /usr/share/ca-certificates/14791372.pem /etc/ssl/certs/14791372.pem"
I0804 00:52:20.665279 1684495 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14791372.pem
I0804 00:52:20.669237 1684495 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 4 00:13 /usr/share/ca-certificates/14791372.pem
I0804 00:52:20.669311 1684495 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14791372.pem
I0804 00:52:20.677276 1684495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14791372.pem /etc/ssl/certs/3ec20f2e.0"
I0804 00:52:20.686864 1684495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0804 00:52:20.697768 1684495 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0804 00:52:20.702635 1684495 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 4 00:02 /usr/share/ca-certificates/minikubeCA.pem
I0804 00:52:20.702708 1684495 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0804 00:52:20.712011 1684495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0804 00:52:20.721806 1684495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1479137.pem && ln -fs /usr/share/ca-certificates/1479137.pem /etc/ssl/certs/1479137.pem"
I0804 00:52:20.732051 1684495 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1479137.pem
I0804 00:52:20.738107 1684495 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 4 00:13 /usr/share/ca-certificates/1479137.pem
I0804 00:52:20.738174 1684495 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1479137.pem
I0804 00:52:20.746070 1684495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1479137.pem /etc/ssl/certs/51391683.0"
I0804 00:52:20.755966 1684495 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0804 00:52:20.761304 1684495 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0804 00:52:20.769000 1684495 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0804 00:52:20.783271 1684495 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0804 00:52:20.791051 1684495 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0804 00:52:20.799359 1684495 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0804 00:52:20.807061 1684495 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0804 00:52:20.814766 1684495 kubeadm.go:392] StartCluster: {Name:old-k8s-version-675414 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-675414 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0804 00:52:20.814918 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0804 00:52:20.815035 1684495 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0804 00:52:20.860437 1684495 cri.go:89] found id: "8423f820a508f1701f321c15883cd64ff81d08c0cfa7609f294ce7f4ae7e829b"
I0804 00:52:20.860516 1684495 cri.go:89] found id: "23b8338269ddca80162212d9a76197f8de6631dc25fd1e89271138d7bf6507f7"
I0804 00:52:20.860536 1684495 cri.go:89] found id: "b2b3333c07971682a25146e6a88c99680d811ede2319300b97cb5b3e68f7f57d"
I0804 00:52:20.860561 1684495 cri.go:89] found id: "989e28403b27a5a0236486c2c183e294a12c016c4c4c64c3ff9089948ddcfd21"
I0804 00:52:20.860603 1684495 cri.go:89] found id: "97f907d0b089f254c91cdc3774ba2ceadb64f9b568a9eade6636d6670779d9a7"
I0804 00:52:20.860624 1684495 cri.go:89] found id: "bfe98cd74da739eabd2a656d66b6599a764d7278da248862ec24b7eb65ddf53a"
I0804 00:52:20.860647 1684495 cri.go:89] found id: "be279b22b091c58ad9ed186bf62fa3b5f4471e254befe9b2885a9e11a69c1a89"
I0804 00:52:20.860682 1684495 cri.go:89] found id: "a66f6cfcc29b8bd49c8f13c54a60e9e147728c2d10100d2768cf68278e21f444"
I0804 00:52:20.860699 1684495 cri.go:89] found id: ""
I0804 00:52:20.860795 1684495 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0804 00:52:20.875168 1684495 cri.go:116] JSON = null
W0804 00:52:20.875267 1684495 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0804 00:52:20.875377 1684495 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0804 00:52:20.887091 1684495 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0804 00:52:20.887164 1684495 kubeadm.go:593] restartPrimaryControlPlane start ...
I0804 00:52:20.887253 1684495 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0804 00:52:20.897167 1684495 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0804 00:52:20.897725 1684495 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-675414" does not appear in /home/jenkins/minikube-integration/19370-1473734/kubeconfig
I0804 00:52:20.897891 1684495 kubeconfig.go:62] /home/jenkins/minikube-integration/19370-1473734/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-675414" cluster setting kubeconfig missing "old-k8s-version-675414" context setting]
I0804 00:52:20.898247 1684495 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-1473734/kubeconfig: {Name:mk27c985a2e0ad08ab78607f36d1f3ca89a1f0ea Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0804 00:52:20.899952 1684495 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0804 00:52:20.913683 1684495 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I0804 00:52:20.913781 1684495 kubeadm.go:597] duration metric: took 26.565844ms to restartPrimaryControlPlane
I0804 00:52:20.913815 1684495 kubeadm.go:394] duration metric: took 99.053732ms to StartCluster
I0804 00:52:20.913844 1684495 settings.go:142] acquiring lock: {Name:mkf39045e3df3ca7153b1fbaed09dab65e974abe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0804 00:52:20.913963 1684495 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19370-1473734/kubeconfig
I0804 00:52:20.914736 1684495 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-1473734/kubeconfig: {Name:mk27c985a2e0ad08ab78607f36d1f3ca89a1f0ea Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0804 00:52:20.915025 1684495 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0804 00:52:20.915437 1684495 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0804 00:52:20.915517 1684495 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-675414"
I0804 00:52:20.915553 1684495 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-675414"
W0804 00:52:20.915560 1684495 addons.go:243] addon storage-provisioner should already be in state true
I0804 00:52:20.915584 1684495 host.go:66] Checking if "old-k8s-version-675414" exists ...
I0804 00:52:20.916002 1684495 cli_runner.go:164] Run: docker container inspect old-k8s-version-675414 --format={{.State.Status}}
I0804 00:52:20.916617 1684495 config.go:182] Loaded profile config "old-k8s-version-675414": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0804 00:52:20.916778 1684495 addons.go:69] Setting dashboard=true in profile "old-k8s-version-675414"
I0804 00:52:20.916811 1684495 addons.go:234] Setting addon dashboard=true in "old-k8s-version-675414"
W0804 00:52:20.916817 1684495 addons.go:243] addon dashboard should already be in state true
I0804 00:52:20.916843 1684495 host.go:66] Checking if "old-k8s-version-675414" exists ...
I0804 00:52:20.917250 1684495 cli_runner.go:164] Run: docker container inspect old-k8s-version-675414 --format={{.State.Status}}
I0804 00:52:20.919103 1684495 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-675414"
I0804 00:52:20.919161 1684495 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-675414"
W0804 00:52:20.919377 1684495 addons.go:243] addon metrics-server should already be in state true
I0804 00:52:20.919445 1684495 host.go:66] Checking if "old-k8s-version-675414" exists ...
I0804 00:52:20.921380 1684495 cli_runner.go:164] Run: docker container inspect old-k8s-version-675414 --format={{.State.Status}}
I0804 00:52:20.919285 1684495 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-675414"
I0804 00:52:20.922726 1684495 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-675414"
I0804 00:52:20.922766 1684495 out.go:177] * Verifying Kubernetes components...
I0804 00:52:20.923068 1684495 cli_runner.go:164] Run: docker container inspect old-k8s-version-675414 --format={{.State.Status}}
I0804 00:52:20.924993 1684495 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0804 00:52:20.962818 1684495 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0804 00:52:20.962936 1684495 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0804 00:52:20.965079 1684495 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0804 00:52:20.965371 1684495 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0804 00:52:20.965385 1684495 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0804 00:52:20.965460 1684495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-675414
I0804 00:52:20.967525 1684495 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0804 00:52:20.967547 1684495 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0804 00:52:20.967636 1684495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-675414
I0804 00:52:20.989154 1684495 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0804 00:52:20.992191 1684495 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0804 00:52:20.992216 1684495 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0804 00:52:20.992296 1684495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-675414
I0804 00:52:21.010586 1684495 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-675414"
W0804 00:52:21.010608 1684495 addons.go:243] addon default-storageclass should already be in state true
I0804 00:52:21.010636 1684495 host.go:66] Checking if "old-k8s-version-675414" exists ...
I0804 00:52:21.011517 1684495 cli_runner.go:164] Run: docker container inspect old-k8s-version-675414 --format={{.State.Status}}
I0804 00:52:21.052877 1684495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34920 SSHKeyPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/machines/old-k8s-version-675414/id_rsa Username:docker}
I0804 00:52:21.074824 1684495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34920 SSHKeyPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/machines/old-k8s-version-675414/id_rsa Username:docker}
I0804 00:52:21.080850 1684495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34920 SSHKeyPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/machines/old-k8s-version-675414/id_rsa Username:docker}
I0804 00:52:21.083031 1684495 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0804 00:52:21.083054 1684495 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0804 00:52:21.083118 1684495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-675414
I0804 00:52:21.116435 1684495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34920 SSHKeyPath:/home/jenkins/minikube-integration/19370-1473734/.minikube/machines/old-k8s-version-675414/id_rsa Username:docker}
I0804 00:52:21.140620 1684495 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0804 00:52:21.192526 1684495 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-675414" to be "Ready" ...
I0804 00:52:21.240315 1684495 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0804 00:52:21.240339 1684495 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0804 00:52:21.293788 1684495 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0804 00:52:21.293816 1684495 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0804 00:52:21.297480 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0804 00:52:21.316995 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0804 00:52:21.320449 1684495 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0804 00:52:21.320519 1684495 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0804 00:52:21.372462 1684495 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0804 00:52:21.372535 1684495 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0804 00:52:21.385474 1684495 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0804 00:52:21.385570 1684495 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0804 00:52:21.456616 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0804 00:52:21.474049 1684495 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0804 00:52:21.474127 1684495 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0804 00:52:21.589196 1684495 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0804 00:52:21.589267 1684495 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0804 00:52:21.626342 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:21.626425 1684495 retry.go:31] will retry after 310.632352ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0804 00:52:21.627909 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:21.627986 1684495 retry.go:31] will retry after 134.808942ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:21.684350 1684495 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0804 00:52:21.684424 1684495 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0804 00:52:21.709251 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:21.709337 1684495 retry.go:31] will retry after 323.768229ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:21.722070 1684495 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0804 00:52:21.722148 1684495 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0804 00:52:21.741366 1684495 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0804 00:52:21.741440 1684495 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0804 00:52:21.760246 1684495 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0804 00:52:21.760321 1684495 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0804 00:52:21.763501 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0804 00:52:21.795442 1684495 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0804 00:52:21.795519 1684495 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0804 00:52:21.854429 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0804 00:52:21.888224 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:21.888305 1684495 retry.go:31] will retry after 433.995887ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:21.937592 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0804 00:52:22.004612 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:22.004702 1684495 retry.go:31] will retry after 312.577807ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:22.033798 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0804 00:52:22.083130 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:22.083221 1684495 retry.go:31] will retry after 546.629343ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0804 00:52:22.162497 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:22.162579 1684495 retry.go:31] will retry after 510.942843ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:22.318387 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0804 00:52:22.322667 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0804 00:52:22.461493 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:22.461579 1684495 retry.go:31] will retry after 256.573273ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0804 00:52:22.479152 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:22.479186 1684495 retry.go:31] will retry after 482.207675ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:22.630566 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0804 00:52:22.674300 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0804 00:52:22.718630 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0804 00:52:22.745907 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:22.745982 1684495 retry.go:31] will retry after 796.473179ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0804 00:52:22.910242 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:22.910314 1684495 retry.go:31] will retry after 308.242734ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:22.962356 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0804 00:52:23.103610 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:23.103639 1684495 retry.go:31] will retry after 669.872259ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:23.193160 1684495 node_ready.go:53] error getting node "old-k8s-version-675414": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-675414": dial tcp 192.168.76.2:8443: connect: connection refused
I0804 00:52:23.219509 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0804 00:52:23.269229 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:23.269258 1684495 retry.go:31] will retry after 612.439619ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0804 00:52:23.389574 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:23.389607 1684495 retry.go:31] will retry after 738.411198ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:23.542873 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0804 00:52:23.613580 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:23.613613 1684495 retry.go:31] will retry after 452.843491ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:23.774576 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0804 00:52:23.847131 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:23.847164 1684495 retry.go:31] will retry after 958.899113ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:23.882412 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0804 00:52:23.960779 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:23.960815 1684495 retry.go:31] will retry after 1.432830457s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:24.067136 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0804 00:52:24.129011 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0804 00:52:24.149478 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:24.149515 1684495 retry.go:31] will retry after 1.198665894s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0804 00:52:24.210193 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:24.210233 1684495 retry.go:31] will retry after 1.740732453s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:24.806289 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0804 00:52:24.878179 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:24.878213 1684495 retry.go:31] will retry after 992.963164ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:25.193932 1684495 node_ready.go:53] error getting node "old-k8s-version-675414": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-675414": dial tcp 192.168.76.2:8443: connect: connection refused
I0804 00:52:25.349249 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0804 00:52:25.394624 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0804 00:52:25.456975 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:25.457012 1684495 retry.go:31] will retry after 2.555274127s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0804 00:52:25.514146 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:25.514188 1684495 retry.go:31] will retry after 970.42327ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:25.872267 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0804 00:52:25.950938 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:25.950973 1684495 retry.go:31] will retry after 2.012595075s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:25.951042 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0804 00:52:26.025573 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:26.025609 1684495 retry.go:31] will retry after 1.846275836s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:26.485583 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0804 00:52:26.563414 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:26.563448 1684495 retry.go:31] will retry after 1.437860964s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:27.694079 1684495 node_ready.go:53] error getting node "old-k8s-version-675414": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-675414": dial tcp 192.168.76.2:8443: connect: connection refused
I0804 00:52:27.872133 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0804 00:52:27.964246 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0804 00:52:28.002170 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0804 00:52:28.013056 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0804 00:52:28.014737 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:28.014767 1684495 retry.go:31] will retry after 2.444967427s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0804 00:52:28.207653 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:28.207681 1684495 retry.go:31] will retry after 3.399187594s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0804 00:52:28.250192 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:28.250223 1684495 retry.go:31] will retry after 4.320798746s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0804 00:52:28.285873 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:28.285910 1684495 retry.go:31] will retry after 1.728407841s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0804 00:52:30.014943 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0804 00:52:30.459947 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0804 00:52:31.607602 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0804 00:52:32.571172 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0804 00:52:40.194357 1684495 node_ready.go:53] error getting node "old-k8s-version-675414": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-675414": net/http: TLS handshake timeout
I0804 00:52:40.490262 1684495 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (10.475259936s)
W0804 00:52:40.490304 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0804 00:52:40.490322 1684495 retry.go:31] will retry after 3.524458997s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0804 00:52:40.831043 1684495 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.371057645s)
W0804 00:52:40.831079 1684495 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0804 00:52:40.831098 1684495 retry.go:31] will retry after 5.444649105s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0804 00:52:41.368221 1684495 node_ready.go:49] node "old-k8s-version-675414" has status "Ready":"True"
I0804 00:52:41.368248 1684495 node_ready.go:38] duration metric: took 20.175688854s for node "old-k8s-version-675414" to be "Ready" ...
I0804 00:52:41.368259 1684495 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0804 00:52:41.598756 1684495 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-hqfq7" in "kube-system" namespace to be "Ready" ...
I0804 00:52:41.838431 1684495 pod_ready.go:92] pod "coredns-74ff55c5b-hqfq7" in "kube-system" namespace has status "Ready":"True"
I0804 00:52:41.838505 1684495 pod_ready.go:81] duration metric: took 239.618234ms for pod "coredns-74ff55c5b-hqfq7" in "kube-system" namespace to be "Ready" ...
I0804 00:52:41.838534 1684495 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-675414" in "kube-system" namespace to be "Ready" ...
I0804 00:52:41.910784 1684495 pod_ready.go:92] pod "etcd-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"True"
I0804 00:52:41.910856 1684495 pod_ready.go:81] duration metric: took 72.30064ms for pod "etcd-old-k8s-version-675414" in "kube-system" namespace to be "Ready" ...
I0804 00:52:41.910907 1684495 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-675414" in "kube-system" namespace to be "Ready" ...
I0804 00:52:41.983624 1684495 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"True"
I0804 00:52:41.983698 1684495 pod_ready.go:81] duration metric: took 72.768634ms for pod "kube-apiserver-old-k8s-version-675414" in "kube-system" namespace to be "Ready" ...
I0804 00:52:41.983724 1684495 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace to be "Ready" ...
I0804 00:52:43.286815 1684495 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (11.679166991s)
I0804 00:52:43.287080 1684495 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (10.715877729s)
I0804 00:52:43.289259 1684495 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-675414 addons enable metrics-server
I0804 00:52:43.991168 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:52:44.015437 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0804 00:52:45.335720 1684495 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (1.320246803s)
I0804 00:52:46.276047 1684495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0804 00:52:46.496260 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:52:46.898651 1684495 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-675414"
I0804 00:52:46.900754 1684495 out.go:177] * Enabled addons: storage-provisioner, dashboard, default-storageclass, metrics-server
I0804 00:52:46.902538 1684495 addons.go:510] duration metric: took 25.98709854s for enable addons: enabled=[storage-provisioner dashboard default-storageclass metrics-server]
I0804 00:52:48.990931 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:52:51.491243 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:52:53.990026 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:52:55.999534 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:52:58.490842 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:00.493207 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:02.499864 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:04.992418 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:07.490429 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:09.493229 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:11.990575 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:14.491736 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:16.990044 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:19.489926 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:21.490107 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:23.992845 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:26.493076 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:28.990254 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:30.990370 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:32.990723 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:35.490840 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:37.491465 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:39.990285 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:41.990408 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:44.492630 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:46.498764 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:48.995452 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:51.491292 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:53.990475 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:56.491557 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:53:58.991191 1684495 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:00.993492 1684495 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"True"
I0804 00:54:00.993522 1684495 pod_ready.go:81] duration metric: took 1m19.009776515s for pod "kube-controller-manager-old-k8s-version-675414" in "kube-system" namespace to be "Ready" ...
I0804 00:54:00.993535 1684495 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-vffqm" in "kube-system" namespace to be "Ready" ...
I0804 00:54:01.000850 1684495 pod_ready.go:92] pod "kube-proxy-vffqm" in "kube-system" namespace has status "Ready":"True"
I0804 00:54:01.000942 1684495 pod_ready.go:81] duration metric: took 7.398773ms for pod "kube-proxy-vffqm" in "kube-system" namespace to be "Ready" ...
I0804 00:54:01.000978 1684495 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-675414" in "kube-system" namespace to be "Ready" ...
I0804 00:54:01.007678 1684495 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-675414" in "kube-system" namespace has status "Ready":"True"
I0804 00:54:01.007703 1684495 pod_ready.go:81] duration metric: took 6.689664ms for pod "kube-scheduler-old-k8s-version-675414" in "kube-system" namespace to be "Ready" ...
I0804 00:54:01.007716 1684495 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace to be "Ready" ...
I0804 00:54:03.016259 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:05.024971 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:07.513093 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:09.513831 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:11.513904 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:14.013702 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:16.014169 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:18.014835 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:20.018430 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:22.514547 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:25.022203 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:27.514524 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:30.023573 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:32.514917 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:35.015638 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:37.520703 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:40.017811 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:42.516247 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:45.023780 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:47.514367 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:50.016123 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:52.106253 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:54.514230 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:57.015205 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:54:59.514056 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:01.514650 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:04.015358 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:06.016809 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:08.513643 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:10.514247 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:13.014022 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:15.018655 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:17.021104 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:19.514273 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:22.014678 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:24.514271 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:27.016006 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:29.514720 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:32.014427 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:34.515440 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:37.015725 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:39.514308 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:42.024193 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:44.513577 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:46.514790 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:49.013580 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:51.014633 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:53.015267 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:55.015841 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:55:57.514241 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:00.030632 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:02.515086 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:05.017398 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:07.020024 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:09.513829 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:11.513940 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:13.514582 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:16.014108 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:18.015405 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:20.016322 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:22.514115 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:24.514465 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:27.015270 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:29.513753 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:31.514391 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:34.015584 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:36.514268 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:38.514525 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:41.013627 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:43.015982 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:45.019910 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:47.520887 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:50.016850 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:52.514440 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:54.514792 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:56.517322 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:56:59.013836 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:01.014837 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:03.514768 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:06.017395 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:08.514086 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:10.514927 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:13.016281 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:15.020651 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:17.513512 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:19.516023 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:22.015111 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:24.015508 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:26.514695 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:29.014195 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:31.014621 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:33.517261 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:36.015991 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:38.514189 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:40.514299 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:43.013992 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:45.025839 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:47.514297 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:49.514840 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:52.015573 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:54.513686 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:57.016807 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:57:59.514677 1684495 pod_ready.go:102] pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace has status "Ready":"False"
I0804 00:58:01.014807 1684495 pod_ready.go:81] duration metric: took 4m0.007076801s for pod "metrics-server-9975d5f86-7sd8p" in "kube-system" namespace to be "Ready" ...
E0804 00:58:01.014832 1684495 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0804 00:58:01.014841 1684495 pod_ready.go:38] duration metric: took 5m19.646571569s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0804 00:58:01.014854 1684495 api_server.go:52] waiting for apiserver process to appear ...
I0804 00:58:01.014884 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0804 00:58:01.014944 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0804 00:58:01.088859 1684495 cri.go:89] found id: "987c7c57f33cc3bca08f2823d03c3436be4204498232f94e80f1ca3ad97e0370"
I0804 00:58:01.088892 1684495 cri.go:89] found id: "be279b22b091c58ad9ed186bf62fa3b5f4471e254befe9b2885a9e11a69c1a89"
I0804 00:58:01.088898 1684495 cri.go:89] found id: ""
I0804 00:58:01.088905 1684495 logs.go:276] 2 containers: [987c7c57f33cc3bca08f2823d03c3436be4204498232f94e80f1ca3ad97e0370 be279b22b091c58ad9ed186bf62fa3b5f4471e254befe9b2885a9e11a69c1a89]
I0804 00:58:01.088961 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.094375 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.099566 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0804 00:58:01.099650 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0804 00:58:01.166854 1684495 cri.go:89] found id: "149ef55fe5819ea69bac9c7279bdc8bb8e78b033b45c5b50cc448617e1d08c73"
I0804 00:58:01.166878 1684495 cri.go:89] found id: "97f907d0b089f254c91cdc3774ba2ceadb64f9b568a9eade6636d6670779d9a7"
I0804 00:58:01.166884 1684495 cri.go:89] found id: ""
I0804 00:58:01.166891 1684495 logs.go:276] 2 containers: [149ef55fe5819ea69bac9c7279bdc8bb8e78b033b45c5b50cc448617e1d08c73 97f907d0b089f254c91cdc3774ba2ceadb64f9b568a9eade6636d6670779d9a7]
I0804 00:58:01.166948 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.171059 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.174882 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0804 00:58:01.174952 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0804 00:58:01.245703 1684495 cri.go:89] found id: "5f5c5ceaa344b4a2f51ee71176bc05b853ecc9224acfc037062f5c089bdd53cd"
I0804 00:58:01.245726 1684495 cri.go:89] found id: "8423f820a508f1701f321c15883cd64ff81d08c0cfa7609f294ce7f4ae7e829b"
I0804 00:58:01.245730 1684495 cri.go:89] found id: ""
I0804 00:58:01.245737 1684495 logs.go:276] 2 containers: [5f5c5ceaa344b4a2f51ee71176bc05b853ecc9224acfc037062f5c089bdd53cd 8423f820a508f1701f321c15883cd64ff81d08c0cfa7609f294ce7f4ae7e829b]
I0804 00:58:01.245809 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.251135 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.255546 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0804 00:58:01.255634 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0804 00:58:01.335579 1684495 cri.go:89] found id: "7960a12d68e3b491cf04420a9d57537f55924eba2b7eb5bda75c8a354ae5e032"
I0804 00:58:01.335602 1684495 cri.go:89] found id: "a66f6cfcc29b8bd49c8f13c54a60e9e147728c2d10100d2768cf68278e21f444"
I0804 00:58:01.335607 1684495 cri.go:89] found id: ""
I0804 00:58:01.335614 1684495 logs.go:276] 2 containers: [7960a12d68e3b491cf04420a9d57537f55924eba2b7eb5bda75c8a354ae5e032 a66f6cfcc29b8bd49c8f13c54a60e9e147728c2d10100d2768cf68278e21f444]
I0804 00:58:01.335670 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.340907 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.344445 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0804 00:58:01.344513 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0804 00:58:01.420038 1684495 cri.go:89] found id: "077c4d240dbe0a241741ad2fc0948dd86eba5a5ea94ab539993c350e9875633f"
I0804 00:58:01.420123 1684495 cri.go:89] found id: "989e28403b27a5a0236486c2c183e294a12c016c4c4c64c3ff9089948ddcfd21"
I0804 00:58:01.420141 1684495 cri.go:89] found id: ""
I0804 00:58:01.420183 1684495 logs.go:276] 2 containers: [077c4d240dbe0a241741ad2fc0948dd86eba5a5ea94ab539993c350e9875633f 989e28403b27a5a0236486c2c183e294a12c016c4c4c64c3ff9089948ddcfd21]
I0804 00:58:01.420273 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.427224 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.431917 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0804 00:58:01.432040 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0804 00:58:01.498843 1684495 cri.go:89] found id: "f75a0f3a0098d71dba19c2fda8834332ee198e6777d297afd3be08a02a5cedf9"
I0804 00:58:01.498920 1684495 cri.go:89] found id: "bfe98cd74da739eabd2a656d66b6599a764d7278da248862ec24b7eb65ddf53a"
I0804 00:58:01.498949 1684495 cri.go:89] found id: ""
I0804 00:58:01.498971 1684495 logs.go:276] 2 containers: [f75a0f3a0098d71dba19c2fda8834332ee198e6777d297afd3be08a02a5cedf9 bfe98cd74da739eabd2a656d66b6599a764d7278da248862ec24b7eb65ddf53a]
I0804 00:58:01.499062 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.505641 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.510080 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0804 00:58:01.510219 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0804 00:58:01.569484 1684495 cri.go:89] found id: "c09a50d1e2d0abf8d930c57d74d8d9d9c9257f0e39e5a083a3ea16e35ee03b0f"
I0804 00:58:01.569555 1684495 cri.go:89] found id: "23b8338269ddca80162212d9a76197f8de6631dc25fd1e89271138d7bf6507f7"
I0804 00:58:01.569572 1684495 cri.go:89] found id: ""
I0804 00:58:01.569594 1684495 logs.go:276] 2 containers: [c09a50d1e2d0abf8d930c57d74d8d9d9c9257f0e39e5a083a3ea16e35ee03b0f 23b8338269ddca80162212d9a76197f8de6631dc25fd1e89271138d7bf6507f7]
I0804 00:58:01.569691 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.576440 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.580698 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0804 00:58:01.580928 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0804 00:58:01.637056 1684495 cri.go:89] found id: "aafe2aa0c39a34282c92489dd6d4e856f3fbd5ff82e808079ab2f8e7c3366383"
I0804 00:58:01.637118 1684495 cri.go:89] found id: ""
I0804 00:58:01.637148 1684495 logs.go:276] 1 containers: [aafe2aa0c39a34282c92489dd6d4e856f3fbd5ff82e808079ab2f8e7c3366383]
I0804 00:58:01.637237 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.641670 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0804 00:58:01.641795 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0804 00:58:01.702293 1684495 cri.go:89] found id: "b6a2eb1e427442100a4c7c83a3d7b1ead5c7c050b06d9744549f7c844a98c947"
I0804 00:58:01.702366 1684495 cri.go:89] found id: "76ba2c77767271189966f7605db549a47762718ea69ef080d8be2aa9635320fa"
I0804 00:58:01.702384 1684495 cri.go:89] found id: ""
I0804 00:58:01.702409 1684495 logs.go:276] 2 containers: [b6a2eb1e427442100a4c7c83a3d7b1ead5c7c050b06d9744549f7c844a98c947 76ba2c77767271189966f7605db549a47762718ea69ef080d8be2aa9635320fa]
I0804 00:58:01.702504 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.706707 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:01.710445 1684495 logs.go:123] Gathering logs for dmesg ...
I0804 00:58:01.710475 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0804 00:58:01.729515 1684495 logs.go:123] Gathering logs for coredns [8423f820a508f1701f321c15883cd64ff81d08c0cfa7609f294ce7f4ae7e829b] ...
I0804 00:58:01.729548 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8423f820a508f1701f321c15883cd64ff81d08c0cfa7609f294ce7f4ae7e829b"
I0804 00:58:01.768709 1684495 logs.go:123] Gathering logs for kube-scheduler [7960a12d68e3b491cf04420a9d57537f55924eba2b7eb5bda75c8a354ae5e032] ...
I0804 00:58:01.768784 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7960a12d68e3b491cf04420a9d57537f55924eba2b7eb5bda75c8a354ae5e032"
I0804 00:58:01.821240 1684495 logs.go:123] Gathering logs for kube-controller-manager [bfe98cd74da739eabd2a656d66b6599a764d7278da248862ec24b7eb65ddf53a] ...
I0804 00:58:01.821270 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bfe98cd74da739eabd2a656d66b6599a764d7278da248862ec24b7eb65ddf53a"
I0804 00:58:01.885821 1684495 logs.go:123] Gathering logs for kindnet [c09a50d1e2d0abf8d930c57d74d8d9d9c9257f0e39e5a083a3ea16e35ee03b0f] ...
I0804 00:58:01.885860 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c09a50d1e2d0abf8d930c57d74d8d9d9c9257f0e39e5a083a3ea16e35ee03b0f"
I0804 00:58:01.951719 1684495 logs.go:123] Gathering logs for kube-apiserver [be279b22b091c58ad9ed186bf62fa3b5f4471e254befe9b2885a9e11a69c1a89] ...
I0804 00:58:01.951753 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be279b22b091c58ad9ed186bf62fa3b5f4471e254befe9b2885a9e11a69c1a89"
I0804 00:58:02.005715 1684495 logs.go:123] Gathering logs for etcd [149ef55fe5819ea69bac9c7279bdc8bb8e78b033b45c5b50cc448617e1d08c73] ...
I0804 00:58:02.005761 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 149ef55fe5819ea69bac9c7279bdc8bb8e78b033b45c5b50cc448617e1d08c73"
I0804 00:58:02.055446 1684495 logs.go:123] Gathering logs for kube-scheduler [a66f6cfcc29b8bd49c8f13c54a60e9e147728c2d10100d2768cf68278e21f444] ...
I0804 00:58:02.055521 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a66f6cfcc29b8bd49c8f13c54a60e9e147728c2d10100d2768cf68278e21f444"
I0804 00:58:02.096424 1684495 logs.go:123] Gathering logs for kube-proxy [077c4d240dbe0a241741ad2fc0948dd86eba5a5ea94ab539993c350e9875633f] ...
I0804 00:58:02.096452 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 077c4d240dbe0a241741ad2fc0948dd86eba5a5ea94ab539993c350e9875633f"
I0804 00:58:02.138482 1684495 logs.go:123] Gathering logs for kube-proxy [989e28403b27a5a0236486c2c183e294a12c016c4c4c64c3ff9089948ddcfd21] ...
I0804 00:58:02.138508 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 989e28403b27a5a0236486c2c183e294a12c016c4c4c64c3ff9089948ddcfd21"
I0804 00:58:02.185079 1684495 logs.go:123] Gathering logs for container status ...
I0804 00:58:02.185150 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0804 00:58:02.232999 1684495 logs.go:123] Gathering logs for kubelet ...
I0804 00:58:02.233031 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0804 00:58:02.295044 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.282639 660 reflector.go:138] object-"kube-system"/"kindnet-token-shjqq": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-shjqq" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:02.295376 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.414364 660 reflector.go:138] object-"kube-system"/"metrics-server-token-6rjpz": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-6rjpz" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:02.295657 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.414439 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-mvlnm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-mvlnm" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:02.295870 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.414534 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:02.296086 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.414581 660 reflector.go:138] object-"kube-system"/"coredns-token-hqkxf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-hqkxf" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:02.296291 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.414628 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:02.296518 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.414673 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-99h2z": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-99h2z" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:02.296819 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.414719 660 reflector.go:138] object-"default"/"default-token-zq2f5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-zq2f5" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:02.305775 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:45 old-k8s-version-675414 kubelet[660]: E0804 00:52:45.082202 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0804 00:58:02.305967 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:45 old-k8s-version-675414 kubelet[660]: E0804 00:52:45.241326 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.308747 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:56 old-k8s-version-675414 kubelet[660]: E0804 00:52:56.947308 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0804 00:58:02.311233 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:10 old-k8s-version-675414 kubelet[660]: E0804 00:53:10.413189 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.311704 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:11 old-k8s-version-675414 kubelet[660]: E0804 00:53:11.416861 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.311898 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:11 old-k8s-version-675414 kubelet[660]: E0804 00:53:11.936064 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.312225 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:14 old-k8s-version-675414 kubelet[660]: E0804 00:53:14.644181 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.312668 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:16 old-k8s-version-675414 kubelet[660]: E0804 00:53:16.429661 660 pod_workers.go:191] Error syncing pod 216c109c-26cb-4b0d-a9f2-68fb302fb56a ("storage-provisioner_kube-system(216c109c-26cb-4b0d-a9f2-68fb302fb56a)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(216c109c-26cb-4b0d-a9f2-68fb302fb56a)"
W0804 00:58:02.315453 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:23 old-k8s-version-675414 kubelet[660]: E0804 00:53:23.943884 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0804 00:58:02.316042 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:28 old-k8s-version-675414 kubelet[660]: E0804 00:53:28.466793 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.316504 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:34 old-k8s-version-675414 kubelet[660]: E0804 00:53:34.644204 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.316690 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:37 old-k8s-version-675414 kubelet[660]: E0804 00:53:37.936216 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.317026 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:46 old-k8s-version-675414 kubelet[660]: E0804 00:53:46.938197 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.317215 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:48 old-k8s-version-675414 kubelet[660]: E0804 00:53:48.951498 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.317535 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:59 old-k8s-version-675414 kubelet[660]: E0804 00:53:59.936614 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.317997 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:01 old-k8s-version-675414 kubelet[660]: E0804 00:54:01.570437 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.318326 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:04 old-k8s-version-675414 kubelet[660]: E0804 00:54:04.644942 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.320762 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:13 old-k8s-version-675414 kubelet[660]: E0804 00:54:13.943413 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0804 00:58:02.321089 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:16 old-k8s-version-675414 kubelet[660]: E0804 00:54:16.936076 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.321282 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:24 old-k8s-version-675414 kubelet[660]: E0804 00:54:24.937645 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.321611 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:27 old-k8s-version-675414 kubelet[660]: E0804 00:54:27.936088 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.321801 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:39 old-k8s-version-675414 kubelet[660]: E0804 00:54:39.950657 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.322387 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:43 old-k8s-version-675414 kubelet[660]: E0804 00:54:43.676832 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.322713 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:44 old-k8s-version-675414 kubelet[660]: E0804 00:54:44.680432 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.322900 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:53 old-k8s-version-675414 kubelet[660]: E0804 00:54:53.936211 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.323230 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:57 old-k8s-version-675414 kubelet[660]: E0804 00:54:57.935700 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.323415 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:07 old-k8s-version-675414 kubelet[660]: E0804 00:55:07.935950 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.323747 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:11 old-k8s-version-675414 kubelet[660]: E0804 00:55:11.935702 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.323932 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:20 old-k8s-version-675414 kubelet[660]: E0804 00:55:20.936143 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.324266 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:24 old-k8s-version-675414 kubelet[660]: E0804 00:55:24.936368 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.326726 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:34 old-k8s-version-675414 kubelet[660]: E0804 00:55:34.943118 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0804 00:58:02.327057 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:38 old-k8s-version-675414 kubelet[660]: E0804 00:55:38.935868 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.327244 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:47 old-k8s-version-675414 kubelet[660]: E0804 00:55:47.936158 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.327583 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:50 old-k8s-version-675414 kubelet[660]: E0804 00:55:50.936495 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.327768 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:58 old-k8s-version-675414 kubelet[660]: E0804 00:55:58.936644 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.328353 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:06 old-k8s-version-675414 kubelet[660]: E0804 00:56:06.867337 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.328538 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:10 old-k8s-version-675414 kubelet[660]: E0804 00:56:10.939645 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.328869 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:14 old-k8s-version-675414 kubelet[660]: E0804 00:56:14.644651 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.329054 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:25 old-k8s-version-675414 kubelet[660]: E0804 00:56:25.935973 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.329380 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:29 old-k8s-version-675414 kubelet[660]: E0804 00:56:29.935605 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.329587 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:37 old-k8s-version-675414 kubelet[660]: E0804 00:56:37.935980 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.329918 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:43 old-k8s-version-675414 kubelet[660]: E0804 00:56:43.936154 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.330103 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:49 old-k8s-version-675414 kubelet[660]: E0804 00:56:49.936459 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.330428 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:55 old-k8s-version-675414 kubelet[660]: E0804 00:56:55.935648 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.330613 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:02 old-k8s-version-675414 kubelet[660]: E0804 00:57:02.936961 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.330939 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:07 old-k8s-version-675414 kubelet[660]: E0804 00:57:07.935632 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.331125 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:17 old-k8s-version-675414 kubelet[660]: E0804 00:57:17.936096 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.331451 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:18 old-k8s-version-675414 kubelet[660]: E0804 00:57:18.936013 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.331635 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:30 old-k8s-version-675414 kubelet[660]: E0804 00:57:30.936039 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.331965 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:33 old-k8s-version-675414 kubelet[660]: E0804 00:57:33.935699 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.332154 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:43 old-k8s-version-675414 kubelet[660]: E0804 00:57:43.936175 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.332482 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:48 old-k8s-version-675414 kubelet[660]: E0804 00:57:48.936525 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.332671 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:58 old-k8s-version-675414 kubelet[660]: E0804 00:57:58.937236 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0804 00:58:02.332681 1684495 logs.go:123] Gathering logs for etcd [97f907d0b089f254c91cdc3774ba2ceadb64f9b568a9eade6636d6670779d9a7] ...
I0804 00:58:02.332696 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 97f907d0b089f254c91cdc3774ba2ceadb64f9b568a9eade6636d6670779d9a7"
I0804 00:58:02.381954 1684495 logs.go:123] Gathering logs for containerd ...
I0804 00:58:02.381983 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0804 00:58:02.443278 1684495 logs.go:123] Gathering logs for storage-provisioner [b6a2eb1e427442100a4c7c83a3d7b1ead5c7c050b06d9744549f7c844a98c947] ...
I0804 00:58:02.443317 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b6a2eb1e427442100a4c7c83a3d7b1ead5c7c050b06d9744549f7c844a98c947"
I0804 00:58:02.498008 1684495 logs.go:123] Gathering logs for storage-provisioner [76ba2c77767271189966f7605db549a47762718ea69ef080d8be2aa9635320fa] ...
I0804 00:58:02.498037 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 76ba2c77767271189966f7605db549a47762718ea69ef080d8be2aa9635320fa"
I0804 00:58:02.535543 1684495 logs.go:123] Gathering logs for describe nodes ...
I0804 00:58:02.535577 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0804 00:58:02.693919 1684495 logs.go:123] Gathering logs for kube-apiserver [987c7c57f33cc3bca08f2823d03c3436be4204498232f94e80f1ca3ad97e0370] ...
I0804 00:58:02.693947 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 987c7c57f33cc3bca08f2823d03c3436be4204498232f94e80f1ca3ad97e0370"
I0804 00:58:02.754938 1684495 logs.go:123] Gathering logs for coredns [5f5c5ceaa344b4a2f51ee71176bc05b853ecc9224acfc037062f5c089bdd53cd] ...
I0804 00:58:02.754971 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f5c5ceaa344b4a2f51ee71176bc05b853ecc9224acfc037062f5c089bdd53cd"
I0804 00:58:02.797577 1684495 logs.go:123] Gathering logs for kube-controller-manager [f75a0f3a0098d71dba19c2fda8834332ee198e6777d297afd3be08a02a5cedf9] ...
I0804 00:58:02.797605 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f75a0f3a0098d71dba19c2fda8834332ee198e6777d297afd3be08a02a5cedf9"
I0804 00:58:02.864702 1684495 logs.go:123] Gathering logs for kindnet [23b8338269ddca80162212d9a76197f8de6631dc25fd1e89271138d7bf6507f7] ...
I0804 00:58:02.864943 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 23b8338269ddca80162212d9a76197f8de6631dc25fd1e89271138d7bf6507f7"
I0804 00:58:02.915802 1684495 logs.go:123] Gathering logs for kubernetes-dashboard [aafe2aa0c39a34282c92489dd6d4e856f3fbd5ff82e808079ab2f8e7c3366383] ...
I0804 00:58:02.915838 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 aafe2aa0c39a34282c92489dd6d4e856f3fbd5ff82e808079ab2f8e7c3366383"
I0804 00:58:02.973927 1684495 out.go:304] Setting ErrFile to fd 2...
I0804 00:58:02.973956 1684495 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0804 00:58:02.974003 1684495 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0804 00:58:02.974018 1684495 out.go:239] Aug 04 00:57:30 old-k8s-version-675414 kubelet[660]: E0804 00:57:30.936039 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:57:30 old-k8s-version-675414 kubelet[660]: E0804 00:57:30.936039 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.974026 1684495 out.go:239] Aug 04 00:57:33 old-k8s-version-675414 kubelet[660]: E0804 00:57:33.935699 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
Aug 04 00:57:33 old-k8s-version-675414 kubelet[660]: E0804 00:57:33.935699 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.974041 1684495 out.go:239] Aug 04 00:57:43 old-k8s-version-675414 kubelet[660]: E0804 00:57:43.936175 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:57:43 old-k8s-version-675414 kubelet[660]: E0804 00:57:43.936175 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:02.974049 1684495 out.go:239] Aug 04 00:57:48 old-k8s-version-675414 kubelet[660]: E0804 00:57:48.936525 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
Aug 04 00:57:48 old-k8s-version-675414 kubelet[660]: E0804 00:57:48.936525 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:02.974060 1684495 out.go:239] Aug 04 00:57:58 old-k8s-version-675414 kubelet[660]: E0804 00:57:58.937236 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:57:58 old-k8s-version-675414 kubelet[660]: E0804 00:57:58.937236 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0804 00:58:02.974068 1684495 out.go:304] Setting ErrFile to fd 2...
I0804 00:58:02.974073 1684495 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0804 00:58:12.975616 1684495 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0804 00:58:12.989094 1684495 api_server.go:72] duration metric: took 5m52.074011299s to wait for apiserver process to appear ...
I0804 00:58:12.989119 1684495 api_server.go:88] waiting for apiserver healthz status ...
I0804 00:58:12.989152 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0804 00:58:12.989212 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0804 00:58:13.040508 1684495 cri.go:89] found id: "987c7c57f33cc3bca08f2823d03c3436be4204498232f94e80f1ca3ad97e0370"
I0804 00:58:13.040532 1684495 cri.go:89] found id: "be279b22b091c58ad9ed186bf62fa3b5f4471e254befe9b2885a9e11a69c1a89"
I0804 00:58:13.040538 1684495 cri.go:89] found id: ""
I0804 00:58:13.040546 1684495 logs.go:276] 2 containers: [987c7c57f33cc3bca08f2823d03c3436be4204498232f94e80f1ca3ad97e0370 be279b22b091c58ad9ed186bf62fa3b5f4471e254befe9b2885a9e11a69c1a89]
I0804 00:58:13.040605 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.044458 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.048169 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0804 00:58:13.048248 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0804 00:58:13.088245 1684495 cri.go:89] found id: "149ef55fe5819ea69bac9c7279bdc8bb8e78b033b45c5b50cc448617e1d08c73"
I0804 00:58:13.088268 1684495 cri.go:89] found id: "97f907d0b089f254c91cdc3774ba2ceadb64f9b568a9eade6636d6670779d9a7"
I0804 00:58:13.088281 1684495 cri.go:89] found id: ""
I0804 00:58:13.088290 1684495 logs.go:276] 2 containers: [149ef55fe5819ea69bac9c7279bdc8bb8e78b033b45c5b50cc448617e1d08c73 97f907d0b089f254c91cdc3774ba2ceadb64f9b568a9eade6636d6670779d9a7]
I0804 00:58:13.088346 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.091973 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.095451 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0804 00:58:13.095573 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0804 00:58:13.133640 1684495 cri.go:89] found id: "5f5c5ceaa344b4a2f51ee71176bc05b853ecc9224acfc037062f5c089bdd53cd"
I0804 00:58:13.133660 1684495 cri.go:89] found id: "8423f820a508f1701f321c15883cd64ff81d08c0cfa7609f294ce7f4ae7e829b"
I0804 00:58:13.133665 1684495 cri.go:89] found id: ""
I0804 00:58:13.133671 1684495 logs.go:276] 2 containers: [5f5c5ceaa344b4a2f51ee71176bc05b853ecc9224acfc037062f5c089bdd53cd 8423f820a508f1701f321c15883cd64ff81d08c0cfa7609f294ce7f4ae7e829b]
I0804 00:58:13.133782 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.143926 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.148397 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0804 00:58:13.148468 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0804 00:58:13.185907 1684495 cri.go:89] found id: "7960a12d68e3b491cf04420a9d57537f55924eba2b7eb5bda75c8a354ae5e032"
I0804 00:58:13.185928 1684495 cri.go:89] found id: "a66f6cfcc29b8bd49c8f13c54a60e9e147728c2d10100d2768cf68278e21f444"
I0804 00:58:13.185933 1684495 cri.go:89] found id: ""
I0804 00:58:13.185941 1684495 logs.go:276] 2 containers: [7960a12d68e3b491cf04420a9d57537f55924eba2b7eb5bda75c8a354ae5e032 a66f6cfcc29b8bd49c8f13c54a60e9e147728c2d10100d2768cf68278e21f444]
I0804 00:58:13.186000 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.189905 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.193350 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0804 00:58:13.193418 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0804 00:58:13.232230 1684495 cri.go:89] found id: "077c4d240dbe0a241741ad2fc0948dd86eba5a5ea94ab539993c350e9875633f"
I0804 00:58:13.232252 1684495 cri.go:89] found id: "989e28403b27a5a0236486c2c183e294a12c016c4c4c64c3ff9089948ddcfd21"
I0804 00:58:13.232257 1684495 cri.go:89] found id: ""
I0804 00:58:13.232264 1684495 logs.go:276] 2 containers: [077c4d240dbe0a241741ad2fc0948dd86eba5a5ea94ab539993c350e9875633f 989e28403b27a5a0236486c2c183e294a12c016c4c4c64c3ff9089948ddcfd21]
I0804 00:58:13.232318 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.235762 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.239507 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0804 00:58:13.239596 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0804 00:58:13.277511 1684495 cri.go:89] found id: "f75a0f3a0098d71dba19c2fda8834332ee198e6777d297afd3be08a02a5cedf9"
I0804 00:58:13.277532 1684495 cri.go:89] found id: "bfe98cd74da739eabd2a656d66b6599a764d7278da248862ec24b7eb65ddf53a"
I0804 00:58:13.277536 1684495 cri.go:89] found id: ""
I0804 00:58:13.277543 1684495 logs.go:276] 2 containers: [f75a0f3a0098d71dba19c2fda8834332ee198e6777d297afd3be08a02a5cedf9 bfe98cd74da739eabd2a656d66b6599a764d7278da248862ec24b7eb65ddf53a]
I0804 00:58:13.277596 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.281139 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.284399 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0804 00:58:13.284511 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0804 00:58:13.324970 1684495 cri.go:89] found id: "c09a50d1e2d0abf8d930c57d74d8d9d9c9257f0e39e5a083a3ea16e35ee03b0f"
I0804 00:58:13.324993 1684495 cri.go:89] found id: "23b8338269ddca80162212d9a76197f8de6631dc25fd1e89271138d7bf6507f7"
I0804 00:58:13.324999 1684495 cri.go:89] found id: ""
I0804 00:58:13.325007 1684495 logs.go:276] 2 containers: [c09a50d1e2d0abf8d930c57d74d8d9d9c9257f0e39e5a083a3ea16e35ee03b0f 23b8338269ddca80162212d9a76197f8de6631dc25fd1e89271138d7bf6507f7]
I0804 00:58:13.325063 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.328693 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.332225 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0804 00:58:13.332296 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0804 00:58:13.373972 1684495 cri.go:89] found id: "aafe2aa0c39a34282c92489dd6d4e856f3fbd5ff82e808079ab2f8e7c3366383"
I0804 00:58:13.373994 1684495 cri.go:89] found id: ""
I0804 00:58:13.374002 1684495 logs.go:276] 1 containers: [aafe2aa0c39a34282c92489dd6d4e856f3fbd5ff82e808079ab2f8e7c3366383]
I0804 00:58:13.374083 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.377871 1684495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0804 00:58:13.377954 1684495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0804 00:58:13.416287 1684495 cri.go:89] found id: "b6a2eb1e427442100a4c7c83a3d7b1ead5c7c050b06d9744549f7c844a98c947"
I0804 00:58:13.416310 1684495 cri.go:89] found id: "76ba2c77767271189966f7605db549a47762718ea69ef080d8be2aa9635320fa"
I0804 00:58:13.416314 1684495 cri.go:89] found id: ""
I0804 00:58:13.416321 1684495 logs.go:276] 2 containers: [b6a2eb1e427442100a4c7c83a3d7b1ead5c7c050b06d9744549f7c844a98c947 76ba2c77767271189966f7605db549a47762718ea69ef080d8be2aa9635320fa]
I0804 00:58:13.416378 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.420055 1684495 ssh_runner.go:195] Run: which crictl
I0804 00:58:13.424480 1684495 logs.go:123] Gathering logs for etcd [97f907d0b089f254c91cdc3774ba2ceadb64f9b568a9eade6636d6670779d9a7] ...
I0804 00:58:13.424507 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 97f907d0b089f254c91cdc3774ba2ceadb64f9b568a9eade6636d6670779d9a7"
I0804 00:58:13.476088 1684495 logs.go:123] Gathering logs for coredns [5f5c5ceaa344b4a2f51ee71176bc05b853ecc9224acfc037062f5c089bdd53cd] ...
I0804 00:58:13.476116 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f5c5ceaa344b4a2f51ee71176bc05b853ecc9224acfc037062f5c089bdd53cd"
I0804 00:58:13.517083 1684495 logs.go:123] Gathering logs for kube-proxy [989e28403b27a5a0236486c2c183e294a12c016c4c4c64c3ff9089948ddcfd21] ...
I0804 00:58:13.517113 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 989e28403b27a5a0236486c2c183e294a12c016c4c4c64c3ff9089948ddcfd21"
I0804 00:58:13.556599 1684495 logs.go:123] Gathering logs for kube-controller-manager [bfe98cd74da739eabd2a656d66b6599a764d7278da248862ec24b7eb65ddf53a] ...
I0804 00:58:13.556628 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bfe98cd74da739eabd2a656d66b6599a764d7278da248862ec24b7eb65ddf53a"
I0804 00:58:13.619113 1684495 logs.go:123] Gathering logs for kube-proxy [077c4d240dbe0a241741ad2fc0948dd86eba5a5ea94ab539993c350e9875633f] ...
I0804 00:58:13.619152 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 077c4d240dbe0a241741ad2fc0948dd86eba5a5ea94ab539993c350e9875633f"
I0804 00:58:13.667994 1684495 logs.go:123] Gathering logs for kube-controller-manager [f75a0f3a0098d71dba19c2fda8834332ee198e6777d297afd3be08a02a5cedf9] ...
I0804 00:58:13.668024 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f75a0f3a0098d71dba19c2fda8834332ee198e6777d297afd3be08a02a5cedf9"
I0804 00:58:13.729551 1684495 logs.go:123] Gathering logs for kindnet [23b8338269ddca80162212d9a76197f8de6631dc25fd1e89271138d7bf6507f7] ...
I0804 00:58:13.729585 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 23b8338269ddca80162212d9a76197f8de6631dc25fd1e89271138d7bf6507f7"
I0804 00:58:13.779356 1684495 logs.go:123] Gathering logs for kubernetes-dashboard [aafe2aa0c39a34282c92489dd6d4e856f3fbd5ff82e808079ab2f8e7c3366383] ...
I0804 00:58:13.779389 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 aafe2aa0c39a34282c92489dd6d4e856f3fbd5ff82e808079ab2f8e7c3366383"
I0804 00:58:13.834449 1684495 logs.go:123] Gathering logs for kubelet ...
I0804 00:58:13.834476 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0804 00:58:13.900986 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.282639 660 reflector.go:138] object-"kube-system"/"kindnet-token-shjqq": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-shjqq" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:13.901390 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.414364 660 reflector.go:138] object-"kube-system"/"metrics-server-token-6rjpz": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-6rjpz" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:13.901661 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.414439 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-mvlnm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-mvlnm" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:13.901913 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.414534 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:13.902181 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.414581 660 reflector.go:138] object-"kube-system"/"coredns-token-hqkxf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-hqkxf" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:13.902442 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.414628 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:13.902744 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.414673 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-99h2z": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-99h2z" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:13.903012 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:41 old-k8s-version-675414 kubelet[660]: E0804 00:52:41.414719 660 reflector.go:138] object-"default"/"default-token-zq2f5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-zq2f5" is forbidden: User "system:node:old-k8s-version-675414" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-675414' and this object
W0804 00:58:13.915803 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:45 old-k8s-version-675414 kubelet[660]: E0804 00:52:45.082202 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0804 00:58:13.916082 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:45 old-k8s-version-675414 kubelet[660]: E0804 00:52:45.241326 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.918908 1684495 logs.go:138] Found kubelet problem: Aug 04 00:52:56 old-k8s-version-675414 kubelet[660]: E0804 00:52:56.947308 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0804 00:58:13.923365 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:10 old-k8s-version-675414 kubelet[660]: E0804 00:53:10.413189 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.924003 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:11 old-k8s-version-675414 kubelet[660]: E0804 00:53:11.416861 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.924260 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:11 old-k8s-version-675414 kubelet[660]: E0804 00:53:11.936064 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.924695 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:14 old-k8s-version-675414 kubelet[660]: E0804 00:53:14.644181 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.925229 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:16 old-k8s-version-675414 kubelet[660]: E0804 00:53:16.429661 660 pod_workers.go:191] Error syncing pod 216c109c-26cb-4b0d-a9f2-68fb302fb56a ("storage-provisioner_kube-system(216c109c-26cb-4b0d-a9f2-68fb302fb56a)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(216c109c-26cb-4b0d-a9f2-68fb302fb56a)"
W0804 00:58:13.928215 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:23 old-k8s-version-675414 kubelet[660]: E0804 00:53:23.943884 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0804 00:58:13.928947 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:28 old-k8s-version-675414 kubelet[660]: E0804 00:53:28.466793 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.929481 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:34 old-k8s-version-675414 kubelet[660]: E0804 00:53:34.644204 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.929702 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:37 old-k8s-version-675414 kubelet[660]: E0804 00:53:37.936216 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.930082 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:46 old-k8s-version-675414 kubelet[660]: E0804 00:53:46.938197 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.930298 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:48 old-k8s-version-675414 kubelet[660]: E0804 00:53:48.951498 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.930638 1684495 logs.go:138] Found kubelet problem: Aug 04 00:53:59 old-k8s-version-675414 kubelet[660]: E0804 00:53:59.936614 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.931266 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:01 old-k8s-version-675414 kubelet[660]: E0804 00:54:01.570437 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.931657 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:04 old-k8s-version-675414 kubelet[660]: E0804 00:54:04.644942 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.934852 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:13 old-k8s-version-675414 kubelet[660]: E0804 00:54:13.943413 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0804 00:58:13.935287 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:16 old-k8s-version-675414 kubelet[660]: E0804 00:54:16.936076 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.935505 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:24 old-k8s-version-675414 kubelet[660]: E0804 00:54:24.937645 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.935888 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:27 old-k8s-version-675414 kubelet[660]: E0804 00:54:27.936088 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.936103 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:39 old-k8s-version-675414 kubelet[660]: E0804 00:54:39.950657 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.936748 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:43 old-k8s-version-675414 kubelet[660]: E0804 00:54:43.676832 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.937111 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:44 old-k8s-version-675414 kubelet[660]: E0804 00:54:44.680432 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.937323 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:53 old-k8s-version-675414 kubelet[660]: E0804 00:54:53.936211 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.937714 1684495 logs.go:138] Found kubelet problem: Aug 04 00:54:57 old-k8s-version-675414 kubelet[660]: E0804 00:54:57.935700 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.937933 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:07 old-k8s-version-675414 kubelet[660]: E0804 00:55:07.935950 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.938367 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:11 old-k8s-version-675414 kubelet[660]: E0804 00:55:11.935702 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.938616 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:20 old-k8s-version-675414 kubelet[660]: E0804 00:55:20.936143 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.939041 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:24 old-k8s-version-675414 kubelet[660]: E0804 00:55:24.936368 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.941920 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:34 old-k8s-version-675414 kubelet[660]: E0804 00:55:34.943118 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0804 00:58:13.942290 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:38 old-k8s-version-675414 kubelet[660]: E0804 00:55:38.935868 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.942637 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:47 old-k8s-version-675414 kubelet[660]: E0804 00:55:47.936158 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.943053 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:50 old-k8s-version-675414 kubelet[660]: E0804 00:55:50.936495 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.943303 1684495 logs.go:138] Found kubelet problem: Aug 04 00:55:58 old-k8s-version-675414 kubelet[660]: E0804 00:55:58.936644 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.943933 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:06 old-k8s-version-675414 kubelet[660]: E0804 00:56:06.867337 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.944161 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:10 old-k8s-version-675414 kubelet[660]: E0804 00:56:10.939645 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.944518 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:14 old-k8s-version-675414 kubelet[660]: E0804 00:56:14.644651 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.944741 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:25 old-k8s-version-675414 kubelet[660]: E0804 00:56:25.935973 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.945092 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:29 old-k8s-version-675414 kubelet[660]: E0804 00:56:29.935605 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.945302 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:37 old-k8s-version-675414 kubelet[660]: E0804 00:56:37.935980 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.945654 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:43 old-k8s-version-675414 kubelet[660]: E0804 00:56:43.936154 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.945890 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:49 old-k8s-version-675414 kubelet[660]: E0804 00:56:49.936459 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.946249 1684495 logs.go:138] Found kubelet problem: Aug 04 00:56:55 old-k8s-version-675414 kubelet[660]: E0804 00:56:55.935648 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.946460 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:02 old-k8s-version-675414 kubelet[660]: E0804 00:57:02.936961 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.946812 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:07 old-k8s-version-675414 kubelet[660]: E0804 00:57:07.935632 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.947050 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:17 old-k8s-version-675414 kubelet[660]: E0804 00:57:17.936096 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.947402 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:18 old-k8s-version-675414 kubelet[660]: E0804 00:57:18.936013 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.947612 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:30 old-k8s-version-675414 kubelet[660]: E0804 00:57:30.936039 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.947960 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:33 old-k8s-version-675414 kubelet[660]: E0804 00:57:33.935699 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.948168 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:43 old-k8s-version-675414 kubelet[660]: E0804 00:57:43.936175 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.948522 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:48 old-k8s-version-675414 kubelet[660]: E0804 00:57:48.936525 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.948770 1684495 logs.go:138] Found kubelet problem: Aug 04 00:57:58 old-k8s-version-675414 kubelet[660]: E0804 00:57:58.937236 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:13.949126 1684495 logs.go:138] Found kubelet problem: Aug 04 00:58:03 old-k8s-version-675414 kubelet[660]: E0804 00:58:03.936079 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:13.949357 1684495 logs.go:138] Found kubelet problem: Aug 04 00:58:10 old-k8s-version-675414 kubelet[660]: E0804 00:58:10.936100 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0804 00:58:13.949400 1684495 logs.go:123] Gathering logs for dmesg ...
I0804 00:58:13.949428 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0804 00:58:13.977199 1684495 logs.go:123] Gathering logs for describe nodes ...
I0804 00:58:13.977280 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0804 00:58:14.173393 1684495 logs.go:123] Gathering logs for kube-apiserver [987c7c57f33cc3bca08f2823d03c3436be4204498232f94e80f1ca3ad97e0370] ...
I0804 00:58:14.173434 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 987c7c57f33cc3bca08f2823d03c3436be4204498232f94e80f1ca3ad97e0370"
I0804 00:58:14.247500 1684495 logs.go:123] Gathering logs for storage-provisioner [76ba2c77767271189966f7605db549a47762718ea69ef080d8be2aa9635320fa] ...
I0804 00:58:14.247538 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 76ba2c77767271189966f7605db549a47762718ea69ef080d8be2aa9635320fa"
I0804 00:58:14.285884 1684495 logs.go:123] Gathering logs for container status ...
I0804 00:58:14.285912 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0804 00:58:14.335255 1684495 logs.go:123] Gathering logs for kube-scheduler [a66f6cfcc29b8bd49c8f13c54a60e9e147728c2d10100d2768cf68278e21f444] ...
I0804 00:58:14.335287 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a66f6cfcc29b8bd49c8f13c54a60e9e147728c2d10100d2768cf68278e21f444"
I0804 00:58:14.386027 1684495 logs.go:123] Gathering logs for storage-provisioner [b6a2eb1e427442100a4c7c83a3d7b1ead5c7c050b06d9744549f7c844a98c947] ...
I0804 00:58:14.386057 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b6a2eb1e427442100a4c7c83a3d7b1ead5c7c050b06d9744549f7c844a98c947"
I0804 00:58:14.426159 1684495 logs.go:123] Gathering logs for kube-apiserver [be279b22b091c58ad9ed186bf62fa3b5f4471e254befe9b2885a9e11a69c1a89] ...
I0804 00:58:14.426187 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be279b22b091c58ad9ed186bf62fa3b5f4471e254befe9b2885a9e11a69c1a89"
I0804 00:58:14.503960 1684495 logs.go:123] Gathering logs for etcd [149ef55fe5819ea69bac9c7279bdc8bb8e78b033b45c5b50cc448617e1d08c73] ...
I0804 00:58:14.503999 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 149ef55fe5819ea69bac9c7279bdc8bb8e78b033b45c5b50cc448617e1d08c73"
I0804 00:58:14.550752 1684495 logs.go:123] Gathering logs for coredns [8423f820a508f1701f321c15883cd64ff81d08c0cfa7609f294ce7f4ae7e829b] ...
I0804 00:58:14.550784 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8423f820a508f1701f321c15883cd64ff81d08c0cfa7609f294ce7f4ae7e829b"
I0804 00:58:14.591408 1684495 logs.go:123] Gathering logs for kube-scheduler [7960a12d68e3b491cf04420a9d57537f55924eba2b7eb5bda75c8a354ae5e032] ...
I0804 00:58:14.591438 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7960a12d68e3b491cf04420a9d57537f55924eba2b7eb5bda75c8a354ae5e032"
I0804 00:58:14.631885 1684495 logs.go:123] Gathering logs for kindnet [c09a50d1e2d0abf8d930c57d74d8d9d9c9257f0e39e5a083a3ea16e35ee03b0f] ...
I0804 00:58:14.631915 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c09a50d1e2d0abf8d930c57d74d8d9d9c9257f0e39e5a083a3ea16e35ee03b0f"
I0804 00:58:14.686885 1684495 logs.go:123] Gathering logs for containerd ...
I0804 00:58:14.686919 1684495 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0804 00:58:14.757654 1684495 out.go:304] Setting ErrFile to fd 2...
I0804 00:58:14.757687 1684495 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0804 00:58:14.757742 1684495 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0804 00:58:14.757762 1684495 out.go:239] Aug 04 00:57:43 old-k8s-version-675414 kubelet[660]: E0804 00:57:43.936175 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:57:43 old-k8s-version-675414 kubelet[660]: E0804 00:57:43.936175 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:14.757791 1684495 out.go:239] Aug 04 00:57:48 old-k8s-version-675414 kubelet[660]: E0804 00:57:48.936525 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
Aug 04 00:57:48 old-k8s-version-675414 kubelet[660]: E0804 00:57:48.936525 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:14.757800 1684495 out.go:239] Aug 04 00:57:58 old-k8s-version-675414 kubelet[660]: E0804 00:57:58.937236 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:57:58 old-k8s-version-675414 kubelet[660]: E0804 00:57:58.937236 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0804 00:58:14.757808 1684495 out.go:239] Aug 04 00:58:03 old-k8s-version-675414 kubelet[660]: E0804 00:58:03.936079 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
Aug 04 00:58:03 old-k8s-version-675414 kubelet[660]: E0804 00:58:03.936079 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
W0804 00:58:14.757815 1684495 out.go:239] Aug 04 00:58:10 old-k8s-version-675414 kubelet[660]: E0804 00:58:10.936100 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:58:10 old-k8s-version-675414 kubelet[660]: E0804 00:58:10.936100 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0804 00:58:14.757821 1684495 out.go:304] Setting ErrFile to fd 2...
I0804 00:58:14.757829 1684495 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0804 00:58:24.758613 1684495 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0804 00:58:24.771506 1684495 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0804 00:58:24.774310 1684495 out.go:177]
W0804 00:58:24.776293 1684495 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0804 00:58:24.776332 1684495 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0804 00:58:24.776382 1684495 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0804 00:58:24.776394 1684495 out.go:239] *
*
W0804 00:58:24.777590 1684495 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0804 00:58:24.784490 1684495 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-675414 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-675414
helpers_test.go:235: (dbg) docker inspect old-k8s-version-675414:
-- stdout --
[
{
"Id": "d3febcbddeffdf569e46467b2871aa8474c03d2c96c1e2eb71b931028045cad7",
"Created": "2024-08-04T00:49:28.303831755Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1684718,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-08-04T00:52:12.961628405Z",
"FinishedAt": "2024-08-04T00:52:11.213981657Z"
},
"Image": "sha256:2cd84ab2172023a68162f38a55db46353562cea41552fd8e8bdec97b31b2c495",
"ResolvConfPath": "/var/lib/docker/containers/d3febcbddeffdf569e46467b2871aa8474c03d2c96c1e2eb71b931028045cad7/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/d3febcbddeffdf569e46467b2871aa8474c03d2c96c1e2eb71b931028045cad7/hostname",
"HostsPath": "/var/lib/docker/containers/d3febcbddeffdf569e46467b2871aa8474c03d2c96c1e2eb71b931028045cad7/hosts",
"LogPath": "/var/lib/docker/containers/d3febcbddeffdf569e46467b2871aa8474c03d2c96c1e2eb71b931028045cad7/d3febcbddeffdf569e46467b2871aa8474c03d2c96c1e2eb71b931028045cad7-json.log",
"Name": "/old-k8s-version-675414",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-675414:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-675414",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/92bffb0c666304d7261ac5863d308aa257720a176ba1cb96a14d35ca3bbca504-init/diff:/var/lib/docker/overlay2/c9f735e285fdb29b4d530e35c1d87d9bab54d0d29e5c01e9c9a15822f9ce0f87/diff",
"MergedDir": "/var/lib/docker/overlay2/92bffb0c666304d7261ac5863d308aa257720a176ba1cb96a14d35ca3bbca504/merged",
"UpperDir": "/var/lib/docker/overlay2/92bffb0c666304d7261ac5863d308aa257720a176ba1cb96a14d35ca3bbca504/diff",
"WorkDir": "/var/lib/docker/overlay2/92bffb0c666304d7261ac5863d308aa257720a176ba1cb96a14d35ca3bbca504/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-675414",
"Source": "/var/lib/docker/volumes/old-k8s-version-675414/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-675414",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-675414",
"name.minikube.sigs.k8s.io": "old-k8s-version-675414",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "8775df9c819fd6d59d37e761ef68b7d58d113c402f1322d196dad69bd8788aff",
"SandboxKey": "/var/run/docker/netns/8775df9c819f",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34920"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34921"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34924"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34922"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34923"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-675414": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null,
"NetworkID": "9b594ab088c6297e397f41528f342ef6dd74a60a1aa3887bee5111d038835591",
"EndpointID": "1604065c35cb292b8b307db1c6c547b5d7b7586c253589c14618d5ad80ed7d9c",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-675414",
"d3febcbddeff"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-675414 -n old-k8s-version-675414
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-675414 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-675414 logs -n 25: (2.328426624s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| start | -p cert-expiration-353972 | cert-expiration-353972 | jenkins | v1.33.1 | 04 Aug 24 00:48 UTC | 04 Aug 24 00:48 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-123856 | force-systemd-env-123856 | jenkins | v1.33.1 | 04 Aug 24 00:48 UTC | 04 Aug 24 00:48 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-123856 | force-systemd-env-123856 | jenkins | v1.33.1 | 04 Aug 24 00:48 UTC | 04 Aug 24 00:48 UTC |
| start | -p cert-options-205301 | cert-options-205301 | jenkins | v1.33.1 | 04 Aug 24 00:48 UTC | 04 Aug 24 00:49 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-205301 ssh | cert-options-205301 | jenkins | v1.33.1 | 04 Aug 24 00:49 UTC | 04 Aug 24 00:49 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-205301 -- sudo | cert-options-205301 | jenkins | v1.33.1 | 04 Aug 24 00:49 UTC | 04 Aug 24 00:49 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-205301 | cert-options-205301 | jenkins | v1.33.1 | 04 Aug 24 00:49 UTC | 04 Aug 24 00:49 UTC |
| start | -p old-k8s-version-675414 | old-k8s-version-675414 | jenkins | v1.33.1 | 04 Aug 24 00:49 UTC | 04 Aug 24 00:51 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-353972 | cert-expiration-353972 | jenkins | v1.33.1 | 04 Aug 24 00:51 UTC | 04 Aug 24 00:52 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| addons | enable metrics-server -p old-k8s-version-675414 | old-k8s-version-675414 | jenkins | v1.33.1 | 04 Aug 24 00:51 UTC | 04 Aug 24 00:51 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-675414 | old-k8s-version-675414 | jenkins | v1.33.1 | 04 Aug 24 00:51 UTC | 04 Aug 24 00:52 UTC |
| | --alsologtostderr -v=3 | | | | | |
| delete | -p cert-expiration-353972 | cert-expiration-353972 | jenkins | v1.33.1 | 04 Aug 24 00:52 UTC | 04 Aug 24 00:52 UTC |
| start | -p no-preload-944170 | no-preload-944170 | jenkins | v1.33.1 | 04 Aug 24 00:52 UTC | 04 Aug 24 00:53 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0-rc.0 | | | | | |
| addons | enable dashboard -p old-k8s-version-675414 | old-k8s-version-675414 | jenkins | v1.33.1 | 04 Aug 24 00:52 UTC | 04 Aug 24 00:52 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-675414 | old-k8s-version-675414 | jenkins | v1.33.1 | 04 Aug 24 00:52 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-944170 | no-preload-944170 | jenkins | v1.33.1 | 04 Aug 24 00:53 UTC | 04 Aug 24 00:53 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-944170 | no-preload-944170 | jenkins | v1.33.1 | 04 Aug 24 00:53 UTC | 04 Aug 24 00:53 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-944170 | no-preload-944170 | jenkins | v1.33.1 | 04 Aug 24 00:53 UTC | 04 Aug 24 00:53 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-944170 | no-preload-944170 | jenkins | v1.33.1 | 04 Aug 24 00:53 UTC | 04 Aug 24 00:58 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0-rc.0 | | | | | |
| image | no-preload-944170 image list | no-preload-944170 | jenkins | v1.33.1 | 04 Aug 24 00:58 UTC | 04 Aug 24 00:58 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-944170 | no-preload-944170 | jenkins | v1.33.1 | 04 Aug 24 00:58 UTC | 04 Aug 24 00:58 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-944170 | no-preload-944170 | jenkins | v1.33.1 | 04 Aug 24 00:58 UTC | 04 Aug 24 00:58 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-944170 | no-preload-944170 | jenkins | v1.33.1 | 04 Aug 24 00:58 UTC | 04 Aug 24 00:58 UTC |
| delete | -p no-preload-944170 | no-preload-944170 | jenkins | v1.33.1 | 04 Aug 24 00:58 UTC | 04 Aug 24 00:58 UTC |
| start | -p embed-certs-449369 | embed-certs-449369 | jenkins | v1.33.1 | 04 Aug 24 00:58 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.3 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/08/04 00:58:23
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0804 00:58:23.606309 1696229 out.go:291] Setting OutFile to fd 1 ...
I0804 00:58:23.606446 1696229 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0804 00:58:23.606457 1696229 out.go:304] Setting ErrFile to fd 2...
I0804 00:58:23.606463 1696229 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0804 00:58:23.606722 1696229 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19370-1473734/.minikube/bin
I0804 00:58:23.607119 1696229 out.go:298] Setting JSON to false
I0804 00:58:23.608082 1696229 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":34849,"bootTime":1722698255,"procs":218,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0804 00:58:23.608154 1696229 start.go:139] virtualization:
I0804 00:58:23.613514 1696229 out.go:177] * [embed-certs-449369] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0804 00:58:23.615298 1696229 out.go:177] - MINIKUBE_LOCATION=19370
I0804 00:58:23.615436 1696229 notify.go:220] Checking for updates...
I0804 00:58:23.618532 1696229 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0804 00:58:23.620336 1696229 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19370-1473734/kubeconfig
I0804 00:58:23.622065 1696229 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19370-1473734/.minikube
I0804 00:58:23.624043 1696229 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0804 00:58:23.625635 1696229 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0804 00:58:23.627779 1696229 config.go:182] Loaded profile config "old-k8s-version-675414": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0804 00:58:23.627870 1696229 driver.go:392] Setting default libvirt URI to qemu:///system
I0804 00:58:23.657811 1696229 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0804 00:58:23.657927 1696229 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0804 00:58:23.717213 1696229 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-04 00:58:23.707816718 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0804 00:58:23.717325 1696229 docker.go:307] overlay module found
I0804 00:58:23.720546 1696229 out.go:177] * Using the docker driver based on user configuration
I0804 00:58:23.722380 1696229 start.go:297] selected driver: docker
I0804 00:58:23.722400 1696229 start.go:901] validating driver "docker" against <nil>
I0804 00:58:23.722414 1696229 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0804 00:58:23.723033 1696229 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0804 00:58:23.777618 1696229 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-04 00:58:23.768603345 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0804 00:58:23.777785 1696229 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0804 00:58:23.778034 1696229 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0804 00:58:23.779729 1696229 out.go:177] * Using Docker driver with root privileges
I0804 00:58:23.781640 1696229 cni.go:84] Creating CNI manager for ""
I0804 00:58:23.781661 1696229 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0804 00:58:23.781672 1696229 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0804 00:58:23.781753 1696229 start.go:340] cluster config:
{Name:embed-certs-449369 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-449369 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0804 00:58:23.783721 1696229 out.go:177] * Starting "embed-certs-449369" primary control-plane node in "embed-certs-449369" cluster
I0804 00:58:23.785128 1696229 cache.go:121] Beginning downloading kic base image for docker with containerd
I0804 00:58:23.786744 1696229 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0804 00:58:23.788832 1696229 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
I0804 00:58:23.788897 1696229 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19370-1473734/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4
I0804 00:58:23.788910 1696229 cache.go:56] Caching tarball of preloaded images
I0804 00:58:23.788993 1696229 preload.go:172] Found /home/jenkins/minikube-integration/19370-1473734/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0804 00:58:23.789006 1696229 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on containerd
I0804 00:58:23.789137 1696229 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-1473734/.minikube/profiles/embed-certs-449369/config.json ...
I0804 00:58:23.789163 1696229 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-1473734/.minikube/profiles/embed-certs-449369/config.json: {Name:mkcb04df7786b393b5a478fd63653cdb1107ea02 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0804 00:58:23.789259 1696229 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
W0804 00:58:23.808451 1696229 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
I0804 00:58:23.808471 1696229 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0804 00:58:23.808562 1696229 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0804 00:58:23.808584 1696229 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0804 00:58:23.808589 1696229 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0804 00:58:23.808597 1696229 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0804 00:58:23.808606 1696229 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0804 00:58:23.951995 1696229 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0804 00:58:23.952048 1696229 cache.go:194] Successfully downloaded all kic artifacts
I0804 00:58:23.952086 1696229 start.go:360] acquireMachinesLock for embed-certs-449369: {Name:mke67916fa9ee249b01b2bdb2038f34582fd8e91 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0804 00:58:23.952654 1696229 start.go:364] duration metric: took 538.405µs to acquireMachinesLock for "embed-certs-449369"
I0804 00:58:23.952698 1696229 start.go:93] Provisioning new machine with config: &{Name:embed-certs-449369 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-449369 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0804 00:58:23.952814 1696229 start.go:125] createHost starting for "" (driver="docker")
I0804 00:58:24.758613 1684495 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0804 00:58:24.771506 1684495 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0804 00:58:24.774310 1684495 out.go:177]
W0804 00:58:24.776293 1684495 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0804 00:58:24.776332 1684495 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0804 00:58:24.776382 1684495 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0804 00:58:24.776394 1684495 out.go:239] *
W0804 00:58:24.777590 1684495 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0804 00:58:24.784490 1684495 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
a5c053b94591d 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 f9c6b1a8af117 dashboard-metrics-scraper-8d5bb5db8-7fkw8
b6a2eb1e42744 ba04bb24b9575 4 minutes ago Running storage-provisioner 2 baec307c8c0fe storage-provisioner
aafe2aa0c39a3 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 c46317b6bb7cd kubernetes-dashboard-cd95d586-clv5v
2eafa0a12399c 1611cd07b61d5 5 minutes ago Running busybox 1 cdb3662e71007 busybox
76ba2c7776727 ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 baec307c8c0fe storage-provisioner
5f5c5ceaa344b db91994f4ee8f 5 minutes ago Running coredns 1 ffa6bc3b4cce4 coredns-74ff55c5b-hqfq7
077c4d240dbe0 25a5233254979 5 minutes ago Running kube-proxy 1 a8942c975ba29 kube-proxy-vffqm
c09a50d1e2d0a f42786f8afd22 5 minutes ago Running kindnet-cni 1 cc9f0a6835f37 kindnet-tqt47
f75a0f3a0098d 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 3062ae13d1d25 kube-controller-manager-old-k8s-version-675414
987c7c57f33cc 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 e358da5226f76 kube-apiserver-old-k8s-version-675414
7960a12d68e3b e7605f88f17d6 5 minutes ago Running kube-scheduler 1 259cd2f8cfd50 kube-scheduler-old-k8s-version-675414
149ef55fe5819 05b738aa1bc63 5 minutes ago Running etcd 1 94595bee1431f etcd-old-k8s-version-675414
02bda80cc32c5 1611cd07b61d5 6 minutes ago Exited busybox 0 840c05accecf3 busybox
8423f820a508f db91994f4ee8f 7 minutes ago Exited coredns 0 44403d5950177 coredns-74ff55c5b-hqfq7
23b8338269ddc f42786f8afd22 7 minutes ago Exited kindnet-cni 0 5e085fd14671f kindnet-tqt47
989e28403b27a 25a5233254979 8 minutes ago Exited kube-proxy 0 a51390603193e kube-proxy-vffqm
97f907d0b089f 05b738aa1bc63 8 minutes ago Exited etcd 0 0e7ad9393baa7 etcd-old-k8s-version-675414
bfe98cd74da73 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 0e878ca5bbc02 kube-controller-manager-old-k8s-version-675414
be279b22b091c 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 ab1b6a45d778d kube-apiserver-old-k8s-version-675414
a66f6cfcc29b8 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 2fbed3b745fa5 kube-scheduler-old-k8s-version-675414
==> containerd <==
Aug 04 00:54:42 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:54:42.966222680Z" level=info msg="CreateContainer within sandbox \"f9c6b1a8af117aa4004ac3d6f2a05cbfa3612720821f8c3af5f57a66527ce8ae\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"f23786aa623e26ca59f6b23fe120d02cc39dbf28a37999c51f4d98b2dbae3e99\""
Aug 04 00:54:42 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:54:42.968086154Z" level=info msg="StartContainer for \"f23786aa623e26ca59f6b23fe120d02cc39dbf28a37999c51f4d98b2dbae3e99\""
Aug 04 00:54:43 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:54:43.058865548Z" level=info msg="StartContainer for \"f23786aa623e26ca59f6b23fe120d02cc39dbf28a37999c51f4d98b2dbae3e99\" returns successfully"
Aug 04 00:54:43 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:54:43.084398472Z" level=info msg="shim disconnected" id=f23786aa623e26ca59f6b23fe120d02cc39dbf28a37999c51f4d98b2dbae3e99 namespace=k8s.io
Aug 04 00:54:43 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:54:43.084464293Z" level=warning msg="cleaning up after shim disconnected" id=f23786aa623e26ca59f6b23fe120d02cc39dbf28a37999c51f4d98b2dbae3e99 namespace=k8s.io
Aug 04 00:54:43 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:54:43.084475559Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 04 00:54:43 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:54:43.677939997Z" level=info msg="RemoveContainer for \"7bb2044ed009b0ba2d6ce3c781d6488be80dfe48ac01a4a6cfbae228b8e06b6d\""
Aug 04 00:54:43 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:54:43.686253907Z" level=info msg="RemoveContainer for \"7bb2044ed009b0ba2d6ce3c781d6488be80dfe48ac01a4a6cfbae228b8e06b6d\" returns successfully"
Aug 04 00:55:34 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:55:34.936411671Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:55:34 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:55:34.940880506Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Aug 04 00:55:34 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:55:34.942637248Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Aug 04 00:55:34 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:55:34.942715262Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Aug 04 00:56:05 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:56:05.937975758Z" level=info msg="CreateContainer within sandbox \"f9c6b1a8af117aa4004ac3d6f2a05cbfa3612720821f8c3af5f57a66527ce8ae\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Aug 04 00:56:05 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:56:05.953082610Z" level=info msg="CreateContainer within sandbox \"f9c6b1a8af117aa4004ac3d6f2a05cbfa3612720821f8c3af5f57a66527ce8ae\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"a5c053b94591d70052938fb5a022709078b7e2e40c419de0adb5035ddf702261\""
Aug 04 00:56:05 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:56:05.953850615Z" level=info msg="StartContainer for \"a5c053b94591d70052938fb5a022709078b7e2e40c419de0adb5035ddf702261\""
Aug 04 00:56:06 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:56:06.027383157Z" level=info msg="StartContainer for \"a5c053b94591d70052938fb5a022709078b7e2e40c419de0adb5035ddf702261\" returns successfully"
Aug 04 00:56:06 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:56:06.055981232Z" level=info msg="shim disconnected" id=a5c053b94591d70052938fb5a022709078b7e2e40c419de0adb5035ddf702261 namespace=k8s.io
Aug 04 00:56:06 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:56:06.056047948Z" level=warning msg="cleaning up after shim disconnected" id=a5c053b94591d70052938fb5a022709078b7e2e40c419de0adb5035ddf702261 namespace=k8s.io
Aug 04 00:56:06 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:56:06.056058442Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 04 00:56:06 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:56:06.867215338Z" level=info msg="RemoveContainer for \"f23786aa623e26ca59f6b23fe120d02cc39dbf28a37999c51f4d98b2dbae3e99\""
Aug 04 00:56:06 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:56:06.872381942Z" level=info msg="RemoveContainer for \"f23786aa623e26ca59f6b23fe120d02cc39dbf28a37999c51f4d98b2dbae3e99\" returns successfully"
Aug 04 00:58:23 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:58:23.936574847Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:58:23 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:58:23.944140037Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Aug 04 00:58:23 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:58:23.945896677Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Aug 04 00:58:23 old-k8s-version-675414 containerd[570]: time="2024-08-04T00:58:23.946001145Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
==> coredns [5f5c5ceaa344b4a2f51ee71176bc05b853ecc9224acfc037062f5c089bdd53cd] <==
[INFO] plugin/ready: Still waiting on: "kubernetes"
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:36216 - 28525 "HINFO IN 2817053651712786571.426891898374259767. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.021142004s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0804 00:53:15.216221 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-04 00:52:45.21530758 +0000 UTC m=+0.083723073) (total time: 30.000800469s):
Trace[2019727887]: [30.000800469s] [30.000800469s] END
E0804 00:53:15.216259 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0804 00:53:15.216618 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-04 00:52:45.216304531 +0000 UTC m=+0.084720024) (total time: 30.000298621s):
Trace[939984059]: [30.000298621s] [30.000298621s] END
E0804 00:53:15.216634 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0804 00:53:15.219840 1 trace.go:116] Trace[1474941318]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-04 00:52:45.216698194 +0000 UTC m=+0.085113671) (total time: 30.003121253s):
Trace[1474941318]: [30.003121253s] [30.003121253s] END
E0804 00:53:15.219857 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> coredns [8423f820a508f1701f321c15883cd64ff81d08c0cfa7609f294ce7f4ae7e829b] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:40200 - 34791 "HINFO IN 6931332840204111526.887828231612056302. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.022463209s
==> describe nodes <==
Name: old-k8s-version-675414
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-675414
kubernetes.io/os=linux
minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf
minikube.k8s.io/name=old-k8s-version-675414
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_08_04T00_50_09_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sun, 04 Aug 2024 00:50:05 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-675414
AcquireTime: <unset>
RenewTime: Sun, 04 Aug 2024 00:58:24 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sun, 04 Aug 2024 00:53:33 +0000 Sun, 04 Aug 2024 00:49:58 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sun, 04 Aug 2024 00:53:33 +0000 Sun, 04 Aug 2024 00:49:58 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sun, 04 Aug 2024 00:53:33 +0000 Sun, 04 Aug 2024 00:49:58 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sun, 04 Aug 2024 00:53:33 +0000 Sun, 04 Aug 2024 00:50:25 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-675414
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
System Info:
Machine ID: 5fc3b4570e3d45c183b5c28d4e84a295
System UUID: 12c0c445-90a9-4143-8de9-d36a6d2b4818
Boot ID: 7d37f827-388f-4261-892f-42defe929bba
Kernel Version: 5.15.0-1066-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.19
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m37s
kube-system coredns-74ff55c5b-hqfq7 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m1s
kube-system etcd-old-k8s-version-675414 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m9s
kube-system kindnet-tqt47 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m1s
kube-system kube-apiserver-old-k8s-version-675414 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m9s
kube-system kube-controller-manager-old-k8s-version-675414 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m9s
kube-system kube-proxy-vffqm 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m1s
kube-system kube-scheduler-old-k8s-version-675414 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m9s
kube-system metrics-server-9975d5f86-7sd8p 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m27s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-7fkw8 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m27s
kubernetes-dashboard kubernetes-dashboard-cd95d586-clv5v 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m27s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m30s (x5 over 8m30s) kubelet Node old-k8s-version-675414 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m30s (x4 over 8m30s) kubelet Node old-k8s-version-675414 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m30s (x5 over 8m30s) kubelet Node old-k8s-version-675414 status is now: NodeHasSufficientPID
Normal Starting 8m9s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m9s kubelet Node old-k8s-version-675414 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m9s kubelet Node old-k8s-version-675414 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m9s kubelet Node old-k8s-version-675414 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m9s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m1s kubelet Node old-k8s-version-675414 status is now: NodeReady
Normal Starting 8m kube-proxy Starting kube-proxy.
Normal Starting 5m58s kubelet Starting kubelet.
Normal NodeAllocatableEnforced 5m58s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 5m57s (x8 over 5m58s) kubelet Node old-k8s-version-675414 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m57s (x8 over 5m58s) kubelet Node old-k8s-version-675414 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m57s (x7 over 5m58s) kubelet Node old-k8s-version-675414 status is now: NodeHasSufficientPID
Normal Starting 5m41s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000956] FS-Cache: O-key=[8] 'c8425c0100000000'
[ +0.000651] FS-Cache: N-cookie c=00000066 [p=0000005d fl=2 nc=0 na=1]
[ +0.000878] FS-Cache: N-cookie d=0000000061b9e6aa{9p.inode} n=00000000e31b34e7
[ +0.000953] FS-Cache: N-key=[8] 'c8425c0100000000'
[ +0.003160] FS-Cache: Duplicate cookie detected
[ +0.000701] FS-Cache: O-cookie c=00000060 [p=0000005d fl=226 nc=0 na=1]
[ +0.000874] FS-Cache: O-cookie d=0000000061b9e6aa{9p.inode} n=000000003c30ab31
[ +0.000955] FS-Cache: O-key=[8] 'c8425c0100000000'
[ +0.000637] FS-Cache: N-cookie c=00000067 [p=0000005d fl=2 nc=0 na=1]
[ +0.000890] FS-Cache: N-cookie d=0000000061b9e6aa{9p.inode} n=00000000eb1f9e00
[ +0.000959] FS-Cache: N-key=[8] 'c8425c0100000000'
[ +2.663855] FS-Cache: Duplicate cookie detected
[ +0.000636] FS-Cache: O-cookie c=0000005e [p=0000005d fl=226 nc=0 na=1]
[ +0.000895] FS-Cache: O-cookie d=0000000061b9e6aa{9p.inode} n=00000000b75ac123
[ +0.000950] FS-Cache: O-key=[8] 'c7425c0100000000'
[ +0.000689] FS-Cache: N-cookie c=00000069 [p=0000005d fl=2 nc=0 na=1]
[ +0.000848] FS-Cache: N-cookie d=0000000061b9e6aa{9p.inode} n=00000000e31b34e7
[ +0.000948] FS-Cache: N-key=[8] 'c7425c0100000000'
[ +0.314814] FS-Cache: Duplicate cookie detected
[ +0.000627] FS-Cache: O-cookie c=00000063 [p=0000005d fl=226 nc=0 na=1]
[ +0.000864] FS-Cache: O-cookie d=0000000061b9e6aa{9p.inode} n=0000000035df286d
[ +0.000951] FS-Cache: O-key=[8] 'cd425c0100000000'
[ +0.000642] FS-Cache: N-cookie c=0000006a [p=0000005d fl=2 nc=0 na=1]
[ +0.000905] FS-Cache: N-cookie d=0000000061b9e6aa{9p.inode} n=00000000be92c5eb
[ +0.000953] FS-Cache: N-key=[8] 'cd425c0100000000'
==> etcd [149ef55fe5819ea69bac9c7279bdc8bb8e78b033b45c5b50cc448617e1d08c73] <==
2024-08-04 00:54:26.689784 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:54:36.689944 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:54:46.689767 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:54:56.690280 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:55:06.689925 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:55:16.690103 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:55:26.689716 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:55:36.689852 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:55:46.691263 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:55:56.689873 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:56:06.689909 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:56:16.689722 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:56:26.689843 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:56:36.689984 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:56:46.689866 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:56:56.689994 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:57:06.689812 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:57:16.690101 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:57:26.689948 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:57:36.689912 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:57:46.689915 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:57:56.689944 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:58:06.689982 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:58:16.690119 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:58:26.690866 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [97f907d0b089f254c91cdc3774ba2ceadb64f9b568a9eade6636d6670779d9a7] <==
raft2024/08/04 00:49:58 INFO: ea7e25599daad906 is starting a new election at term 1
raft2024/08/04 00:49:58 INFO: ea7e25599daad906 became candidate at term 2
raft2024/08/04 00:49:58 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/08/04 00:49:58 INFO: ea7e25599daad906 became leader at term 2
raft2024/08/04 00:49:58 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-08-04 00:49:58.569890 I | etcdserver: published {Name:old-k8s-version-675414 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-08-04 00:49:58.570425 I | embed: ready to serve client requests
2024-08-04 00:49:58.571529 I | etcdserver: setting up the initial cluster version to 3.4
2024-08-04 00:49:58.573442 I | embed: serving client requests on 192.168.76.2:2379
2024-08-04 00:49:58.579845 N | etcdserver/membership: set the initial cluster version to 3.4
2024-08-04 00:49:58.579966 I | etcdserver/api: enabled capabilities for version 3.4
2024-08-04 00:49:58.580004 I | embed: ready to serve client requests
2024-08-04 00:49:58.589908 I | embed: serving client requests on 127.0.0.1:2379
2024-08-04 00:50:07.474742 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:50:19.345117 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:50:21.695068 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:50:31.695256 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:50:41.695253 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:50:51.695104 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:51:01.695184 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:51:11.695273 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:51:21.695169 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:51:31.695139 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:51:41.695213 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-04 00:51:51.695120 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
00:58:26 up 9:40, 0 users, load average: 0.95, 1.98, 2.56
Linux old-k8s-version-675414 5.15.0-1066-aws #72~20.04.1-Ubuntu SMP Sat Jul 20 07:44:07 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [23b8338269ddca80162212d9a76197f8de6631dc25fd1e89271138d7bf6507f7] <==
I0804 00:50:58.945760 1 main.go:299] handling current node
W0804 00:51:02.248831 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0804 00:51:02.248869 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
W0804 00:51:08.535768 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0804 00:51:08.535804 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0804 00:51:08.945672 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0804 00:51:08.945708 1 main.go:299] handling current node
W0804 00:51:12.239104 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0804 00:51:12.239141 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0804 00:51:18.946479 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0804 00:51:18.946548 1 main.go:299] handling current node
I0804 00:51:28.946314 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0804 00:51:28.946360 1 main.go:299] handling current node
I0804 00:51:38.945768 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0804 00:51:38.945800 1 main.go:299] handling current node
I0804 00:51:48.946403 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0804 00:51:48.946439 1 main.go:299] handling current node
W0804 00:51:50.007484 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0804 00:51:50.007525 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
W0804 00:51:54.226051 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0804 00:51:54.226283 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
W0804 00:51:57.043378 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0804 00:51:57.043415 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0804 00:51:58.946322 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0804 00:51:58.946370 1 main.go:299] handling current node
==> kindnet [c09a50d1e2d0abf8d930c57d74d8d9d9c9257f0e39e5a083a3ea16e35ee03b0f] <==
I0804 00:57:14.868824 1 main.go:299] handling current node
W0804 00:57:15.181460 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0804 00:57:15.181498 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0804 00:57:24.869673 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0804 00:57:24.869717 1 main.go:299] handling current node
I0804 00:57:34.869071 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0804 00:57:34.869109 1 main.go:299] handling current node
W0804 00:57:41.043473 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0804 00:57:41.043510 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0804 00:57:44.869169 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0804 00:57:44.869264 1 main.go:299] handling current node
W0804 00:57:47.617417 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0804 00:57:47.617464 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
W0804 00:57:52.715086 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0804 00:57:52.715127 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0804 00:57:54.868865 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0804 00:57:54.868905 1 main.go:299] handling current node
I0804 00:58:04.869343 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0804 00:58:04.869387 1 main.go:299] handling current node
I0804 00:58:14.869379 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0804 00:58:14.869416 1 main.go:299] handling current node
I0804 00:58:24.869040 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0804 00:58:24.869077 1 main.go:299] handling current node
W0804 00:58:26.012285 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0804 00:58:26.012346 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
==> kube-apiserver [987c7c57f33cc3bca08f2823d03c3436be4204498232f94e80f1ca3ad97e0370] <==
I0804 00:55:15.204169 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0804 00:55:15.204178 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0804 00:55:44.881264 1 handler_proxy.go:102] no RequestInfo found in the context
E0804 00:55:44.881346 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0804 00:55:44.881354 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0804 00:55:51.691334 1 client.go:360] parsed scheme: "passthrough"
I0804 00:55:51.691383 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0804 00:55:51.691392 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0804 00:56:26.803770 1 client.go:360] parsed scheme: "passthrough"
I0804 00:56:26.803816 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0804 00:56:26.803825 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0804 00:57:06.716095 1 client.go:360] parsed scheme: "passthrough"
I0804 00:57:06.716139 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0804 00:57:06.716147 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0804 00:57:38.854359 1 client.go:360] parsed scheme: "passthrough"
I0804 00:57:38.854407 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0804 00:57:38.854558 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0804 00:57:42.339561 1 handler_proxy.go:102] no RequestInfo found in the context
E0804 00:57:42.339784 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0804 00:57:42.339800 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0804 00:58:16.558802 1 client.go:360] parsed scheme: "passthrough"
I0804 00:58:16.558861 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0804 00:58:16.558999 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [be279b22b091c58ad9ed186bf62fa3b5f4471e254befe9b2885a9e11a69c1a89] <==
I0804 00:50:06.320284 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0804 00:50:06.323678 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0804 00:50:06.323850 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0804 00:50:06.813770 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0804 00:50:06.855997 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0804 00:50:06.946351 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I0804 00:50:06.947814 1 controller.go:606] quota admission added evaluator for: endpoints
I0804 00:50:06.961665 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0804 00:50:07.966201 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0804 00:50:08.569129 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0804 00:50:08.642813 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0804 00:50:17.042864 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0804 00:50:25.143263 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0804 00:50:25.223234 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0804 00:50:44.760629 1 client.go:360] parsed scheme: "passthrough"
I0804 00:50:44.760670 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0804 00:50:44.760678 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0804 00:51:16.779498 1 client.go:360] parsed scheme: "passthrough"
I0804 00:51:16.779542 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0804 00:51:16.779567 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0804 00:51:53.621558 1 client.go:360] parsed scheme: "passthrough"
I0804 00:51:53.621599 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0804 00:51:53.621607 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
E0804 00:51:56.853047 1 upgradeaware.go:387] Error proxying data from backend to client: write tcp 192.168.76.2:8443->192.168.76.1:50874: write: broken pipe
E0804 00:51:58.444147 1 available_controller.go:508] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again
==> kube-controller-manager [bfe98cd74da739eabd2a656d66b6599a764d7278da248862ec24b7eb65ddf53a] <==
I0804 00:50:25.119212 1 range_allocator.go:373] Set node old-k8s-version-675414 PodCIDR to [10.244.0.0/24]
I0804 00:50:25.133437 1 shared_informer.go:247] Caches are synced for ReplicaSet
I0804 00:50:25.163670 1 shared_informer.go:247] Caches are synced for stateful set
I0804 00:50:25.163736 1 shared_informer.go:247] Caches are synced for PVC protection
I0804 00:50:25.205069 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-tqt47"
I0804 00:50:25.212772 1 shared_informer.go:247] Caches are synced for deployment
I0804 00:50:25.213451 1 shared_informer.go:247] Caches are synced for attach detach
I0804 00:50:25.242660 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-vffqm"
I0804 00:50:25.283354 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
I0804 00:50:25.308240 1 shared_informer.go:247] Caches are synced for resource quota
I0804 00:50:25.312361 1 shared_informer.go:247] Caches are synced for disruption
I0804 00:50:25.312385 1 disruption.go:339] Sending events to api server.
I0804 00:50:25.312851 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-hqfq7"
I0804 00:50:25.315823 1 shared_informer.go:247] Caches are synced for resource quota
I0804 00:50:25.363198 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-d9q67"
E0804 00:50:25.486992 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"14722b73-e7c6-4547-ac04-70bb77dd3f5f", ResourceVersion:"269", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63858329408, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001ad83e0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001ad8400)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0x4001ad8420), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x4001ad2380), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001ad8
440), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001ad8460), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001ad84a0)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001ada060), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4001ad0498), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40002d4a80), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x4000823818)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4001ad04e8)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
E0804 00:50:25.489826 1 daemon_controller.go:320] kube-system/kindnet failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kindnet", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"8dc483f6-b378-4501-9072-b6138a6646f3", ResourceVersion:"283", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63858329409, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"},\"name\":\"kindnet\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"app\":\"k
indnet\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"}},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"HOST_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.hostIP\"}}},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"POD_SUBNET\",\"value\":\"10.244.0.0/16\"}],\"image\":\"docker.io/kindest/kindnetd:v20240719-e7903573\",\"name\":\"kindnet-cni\",\"resources\":{\"limits\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"}},\"securityContext\":{\"capabilities\":{\"add\":[\"NET_RAW\",\"NET_ADMIN\"]},\"privileged\":false},\"volumeMounts\":[{\"mountPath\":\"/etc/cni/net.d\",\"name\":\"cni-cfg\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\",\"readOnly\":false},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\",\"readOnly\":true}]}],\"hostNetwork\":true,\"serviceAccountName\":\"kindnet\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\
":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/etc/cni/net.d\",\"type\":\"DirectoryOrCreate\"},\"name\":\"cni-cfg\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"}]}}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001ad8500), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001ad8520)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4001ad8540), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string
{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"cni-cfg", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001ad8560), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil),
FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001ad8580), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Glust
erfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001ad85a0), EmptyDi
r:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil),
PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kindnet-cni", Image:"docker.io/kindest/kindnetd:v20240719-e7903573", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOST_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001ad85c0)}, v1.EnvVar{Name:"POD_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001ad8600)}, v1.EnvVar{Name:"POD_SUBNET", Value:"10.244.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:
0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-cfg", ReadOnly:false, MountPath:"/etc/cni/net.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:
(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001ada0c0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4001ad06e8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"kindnet", DeprecatedServiceAccount:"kindnet", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40002d4d20), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}},
HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x4000823828)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4001ad0730)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kindnet": the object has been modified; please apply your changes to the latest version and try again
I0804 00:50:25.520692 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0804 00:50:25.712747 1 shared_informer.go:247] Caches are synced for garbage collector
I0804 00:50:25.712770 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0804 00:50:25.720878 1 shared_informer.go:247] Caches are synced for garbage collector
I0804 00:50:26.690122 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0804 00:50:26.713569 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-d9q67"
I0804 00:50:30.058833 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0804 00:51:58.029262 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
==> kube-controller-manager [f75a0f3a0098d71dba19c2fda8834332ee198e6777d297afd3be08a02a5cedf9] <==
I0804 00:54:06.638810 1 request.go:655] Throttling request took 1.048287333s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0804 00:54:07.490157 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0804 00:54:32.820894 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0804 00:54:39.141457 1 request.go:655] Throttling request took 1.048902107s, request: GET:https://192.168.76.2:8443/apis/authentication.k8s.io/v1?timeout=32s
W0804 00:54:39.992228 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0804 00:55:03.322905 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0804 00:55:11.642793 1 request.go:655] Throttling request took 1.04841771s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0804 00:55:12.494199 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0804 00:55:33.824466 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0804 00:55:44.192098 1 request.go:655] Throttling request took 1.047122446s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0804 00:55:45.046034 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0804 00:56:04.326617 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0804 00:56:16.696462 1 request.go:655] Throttling request took 1.048291224s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0804 00:56:17.547893 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0804 00:56:34.828403 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0804 00:56:49.198469 1 request.go:655] Throttling request took 1.048375815s, request: GET:https://192.168.76.2:8443/apis/certificates.k8s.io/v1?timeout=32s
W0804 00:56:50.050032 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0804 00:57:05.330253 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0804 00:57:21.700483 1 request.go:655] Throttling request took 1.048484339s, request: GET:https://192.168.76.2:8443/apis/authentication.k8s.io/v1beta1?timeout=32s
W0804 00:57:22.551946 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0804 00:57:35.831889 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0804 00:57:54.202403 1 request.go:655] Throttling request took 1.048288002s, request: GET:https://192.168.76.2:8443/apis/certificates.k8s.io/v1beta1?timeout=32s
W0804 00:57:55.053973 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0804 00:58:06.333738 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0804 00:58:26.704557 1 request.go:655] Throttling request took 1.04803162s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
==> kube-proxy [077c4d240dbe0a241741ad2fc0948dd86eba5a5ea94ab539993c350e9875633f] <==
I0804 00:52:45.664005 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0804 00:52:45.664091 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0804 00:52:45.694570 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0804 00:52:45.694659 1 server_others.go:185] Using iptables Proxier.
I0804 00:52:45.694875 1 server.go:650] Version: v1.20.0
I0804 00:52:45.695839 1 config.go:315] Starting service config controller
I0804 00:52:45.695849 1 shared_informer.go:240] Waiting for caches to sync for service config
I0804 00:52:45.695865 1 config.go:224] Starting endpoint slice config controller
I0804 00:52:45.695869 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0804 00:52:45.796803 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0804 00:52:45.796973 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [989e28403b27a5a0236486c2c183e294a12c016c4c4c64c3ff9089948ddcfd21] <==
I0804 00:50:26.508086 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0804 00:50:26.508207 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0804 00:50:26.532898 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0804 00:50:26.532992 1 server_others.go:185] Using iptables Proxier.
I0804 00:50:26.533221 1 server.go:650] Version: v1.20.0
I0804 00:50:26.533719 1 config.go:315] Starting service config controller
I0804 00:50:26.533739 1 shared_informer.go:240] Waiting for caches to sync for service config
I0804 00:50:26.536093 1 config.go:224] Starting endpoint slice config controller
I0804 00:50:26.536119 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0804 00:50:26.633875 1 shared_informer.go:247] Caches are synced for service config
I0804 00:50:26.636642 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [7960a12d68e3b491cf04420a9d57537f55924eba2b7eb5bda75c8a354ae5e032] <==
I0804 00:52:37.481636 1 serving.go:331] Generated self-signed cert in-memory
W0804 00:52:41.217296 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0804 00:52:41.217329 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0804 00:52:41.217340 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0804 00:52:41.217345 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0804 00:52:41.492920 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0804 00:52:41.492964 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0804 00:52:41.493352 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0804 00:52:41.493394 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0804 00:52:41.695008 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [a66f6cfcc29b8bd49c8f13c54a60e9e147728c2d10100d2768cf68278e21f444] <==
W0804 00:50:05.461735 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0804 00:50:05.461773 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0804 00:50:05.461819 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0804 00:50:05.461838 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0804 00:50:05.540713 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0804 00:50:05.541577 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0804 00:50:05.548873 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0804 00:50:05.559187 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
E0804 00:50:05.573821 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0804 00:50:05.573957 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0804 00:50:05.574101 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0804 00:50:05.574200 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0804 00:50:05.576566 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0804 00:50:05.576651 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0804 00:50:05.576776 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0804 00:50:05.576858 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0804 00:50:05.576939 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0804 00:50:05.577010 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0804 00:50:05.577089 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0804 00:50:05.589885 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0804 00:50:06.436625 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0804 00:50:06.503501 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0804 00:50:06.524802 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0804 00:50:06.612635 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
I0804 00:50:06.959321 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Aug 04 00:56:49 old-k8s-version-675414 kubelet[660]: E0804 00:56:49.936459 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:56:55 old-k8s-version-675414 kubelet[660]: I0804 00:56:55.935296 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: a5c053b94591d70052938fb5a022709078b7e2e40c419de0adb5035ddf702261
Aug 04 00:56:55 old-k8s-version-675414 kubelet[660]: E0804 00:56:55.935648 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
Aug 04 00:57:02 old-k8s-version-675414 kubelet[660]: E0804 00:57:02.936961 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:57:07 old-k8s-version-675414 kubelet[660]: I0804 00:57:07.935284 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: a5c053b94591d70052938fb5a022709078b7e2e40c419de0adb5035ddf702261
Aug 04 00:57:07 old-k8s-version-675414 kubelet[660]: E0804 00:57:07.935632 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
Aug 04 00:57:17 old-k8s-version-675414 kubelet[660]: E0804 00:57:17.936096 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:57:18 old-k8s-version-675414 kubelet[660]: I0804 00:57:18.935538 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: a5c053b94591d70052938fb5a022709078b7e2e40c419de0adb5035ddf702261
Aug 04 00:57:18 old-k8s-version-675414 kubelet[660]: E0804 00:57:18.936013 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
Aug 04 00:57:30 old-k8s-version-675414 kubelet[660]: E0804 00:57:30.936039 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:57:33 old-k8s-version-675414 kubelet[660]: I0804 00:57:33.935318 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: a5c053b94591d70052938fb5a022709078b7e2e40c419de0adb5035ddf702261
Aug 04 00:57:33 old-k8s-version-675414 kubelet[660]: E0804 00:57:33.935699 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
Aug 04 00:57:43 old-k8s-version-675414 kubelet[660]: E0804 00:57:43.936175 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:57:48 old-k8s-version-675414 kubelet[660]: I0804 00:57:48.935634 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: a5c053b94591d70052938fb5a022709078b7e2e40c419de0adb5035ddf702261
Aug 04 00:57:48 old-k8s-version-675414 kubelet[660]: E0804 00:57:48.936525 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
Aug 04 00:57:58 old-k8s-version-675414 kubelet[660]: E0804 00:57:58.937236 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:58:03 old-k8s-version-675414 kubelet[660]: I0804 00:58:03.935817 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: a5c053b94591d70052938fb5a022709078b7e2e40c419de0adb5035ddf702261
Aug 04 00:58:03 old-k8s-version-675414 kubelet[660]: E0804 00:58:03.936079 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
Aug 04 00:58:10 old-k8s-version-675414 kubelet[660]: E0804 00:58:10.936100 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 04 00:58:14 old-k8s-version-675414 kubelet[660]: I0804 00:58:14.935416 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: a5c053b94591d70052938fb5a022709078b7e2e40c419de0adb5035ddf702261
Aug 04 00:58:14 old-k8s-version-675414 kubelet[660]: E0804 00:58:14.943760 660 pod_workers.go:191] Error syncing pod de08bfc4-c28c-463d-85c4-35ed2b14dd7b ("dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-7fkw8_kubernetes-dashboard(de08bfc4-c28c-463d-85c4-35ed2b14dd7b)"
Aug 04 00:58:23 old-k8s-version-675414 kubelet[660]: E0804 00:58:23.946226 660 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 04 00:58:23 old-k8s-version-675414 kubelet[660]: E0804 00:58:23.946286 660 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 04 00:58:23 old-k8s-version-675414 kubelet[660]: E0804 00:58:23.946415 660 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-6rjpz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-7sd8p_kube-system(9e799fe
e-f413-4e22-a6bc-fd5487dddf5b): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 04 00:58:23 old-k8s-version-675414 kubelet[660]: E0804 00:58:23.946449 660 pod_workers.go:191] Error syncing pod 9e799fee-f413-4e22-a6bc-fd5487dddf5b ("metrics-server-9975d5f86-7sd8p_kube-system(9e799fee-f413-4e22-a6bc-fd5487dddf5b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
==> kubernetes-dashboard [aafe2aa0c39a34282c92489dd6d4e856f3fbd5ff82e808079ab2f8e7c3366383] <==
2024/08/04 00:53:04 Using namespace: kubernetes-dashboard
2024/08/04 00:53:04 Using in-cluster config to connect to apiserver
2024/08/04 00:53:04 Using secret token for csrf signing
2024/08/04 00:53:04 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/08/04 00:53:04 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/08/04 00:53:04 Successful initial request to the apiserver, version: v1.20.0
2024/08/04 00:53:04 Generating JWE encryption key
2024/08/04 00:53:04 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/08/04 00:53:04 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/08/04 00:53:05 Initializing JWE encryption key from synchronized object
2024/08/04 00:53:05 Creating in-cluster Sidecar client
2024/08/04 00:53:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/04 00:53:05 Serving insecurely on HTTP port: 9090
2024/08/04 00:53:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/04 00:54:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/04 00:54:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/04 00:55:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/04 00:55:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/04 00:56:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/04 00:56:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/04 00:57:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/04 00:57:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/04 00:58:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/04 00:53:04 Starting overwatch
==> storage-provisioner [76ba2c77767271189966f7605db549a47762718ea69ef080d8be2aa9635320fa] <==
I0804 00:52:45.982406 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0804 00:53:15.991792 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [b6a2eb1e427442100a4c7c83a3d7b1ead5c7c050b06d9744549f7c844a98c947] <==
I0804 00:53:30.063299 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0804 00:53:30.084315 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0804 00:53:30.084569 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0804 00:53:47.641647 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0804 00:53:47.642279 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-675414_4aa68657-e12b-49ea-ba6c-c6e5b3908595!
I0804 00:53:47.643505 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"fc3c64e1-e895-4d52-8a6b-0b992b53ff07", APIVersion:"v1", ResourceVersion:"850", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-675414_4aa68657-e12b-49ea-ba6c-c6e5b3908595 became leader
I0804 00:53:47.743153 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-675414_4aa68657-e12b-49ea-ba6c-c6e5b3908595!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-675414 -n old-k8s-version-675414
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-675414 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-7sd8p
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-675414 describe pod metrics-server-9975d5f86-7sd8p
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-675414 describe pod metrics-server-9975d5f86-7sd8p: exit status 1 (162.899338ms)
** stderr **
E0804 00:58:28.566622 1696986 memcache.go:287] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0804 00:58:28.570918 1696986 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0804 00:58:28.586101 1696986 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0804 00:58:28.594125 1696986 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0804 00:58:28.603018 1696986 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0804 00:58:28.608428 1696986 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Error from server (NotFound): pods "metrics-server-9975d5f86-7sd8p" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-675414 describe pod metrics-server-9975d5f86-7sd8p: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (376.75s)