=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-999319 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-999319 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m7.54787544s)
-- stdout --
* [old-k8s-version-999319] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19356
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19356-869736/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19356-869736/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
* Using the docker driver based on existing profile
* Starting "old-k8s-version-999319" primary control-plane node in "old-k8s-version-999319" cluster
* Pulling base image v0.0.44-1721902582-19326 ...
* Restarting existing docker container for "old-k8s-version-999319" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image registry.k8s.io/echoserver:1.4
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-999319 addons enable metrics-server
* Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
-- /stdout --
** stderr **
I0731 19:53:22.467413 1082506 out.go:291] Setting OutFile to fd 1 ...
I0731 19:53:22.467601 1082506 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 19:53:22.467613 1082506 out.go:304] Setting ErrFile to fd 2...
I0731 19:53:22.467619 1082506 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 19:53:22.467896 1082506 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19356-869736/.minikube/bin
I0731 19:53:22.468318 1082506 out.go:298] Setting JSON to false
I0731 19:53:22.469410 1082506 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":12942,"bootTime":1722442661,"procs":220,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
I0731 19:53:22.469478 1082506 start.go:139] virtualization:
I0731 19:53:22.471909 1082506 out.go:177] * [old-k8s-version-999319] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0731 19:53:22.474073 1082506 out.go:177] - MINIKUBE_LOCATION=19356
I0731 19:53:22.474247 1082506 notify.go:220] Checking for updates...
I0731 19:53:22.477124 1082506 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0731 19:53:22.479301 1082506 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19356-869736/kubeconfig
I0731 19:53:22.480876 1082506 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19356-869736/.minikube
I0731 19:53:22.482408 1082506 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0731 19:53:22.484063 1082506 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0731 19:53:22.485948 1082506 config.go:182] Loaded profile config "old-k8s-version-999319": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0731 19:53:22.488280 1082506 out.go:177] * Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
I0731 19:53:22.489886 1082506 driver.go:392] Setting default libvirt URI to qemu:///system
I0731 19:53:22.520190 1082506 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0731 19:53:22.520295 1082506 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0731 19:53:22.570206 1082506 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:68 SystemTime:2024-07-31 19:53:22.561042108 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0731 19:53:22.570319 1082506 docker.go:307] overlay module found
I0731 19:53:22.573513 1082506 out.go:177] * Using the docker driver based on existing profile
I0731 19:53:22.574998 1082506 start.go:297] selected driver: docker
I0731 19:53:22.575021 1082506 start.go:901] validating driver "docker" against &{Name:old-k8s-version-999319 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-999319 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0731 19:53:22.575132 1082506 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0731 19:53:22.575763 1082506 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0731 19:53:22.635605 1082506 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:68 SystemTime:2024-07-31 19:53:22.62662502 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0731 19:53:22.636117 1082506 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0731 19:53:22.636148 1082506 cni.go:84] Creating CNI manager for ""
I0731 19:53:22.636156 1082506 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0731 19:53:22.636206 1082506 start.go:340] cluster config:
{Name:old-k8s-version-999319 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-999319 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0731 19:53:22.638115 1082506 out.go:177] * Starting "old-k8s-version-999319" primary control-plane node in "old-k8s-version-999319" cluster
I0731 19:53:22.639517 1082506 cache.go:121] Beginning downloading kic base image for docker with containerd
I0731 19:53:22.641552 1082506 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0731 19:53:22.642997 1082506 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0731 19:53:22.643044 1082506 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19356-869736/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0731 19:53:22.643057 1082506 cache.go:56] Caching tarball of preloaded images
I0731 19:53:22.643152 1082506 preload.go:172] Found /home/jenkins/minikube-integration/19356-869736/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0731 19:53:22.643164 1082506 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0731 19:53:22.643281 1082506 profile.go:143] Saving config to /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/old-k8s-version-999319/config.json ...
I0731 19:53:22.643501 1082506 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
W0731 19:53:22.661961 1082506 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
I0731 19:53:22.661982 1082506 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0731 19:53:22.662054 1082506 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0731 19:53:22.662079 1082506 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0731 19:53:22.662088 1082506 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0731 19:53:22.662096 1082506 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0731 19:53:22.662102 1082506 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0731 19:53:22.784166 1082506 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0731 19:53:22.784207 1082506 cache.go:194] Successfully downloaded all kic artifacts
I0731 19:53:22.784250 1082506 start.go:360] acquireMachinesLock for old-k8s-version-999319: {Name:mkc013ec4750cb18484b920f0112f1b4ee95be56 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0731 19:53:22.784328 1082506 start.go:364] duration metric: took 54.982µs to acquireMachinesLock for "old-k8s-version-999319"
I0731 19:53:22.784353 1082506 start.go:96] Skipping create...Using existing machine configuration
I0731 19:53:22.784359 1082506 fix.go:54] fixHost starting:
I0731 19:53:22.784641 1082506 cli_runner.go:164] Run: docker container inspect old-k8s-version-999319 --format={{.State.Status}}
I0731 19:53:22.802321 1082506 fix.go:112] recreateIfNeeded on old-k8s-version-999319: state=Stopped err=<nil>
W0731 19:53:22.802351 1082506 fix.go:138] unexpected machine state, will restart: <nil>
I0731 19:53:22.804644 1082506 out.go:177] * Restarting existing docker container for "old-k8s-version-999319" ...
I0731 19:53:22.806482 1082506 cli_runner.go:164] Run: docker start old-k8s-version-999319
I0731 19:53:23.117738 1082506 cli_runner.go:164] Run: docker container inspect old-k8s-version-999319 --format={{.State.Status}}
I0731 19:53:23.148312 1082506 kic.go:430] container "old-k8s-version-999319" state is running.
I0731 19:53:23.148720 1082506 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-999319
I0731 19:53:23.168677 1082506 profile.go:143] Saving config to /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/old-k8s-version-999319/config.json ...
I0731 19:53:23.168908 1082506 machine.go:94] provisionDockerMachine start ...
I0731 19:53:23.168965 1082506 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-999319
I0731 19:53:23.189894 1082506 main.go:141] libmachine: Using SSH client type: native
I0731 19:53:23.190169 1082506 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33854 <nil> <nil>}
I0731 19:53:23.190179 1082506 main.go:141] libmachine: About to run SSH command:
hostname
I0731 19:53:23.190828 1082506 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:33600->127.0.0.1:33854: read: connection reset by peer
I0731 19:53:26.327733 1082506 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-999319
I0731 19:53:26.327806 1082506 ubuntu.go:169] provisioning hostname "old-k8s-version-999319"
I0731 19:53:26.327932 1082506 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-999319
I0731 19:53:26.349100 1082506 main.go:141] libmachine: Using SSH client type: native
I0731 19:53:26.349359 1082506 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33854 <nil> <nil>}
I0731 19:53:26.349377 1082506 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-999319 && echo "old-k8s-version-999319" | sudo tee /etc/hostname
I0731 19:53:26.492990 1082506 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-999319
I0731 19:53:26.493103 1082506 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-999319
I0731 19:53:26.512228 1082506 main.go:141] libmachine: Using SSH client type: native
I0731 19:53:26.512481 1082506 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33854 <nil> <nil>}
I0731 19:53:26.512506 1082506 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-999319' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-999319/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-999319' | sudo tee -a /etc/hosts;
fi
fi
I0731 19:53:26.652386 1082506 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0731 19:53:26.652422 1082506 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19356-869736/.minikube CaCertPath:/home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19356-869736/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19356-869736/.minikube}
I0731 19:53:26.652445 1082506 ubuntu.go:177] setting up certificates
I0731 19:53:26.652456 1082506 provision.go:84] configureAuth start
I0731 19:53:26.652515 1082506 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-999319
I0731 19:53:26.669566 1082506 provision.go:143] copyHostCerts
I0731 19:53:26.669691 1082506 exec_runner.go:144] found /home/jenkins/minikube-integration/19356-869736/.minikube/ca.pem, removing ...
I0731 19:53:26.669726 1082506 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19356-869736/.minikube/ca.pem
I0731 19:53:26.669852 1082506 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19356-869736/.minikube/ca.pem (1078 bytes)
I0731 19:53:26.669976 1082506 exec_runner.go:144] found /home/jenkins/minikube-integration/19356-869736/.minikube/cert.pem, removing ...
I0731 19:53:26.669987 1082506 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19356-869736/.minikube/cert.pem
I0731 19:53:26.670030 1082506 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19356-869736/.minikube/cert.pem (1123 bytes)
I0731 19:53:26.670098 1082506 exec_runner.go:144] found /home/jenkins/minikube-integration/19356-869736/.minikube/key.pem, removing ...
I0731 19:53:26.670110 1082506 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19356-869736/.minikube/key.pem
I0731 19:53:26.670137 1082506 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19356-869736/.minikube/key.pem (1679 bytes)
I0731 19:53:26.670195 1082506 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19356-869736/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-999319 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-999319]
I0731 19:53:26.971824 1082506 provision.go:177] copyRemoteCerts
I0731 19:53:26.971904 1082506 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0731 19:53:26.971949 1082506 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-999319
I0731 19:53:26.991078 1082506 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33854 SSHKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/old-k8s-version-999319/id_rsa Username:docker}
I0731 19:53:27.088963 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0731 19:53:27.114251 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0731 19:53:27.142396 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0731 19:53:27.167759 1082506 provision.go:87] duration metric: took 515.289536ms to configureAuth
I0731 19:53:27.167784 1082506 ubuntu.go:193] setting minikube options for container-runtime
I0731 19:53:27.168058 1082506 config.go:182] Loaded profile config "old-k8s-version-999319": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0731 19:53:27.168071 1082506 machine.go:97] duration metric: took 3.999155262s to provisionDockerMachine
I0731 19:53:27.168080 1082506 start.go:293] postStartSetup for "old-k8s-version-999319" (driver="docker")
I0731 19:53:27.168090 1082506 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0731 19:53:27.168156 1082506 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0731 19:53:27.168212 1082506 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-999319
I0731 19:53:27.185931 1082506 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33854 SSHKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/old-k8s-version-999319/id_rsa Username:docker}
I0731 19:53:27.280988 1082506 ssh_runner.go:195] Run: cat /etc/os-release
I0731 19:53:27.284152 1082506 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0731 19:53:27.284185 1082506 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0731 19:53:27.284197 1082506 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0731 19:53:27.284204 1082506 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0731 19:53:27.284219 1082506 filesync.go:126] Scanning /home/jenkins/minikube-integration/19356-869736/.minikube/addons for local assets ...
I0731 19:53:27.284276 1082506 filesync.go:126] Scanning /home/jenkins/minikube-integration/19356-869736/.minikube/files for local assets ...
I0731 19:53:27.284357 1082506 filesync.go:149] local asset: /home/jenkins/minikube-integration/19356-869736/.minikube/files/etc/ssl/certs/8751262.pem -> 8751262.pem in /etc/ssl/certs
I0731 19:53:27.284466 1082506 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0731 19:53:27.292848 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/files/etc/ssl/certs/8751262.pem --> /etc/ssl/certs/8751262.pem (1708 bytes)
I0731 19:53:27.318013 1082506 start.go:296] duration metric: took 149.915667ms for postStartSetup
I0731 19:53:27.318117 1082506 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0731 19:53:27.318166 1082506 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-999319
I0731 19:53:27.335867 1082506 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33854 SSHKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/old-k8s-version-999319/id_rsa Username:docker}
I0731 19:53:27.429328 1082506 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0731 19:53:27.434098 1082506 fix.go:56] duration metric: took 4.649730151s for fixHost
I0731 19:53:27.434120 1082506 start.go:83] releasing machines lock for "old-k8s-version-999319", held for 4.649780998s
I0731 19:53:27.434202 1082506 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-999319
I0731 19:53:27.450352 1082506 ssh_runner.go:195] Run: cat /version.json
I0731 19:53:27.450407 1082506 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-999319
I0731 19:53:27.450460 1082506 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0731 19:53:27.450522 1082506 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-999319
I0731 19:53:27.469440 1082506 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33854 SSHKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/old-k8s-version-999319/id_rsa Username:docker}
I0731 19:53:27.470039 1082506 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33854 SSHKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/old-k8s-version-999319/id_rsa Username:docker}
I0731 19:53:27.719131 1082506 ssh_runner.go:195] Run: systemctl --version
I0731 19:53:27.724322 1082506 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0731 19:53:27.728422 1082506 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0731 19:53:27.746857 1082506 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0731 19:53:27.746935 1082506 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0731 19:53:27.756528 1082506 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0731 19:53:27.756554 1082506 start.go:495] detecting cgroup driver to use...
I0731 19:53:27.756587 1082506 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0731 19:53:27.756638 1082506 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0731 19:53:27.770433 1082506 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0731 19:53:27.783889 1082506 docker.go:217] disabling cri-docker service (if available) ...
I0731 19:53:27.784018 1082506 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0731 19:53:27.797969 1082506 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0731 19:53:27.810788 1082506 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0731 19:53:27.915528 1082506 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0731 19:53:28.015003 1082506 docker.go:233] disabling docker service ...
I0731 19:53:28.015077 1082506 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0731 19:53:28.028942 1082506 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0731 19:53:28.042234 1082506 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0731 19:53:28.142866 1082506 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0731 19:53:28.229748 1082506 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0731 19:53:28.241056 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0731 19:53:28.257917 1082506 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0731 19:53:28.268997 1082506 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0731 19:53:28.279280 1082506 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0731 19:53:28.279396 1082506 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0731 19:53:28.289919 1082506 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0731 19:53:28.299957 1082506 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0731 19:53:28.310360 1082506 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0731 19:53:28.320709 1082506 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0731 19:53:28.330510 1082506 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0731 19:53:28.343024 1082506 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0731 19:53:28.353589 1082506 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0731 19:53:28.361808 1082506 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 19:53:28.450229 1082506 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0731 19:53:28.635519 1082506 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0731 19:53:28.635633 1082506 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0731 19:53:28.639304 1082506 start.go:563] Will wait 60s for crictl version
I0731 19:53:28.639419 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:53:28.642695 1082506 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0731 19:53:28.689527 1082506 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.19
RuntimeApiVersion: v1
I0731 19:53:28.689633 1082506 ssh_runner.go:195] Run: containerd --version
I0731 19:53:28.715324 1082506 ssh_runner.go:195] Run: containerd --version
I0731 19:53:28.748972 1082506 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
I0731 19:53:28.751032 1082506 cli_runner.go:164] Run: docker network inspect old-k8s-version-999319 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0731 19:53:28.768577 1082506 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0731 19:53:28.772819 1082506 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0731 19:53:28.785065 1082506 kubeadm.go:883] updating cluster {Name:old-k8s-version-999319 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-999319 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0731 19:53:28.785196 1082506 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0731 19:53:28.785259 1082506 ssh_runner.go:195] Run: sudo crictl images --output json
I0731 19:53:28.822973 1082506 containerd.go:627] all images are preloaded for containerd runtime.
I0731 19:53:28.822997 1082506 containerd.go:534] Images already preloaded, skipping extraction
I0731 19:53:28.823058 1082506 ssh_runner.go:195] Run: sudo crictl images --output json
I0731 19:53:28.864966 1082506 containerd.go:627] all images are preloaded for containerd runtime.
I0731 19:53:28.864987 1082506 cache_images.go:84] Images are preloaded, skipping loading
I0731 19:53:28.864995 1082506 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.20.0 containerd true true} ...
I0731 19:53:28.865119 1082506 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-999319 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-999319 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0731 19:53:28.865190 1082506 ssh_runner.go:195] Run: sudo crictl info
I0731 19:53:28.905610 1082506 cni.go:84] Creating CNI manager for ""
I0731 19:53:28.905635 1082506 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0731 19:53:28.905644 1082506 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0731 19:53:28.905663 1082506 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-999319 NodeName:old-k8s-version-999319 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0731 19:53:28.905788 1082506 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-999319"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0731 19:53:28.905861 1082506 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0731 19:53:28.915191 1082506 binaries.go:44] Found k8s binaries, skipping transfer
I0731 19:53:28.915275 1082506 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0731 19:53:28.923962 1082506 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0731 19:53:28.941767 1082506 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0731 19:53:28.959393 1082506 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0731 19:53:28.977518 1082506 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0731 19:53:28.987807 1082506 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0731 19:53:29.001277 1082506 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 19:53:29.086286 1082506 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0731 19:53:29.101292 1082506 certs.go:68] Setting up /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/old-k8s-version-999319 for IP: 192.168.85.2
I0731 19:53:29.101328 1082506 certs.go:194] generating shared ca certs ...
I0731 19:53:29.101359 1082506 certs.go:226] acquiring lock for ca certs: {Name:mkbe8972b65e866e00919db4c1d4ac947f84a312 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 19:53:29.101519 1082506 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19356-869736/.minikube/ca.key
I0731 19:53:29.101601 1082506 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19356-869736/.minikube/proxy-client-ca.key
I0731 19:53:29.101614 1082506 certs.go:256] generating profile certs ...
I0731 19:53:29.101722 1082506 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/old-k8s-version-999319/client.key
I0731 19:53:29.101827 1082506 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/old-k8s-version-999319/apiserver.key.c20d1422
I0731 19:53:29.101897 1082506 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/old-k8s-version-999319/proxy-client.key
I0731 19:53:29.102049 1082506 certs.go:484] found cert: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/875126.pem (1338 bytes)
W0731 19:53:29.102109 1082506 certs.go:480] ignoring /home/jenkins/minikube-integration/19356-869736/.minikube/certs/875126_empty.pem, impossibly tiny 0 bytes
I0731 19:53:29.102125 1082506 certs.go:484] found cert: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca-key.pem (1679 bytes)
I0731 19:53:29.102169 1082506 certs.go:484] found cert: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca.pem (1078 bytes)
I0731 19:53:29.102214 1082506 certs.go:484] found cert: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/cert.pem (1123 bytes)
I0731 19:53:29.102264 1082506 certs.go:484] found cert: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/key.pem (1679 bytes)
I0731 19:53:29.102339 1082506 certs.go:484] found cert: /home/jenkins/minikube-integration/19356-869736/.minikube/files/etc/ssl/certs/8751262.pem (1708 bytes)
I0731 19:53:29.103130 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0731 19:53:29.137777 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0731 19:53:29.165042 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0731 19:53:29.192039 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0731 19:53:29.217270 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/old-k8s-version-999319/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0731 19:53:29.240494 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/old-k8s-version-999319/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0731 19:53:29.271494 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/old-k8s-version-999319/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0731 19:53:29.299436 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/old-k8s-version-999319/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0731 19:53:29.325088 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/certs/875126.pem --> /usr/share/ca-certificates/875126.pem (1338 bytes)
I0731 19:53:29.352588 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/files/etc/ssl/certs/8751262.pem --> /usr/share/ca-certificates/8751262.pem (1708 bytes)
I0731 19:53:29.377298 1082506 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0731 19:53:29.402753 1082506 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0731 19:53:29.420746 1082506 ssh_runner.go:195] Run: openssl version
I0731 19:53:29.428374 1082506 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/875126.pem && ln -fs /usr/share/ca-certificates/875126.pem /etc/ssl/certs/875126.pem"
I0731 19:53:29.438280 1082506 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/875126.pem
I0731 19:53:29.441863 1082506 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 31 19:13 /usr/share/ca-certificates/875126.pem
I0731 19:53:29.441928 1082506 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/875126.pem
I0731 19:53:29.448942 1082506 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/875126.pem /etc/ssl/certs/51391683.0"
I0731 19:53:29.457872 1082506 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8751262.pem && ln -fs /usr/share/ca-certificates/8751262.pem /etc/ssl/certs/8751262.pem"
I0731 19:53:29.467510 1082506 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8751262.pem
I0731 19:53:29.471053 1082506 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 31 19:13 /usr/share/ca-certificates/8751262.pem
I0731 19:53:29.471176 1082506 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8751262.pem
I0731 19:53:29.478432 1082506 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8751262.pem /etc/ssl/certs/3ec20f2e.0"
I0731 19:53:29.487039 1082506 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0731 19:53:29.496555 1082506 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0731 19:53:29.500217 1082506 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 31 19:03 /usr/share/ca-certificates/minikubeCA.pem
I0731 19:53:29.500280 1082506 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0731 19:53:29.507129 1082506 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0731 19:53:29.516260 1082506 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0731 19:53:29.520169 1082506 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0731 19:53:29.527079 1082506 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0731 19:53:29.534058 1082506 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0731 19:53:29.541019 1082506 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0731 19:53:29.548425 1082506 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0731 19:53:29.555403 1082506 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0731 19:53:29.562652 1082506 kubeadm.go:392] StartCluster: {Name:old-k8s-version-999319 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-999319 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0731 19:53:29.562761 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0731 19:53:29.562843 1082506 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0731 19:53:29.602411 1082506 cri.go:89] found id: "bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046"
I0731 19:53:29.602451 1082506 cri.go:89] found id: "58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd"
I0731 19:53:29.602456 1082506 cri.go:89] found id: "d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d"
I0731 19:53:29.602460 1082506 cri.go:89] found id: "9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f"
I0731 19:53:29.602480 1082506 cri.go:89] found id: "efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc"
I0731 19:53:29.602492 1082506 cri.go:89] found id: "687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf"
I0731 19:53:29.602495 1082506 cri.go:89] found id: "e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691"
I0731 19:53:29.602498 1082506 cri.go:89] found id: "58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d"
I0731 19:53:29.602501 1082506 cri.go:89] found id: ""
I0731 19:53:29.602574 1082506 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0731 19:53:29.615149 1082506 cri.go:116] JSON = null
W0731 19:53:29.615267 1082506 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0731 19:53:29.615356 1082506 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0731 19:53:29.624190 1082506 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0731 19:53:29.624263 1082506 kubeadm.go:593] restartPrimaryControlPlane start ...
I0731 19:53:29.624344 1082506 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0731 19:53:29.633689 1082506 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0731 19:53:29.634273 1082506 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-999319" does not appear in /home/jenkins/minikube-integration/19356-869736/kubeconfig
I0731 19:53:29.634523 1082506 kubeconfig.go:62] /home/jenkins/minikube-integration/19356-869736/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-999319" cluster setting kubeconfig missing "old-k8s-version-999319" context setting]
I0731 19:53:29.634968 1082506 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19356-869736/kubeconfig: {Name:mk3e4cdb3475640e2f018e673d3b9b1d0ac70f56 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 19:53:29.636341 1082506 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0731 19:53:29.647280 1082506 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2
I0731 19:53:29.647314 1082506 kubeadm.go:597] duration metric: took 23.03229ms to restartPrimaryControlPlane
I0731 19:53:29.647324 1082506 kubeadm.go:394] duration metric: took 84.682375ms to StartCluster
I0731 19:53:29.647358 1082506 settings.go:142] acquiring lock: {Name:mk2da8b36d8c0cf6459e75f7b328b29e49cf5efb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 19:53:29.647431 1082506 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19356-869736/kubeconfig
I0731 19:53:29.648485 1082506 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19356-869736/kubeconfig: {Name:mk3e4cdb3475640e2f018e673d3b9b1d0ac70f56 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 19:53:29.648723 1082506 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0731 19:53:29.649005 1082506 config.go:182] Loaded profile config "old-k8s-version-999319": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0731 19:53:29.649042 1082506 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0731 19:53:29.649112 1082506 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-999319"
I0731 19:53:29.649138 1082506 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-999319"
W0731 19:53:29.649149 1082506 addons.go:243] addon storage-provisioner should already be in state true
I0731 19:53:29.649170 1082506 host.go:66] Checking if "old-k8s-version-999319" exists ...
I0731 19:53:29.649364 1082506 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-999319"
I0731 19:53:29.649411 1082506 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-999319"
I0731 19:53:29.649467 1082506 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-999319"
W0731 19:53:29.649486 1082506 addons.go:243] addon metrics-server should already be in state true
I0731 19:53:29.649553 1082506 host.go:66] Checking if "old-k8s-version-999319" exists ...
I0731 19:53:29.649815 1082506 cli_runner.go:164] Run: docker container inspect old-k8s-version-999319 --format={{.State.Status}}
I0731 19:53:29.650086 1082506 cli_runner.go:164] Run: docker container inspect old-k8s-version-999319 --format={{.State.Status}}
I0731 19:53:29.649418 1082506 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-999319"
I0731 19:53:29.650605 1082506 cli_runner.go:164] Run: docker container inspect old-k8s-version-999319 --format={{.State.Status}}
I0731 19:53:29.649366 1082506 addons.go:69] Setting dashboard=true in profile "old-k8s-version-999319"
I0731 19:53:29.650842 1082506 addons.go:234] Setting addon dashboard=true in "old-k8s-version-999319"
W0731 19:53:29.650855 1082506 addons.go:243] addon dashboard should already be in state true
I0731 19:53:29.650878 1082506 host.go:66] Checking if "old-k8s-version-999319" exists ...
I0731 19:53:29.651258 1082506 cli_runner.go:164] Run: docker container inspect old-k8s-version-999319 --format={{.State.Status}}
I0731 19:53:29.653813 1082506 out.go:177] * Verifying Kubernetes components...
I0731 19:53:29.655533 1082506 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 19:53:29.724336 1082506 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0731 19:53:29.724442 1082506 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0731 19:53:29.725583 1082506 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-999319"
W0731 19:53:29.725602 1082506 addons.go:243] addon default-storageclass should already be in state true
I0731 19:53:29.725626 1082506 host.go:66] Checking if "old-k8s-version-999319" exists ...
I0731 19:53:29.726018 1082506 cli_runner.go:164] Run: docker container inspect old-k8s-version-999319 --format={{.State.Status}}
I0731 19:53:29.727303 1082506 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0731 19:53:29.727484 1082506 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0731 19:53:29.727494 1082506 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0731 19:53:29.727545 1082506 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-999319
I0731 19:53:29.728926 1082506 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0731 19:53:29.728991 1082506 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0731 19:53:29.729001 1082506 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0731 19:53:29.729058 1082506 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-999319
I0731 19:53:29.730903 1082506 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0731 19:53:29.730922 1082506 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0731 19:53:29.730991 1082506 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-999319
I0731 19:53:29.767292 1082506 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0731 19:53:29.767313 1082506 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0731 19:53:29.767376 1082506 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-999319
I0731 19:53:29.767791 1082506 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33854 SSHKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/old-k8s-version-999319/id_rsa Username:docker}
I0731 19:53:29.796268 1082506 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0731 19:53:29.798417 1082506 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33854 SSHKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/old-k8s-version-999319/id_rsa Username:docker}
I0731 19:53:29.806941 1082506 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33854 SSHKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/old-k8s-version-999319/id_rsa Username:docker}
I0731 19:53:29.819846 1082506 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33854 SSHKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/old-k8s-version-999319/id_rsa Username:docker}
I0731 19:53:29.822567 1082506 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-999319" to be "Ready" ...
I0731 19:53:29.915654 1082506 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0731 19:53:29.915725 1082506 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0731 19:53:29.937122 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0731 19:53:29.938791 1082506 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0731 19:53:29.938854 1082506 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0731 19:53:29.971206 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0731 19:53:29.977624 1082506 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0731 19:53:29.977686 1082506 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0731 19:53:29.981314 1082506 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0731 19:53:29.981383 1082506 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0731 19:53:30.012553 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0731 19:53:30.034284 1082506 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0731 19:53:30.034372 1082506 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0731 19:53:30.123137 1082506 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0731 19:53:30.123232 1082506 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0731 19:53:30.169735 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.169833 1082506 retry.go:31] will retry after 364.488132ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.190462 1082506 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0731 19:53:30.190536 1082506 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0731 19:53:30.199548 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.199620 1082506 retry.go:31] will retry after 225.582089ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0731 19:53:30.199585 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.199660 1082506 retry.go:31] will retry after 342.174847ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.211541 1082506 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0731 19:53:30.211621 1082506 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0731 19:53:30.230366 1082506 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0731 19:53:30.230440 1082506 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0731 19:53:30.249271 1082506 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0731 19:53:30.249295 1082506 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0731 19:53:30.267117 1082506 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0731 19:53:30.267193 1082506 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0731 19:53:30.285791 1082506 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0731 19:53:30.285814 1082506 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0731 19:53:30.305069 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0731 19:53:30.377246 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.377276 1082506 retry.go:31] will retry after 233.863086ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.425366 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0731 19:53:30.494678 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.494710 1082506 retry.go:31] will retry after 190.976672ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.534995 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0731 19:53:30.542353 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0731 19:53:30.611672 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0731 19:53:30.654484 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.654531 1082506 retry.go:31] will retry after 240.07837ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0731 19:53:30.654578 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.654586 1082506 retry.go:31] will retry after 458.528534ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.686693 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0731 19:53:30.722148 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.722194 1082506 retry.go:31] will retry after 266.729407ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0731 19:53:30.773318 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.773347 1082506 retry.go:31] will retry after 441.377765ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.895132 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0731 19:53:30.966042 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.966075 1082506 retry.go:31] will retry after 722.930544ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:30.989222 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0731 19:53:31.066087 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:31.066178 1082506 retry.go:31] will retry after 572.88117ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:31.114380 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0731 19:53:31.195676 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:31.195708 1082506 retry.go:31] will retry after 328.456872ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:31.215043 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0731 19:53:31.287484 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:31.287526 1082506 retry.go:31] will retry after 792.024151ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:31.524404 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0731 19:53:31.591039 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:31.591068 1082506 retry.go:31] will retry after 441.09502ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:31.639428 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0731 19:53:31.689908 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0731 19:53:31.727505 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:31.727539 1082506 retry.go:31] will retry after 930.355981ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0731 19:53:31.777910 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:31.777941 1082506 retry.go:31] will retry after 725.203382ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:31.823498 1082506 node_ready.go:53] error getting node "old-k8s-version-999319": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-999319": dial tcp 192.168.85.2:8443: connect: connection refused
I0731 19:53:32.032986 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0731 19:53:32.080478 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0731 19:53:32.143870 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:32.143971 1082506 retry.go:31] will retry after 1.891889075s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0731 19:53:32.192916 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:32.192950 1082506 retry.go:31] will retry after 934.223192ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:32.504295 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0731 19:53:32.581574 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:32.581605 1082506 retry.go:31] will retry after 1.384653712s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:32.658851 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0731 19:53:32.727237 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:32.727270 1082506 retry.go:31] will retry after 962.488761ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:33.128190 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0731 19:53:33.202323 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:33.202358 1082506 retry.go:31] will retry after 2.252190409s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:33.690532 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0731 19:53:33.761673 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:33.761708 1082506 retry.go:31] will retry after 1.144489299s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:33.966812 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0731 19:53:34.036197 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0731 19:53:34.048901 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:34.048940 1082506 retry.go:31] will retry after 1.630449333s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0731 19:53:34.130241 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:34.130271 1082506 retry.go:31] will retry after 993.711265ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:34.323947 1082506 node_ready.go:53] error getting node "old-k8s-version-999319": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-999319": dial tcp 192.168.85.2:8443: connect: connection refused
I0731 19:53:34.907127 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0731 19:53:34.986276 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:34.986312 1082506 retry.go:31] will retry after 3.043471739s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:35.124681 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0731 19:53:35.197588 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:35.197635 1082506 retry.go:31] will retry after 2.365063753s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:35.455676 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0731 19:53:35.531298 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:35.531333 1082506 retry.go:31] will retry after 2.80126783s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:35.679566 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0731 19:53:35.753104 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:35.753139 1082506 retry.go:31] will retry after 2.814327796s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:36.823902 1082506 node_ready.go:53] error getting node "old-k8s-version-999319": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-999319": dial tcp 192.168.85.2:8443: connect: connection refused
I0731 19:53:37.563826 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0731 19:53:37.668934 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:37.668975 1082506 retry.go:31] will retry after 3.269116471s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:38.030350 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0731 19:53:38.143870 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:38.143910 1082506 retry.go:31] will retry after 5.726294177s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:38.332933 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0731 19:53:38.568479 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0731 19:53:38.594698 1082506 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:38.594755 1082506 retry.go:31] will retry after 5.022833231s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 19:53:40.938981 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0731 19:53:43.618141 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0731 19:53:43.871196 1082506 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0731 19:53:46.426815 1082506 node_ready.go:49] node "old-k8s-version-999319" has status "Ready":"True"
I0731 19:53:46.426890 1082506 node_ready.go:38] duration metric: took 16.604296124s for node "old-k8s-version-999319" to be "Ready" ...
I0731 19:53:46.426915 1082506 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0731 19:53:46.744899 1082506 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-d5xpg" in "kube-system" namespace to be "Ready" ...
I0731 19:53:46.923053 1082506 pod_ready.go:92] pod "coredns-74ff55c5b-d5xpg" in "kube-system" namespace has status "Ready":"True"
I0731 19:53:46.923133 1082506 pod_ready.go:81] duration metric: took 178.136881ms for pod "coredns-74ff55c5b-d5xpg" in "kube-system" namespace to be "Ready" ...
I0731 19:53:46.923160 1082506 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-999319" in "kube-system" namespace to be "Ready" ...
I0731 19:53:46.980756 1082506 pod_ready.go:92] pod "etcd-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"True"
I0731 19:53:46.980824 1082506 pod_ready.go:81] duration metric: took 57.643702ms for pod "etcd-old-k8s-version-999319" in "kube-system" namespace to be "Ready" ...
I0731 19:53:46.980855 1082506 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-999319" in "kube-system" namespace to be "Ready" ...
I0731 19:53:47.233916 1082506 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (8.665392633s)
I0731 19:53:47.625952 1082506 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (6.686924991s)
I0731 19:53:47.766240 1082506 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (4.148053584s)
I0731 19:53:47.766327 1082506 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-999319"
I0731 19:53:47.964854 1082506 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (4.093602312s)
I0731 19:53:47.966828 1082506 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-999319 addons enable metrics-server
I0731 19:53:47.968645 1082506 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
I0731 19:53:47.970286 1082506 addons.go:510] duration metric: took 18.321237397s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server dashboard]
I0731 19:53:48.990395 1082506 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:53:51.486725 1082506 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:53:53.487208 1082506 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:53:55.489200 1082506 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:53:55.986727 1082506 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"True"
I0731 19:53:55.986752 1082506 pod_ready.go:81] duration metric: took 9.005878278s for pod "kube-apiserver-old-k8s-version-999319" in "kube-system" namespace to be "Ready" ...
I0731 19:53:55.986764 1082506 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace to be "Ready" ...
I0731 19:53:57.992675 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:53:59.993122 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:01.994295 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:04.492963 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:06.493674 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:08.993468 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:11.009881 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:13.494585 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:15.517296 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:17.997303 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:20.493638 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:22.495114 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:24.993096 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:26.997547 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:29.493836 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:31.494066 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:33.993929 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:35.994382 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:38.493147 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:40.493455 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:42.993448 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:45.493233 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:47.493533 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:49.493742 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:51.494560 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:53.993362 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:56.493130 1082506 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:54:56.994229 1082506 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"True"
I0731 19:54:56.994255 1082506 pod_ready.go:81] duration metric: took 1m1.007482762s for pod "kube-controller-manager-old-k8s-version-999319" in "kube-system" namespace to be "Ready" ...
I0731 19:54:56.994268 1082506 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-ph6qj" in "kube-system" namespace to be "Ready" ...
I0731 19:54:56.999109 1082506 pod_ready.go:92] pod "kube-proxy-ph6qj" in "kube-system" namespace has status "Ready":"True"
I0731 19:54:56.999135 1082506 pod_ready.go:81] duration metric: took 4.860954ms for pod "kube-proxy-ph6qj" in "kube-system" namespace to be "Ready" ...
I0731 19:54:56.999148 1082506 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-999319" in "kube-system" namespace to be "Ready" ...
I0731 19:54:59.007831 1082506 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:01.008121 1082506 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:03.505248 1082506 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:05.013817 1082506 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-999319" in "kube-system" namespace has status "Ready":"True"
I0731 19:55:05.013850 1082506 pod_ready.go:81] duration metric: took 8.014692251s for pod "kube-scheduler-old-k8s-version-999319" in "kube-system" namespace to be "Ready" ...
I0731 19:55:05.013863 1082506 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace to be "Ready" ...
I0731 19:55:07.020997 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:09.520244 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:12.019792 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:14.521455 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:17.022635 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:19.520436 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:22.023935 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:24.520601 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:27.097415 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:29.521224 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:32.020275 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:34.020728 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:36.519289 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:38.520506 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:40.521152 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:43.025688 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:45.520465 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:48.020672 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:50.519829 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:53.021214 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:55.520529 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:55:58.021363 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:00.072628 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:02.522810 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:05.026344 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:07.520079 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:09.521240 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:12.020108 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:14.020620 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:16.024577 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:18.520594 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:20.521000 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:23.019805 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:25.021726 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:27.572439 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:30.027923 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:32.520131 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:35.027892 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:37.520189 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:40.024903 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:42.521202 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:44.523636 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:47.020190 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:49.520410 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:52.020940 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:54.521353 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:57.020134 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:56:59.020531 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:01.020932 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:03.519725 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:05.520960 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:08.021400 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:10.021506 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:12.519890 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:14.521376 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:17.019609 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:19.019816 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:21.020944 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:23.520192 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:26.019783 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:28.076447 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:30.520446 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:32.520773 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:35.021720 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:37.520349 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:39.520799 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:42.021677 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:44.521408 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:47.020217 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:49.026107 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:51.519808 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:53.520588 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:56.020236 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:57:58.028334 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:00.029341 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:02.520371 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:05.021041 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:07.521270 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:10.022409 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:12.519776 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:14.520369 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:16.521273 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:18.521437 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:21.019670 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:23.020971 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:25.519766 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:27.526071 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:30.030490 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:32.520233 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:34.520849 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:37.020918 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:39.520079 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:42.020202 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:44.021121 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:46.520275 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:48.525341 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:51.026762 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:53.521080 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:55.521184 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:57.528703 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:59:00.024507 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:59:02.520251 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:59:04.521311 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:59:05.022474 1082506 pod_ready.go:81] duration metric: took 4m0.008595809s for pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace to be "Ready" ...
E0731 19:59:05.022503 1082506 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0731 19:59:05.022512 1082506 pod_ready.go:38] duration metric: took 5m18.595572288s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0731 19:59:05.022526 1082506 api_server.go:52] waiting for apiserver process to appear ...
I0731 19:59:05.022557 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0731 19:59:05.022628 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0731 19:59:05.067499 1082506 cri.go:89] found id: "01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb"
I0731 19:59:05.067518 1082506 cri.go:89] found id: "e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691"
I0731 19:59:05.067523 1082506 cri.go:89] found id: ""
I0731 19:59:05.067530 1082506 logs.go:276] 2 containers: [01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691]
I0731 19:59:05.067588 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.071675 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.075774 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0731 19:59:05.075847 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0731 19:59:05.156855 1082506 cri.go:89] found id: "7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8"
I0731 19:59:05.156874 1082506 cri.go:89] found id: "efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc"
I0731 19:59:05.156878 1082506 cri.go:89] found id: ""
I0731 19:59:05.156885 1082506 logs.go:276] 2 containers: [7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8 efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc]
I0731 19:59:05.156941 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.161462 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.166177 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0731 19:59:05.166245 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0731 19:59:05.221663 1082506 cri.go:89] found id: "d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e"
I0731 19:59:05.221680 1082506 cri.go:89] found id: "bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046"
I0731 19:59:05.221685 1082506 cri.go:89] found id: ""
I0731 19:59:05.221691 1082506 logs.go:276] 2 containers: [d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046]
I0731 19:59:05.221754 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.225845 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.231004 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0731 19:59:05.231135 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0731 19:59:05.287518 1082506 cri.go:89] found id: "5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983"
I0731 19:59:05.287551 1082506 cri.go:89] found id: "58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d"
I0731 19:59:05.287557 1082506 cri.go:89] found id: ""
I0731 19:59:05.287564 1082506 logs.go:276] 2 containers: [5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983 58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d]
I0731 19:59:05.287636 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.291755 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.295567 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0731 19:59:05.295665 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0731 19:59:05.354786 1082506 cri.go:89] found id: "c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51"
I0731 19:59:05.354858 1082506 cri.go:89] found id: "9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f"
I0731 19:59:05.354875 1082506 cri.go:89] found id: ""
I0731 19:59:05.354895 1082506 logs.go:276] 2 containers: [c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51 9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f]
I0731 19:59:05.354972 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.371718 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.376095 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0731 19:59:05.376204 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0731 19:59:05.431441 1082506 cri.go:89] found id: "82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513"
I0731 19:59:05.431506 1082506 cri.go:89] found id: "687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf"
I0731 19:59:05.431523 1082506 cri.go:89] found id: ""
I0731 19:59:05.431544 1082506 logs.go:276] 2 containers: [82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513 687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf]
I0731 19:59:05.431648 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.435719 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.439948 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0731 19:59:05.440062 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0731 19:59:05.489676 1082506 cri.go:89] found id: "fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54"
I0731 19:59:05.489745 1082506 cri.go:89] found id: "58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd"
I0731 19:59:05.489763 1082506 cri.go:89] found id: ""
I0731 19:59:05.489784 1082506 logs.go:276] 2 containers: [fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54 58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd]
I0731 19:59:05.489860 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.494637 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.498880 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0731 19:59:05.498982 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0731 19:59:05.560427 1082506 cri.go:89] found id: "72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74"
I0731 19:59:05.560499 1082506 cri.go:89] found id: "d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d"
I0731 19:59:05.560516 1082506 cri.go:89] found id: ""
I0731 19:59:05.560536 1082506 logs.go:276] 2 containers: [72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74 d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d]
I0731 19:59:05.560619 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.564346 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.570278 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0731 19:59:05.570365 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0731 19:59:05.645984 1082506 cri.go:89] found id: "3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb"
I0731 19:59:05.646013 1082506 cri.go:89] found id: ""
I0731 19:59:05.646022 1082506 logs.go:276] 1 containers: [3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb]
I0731 19:59:05.646093 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.650106 1082506 logs.go:123] Gathering logs for kube-controller-manager [82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513] ...
I0731 19:59:05.650176 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513"
I0731 19:59:05.743927 1082506 logs.go:123] Gathering logs for storage-provisioner [d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d] ...
I0731 19:59:05.744033 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d"
I0731 19:59:05.801342 1082506 logs.go:123] Gathering logs for kubernetes-dashboard [3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb] ...
I0731 19:59:05.801417 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb"
I0731 19:59:05.851853 1082506 logs.go:123] Gathering logs for kubelet ...
I0731 19:59:05.851933 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0731 19:59:05.903952 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326038 660 reflector.go:138] object-"kube-system"/"coredns-token-gj262": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-gj262" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.905276 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326155 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.905558 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326225 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-lplc7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-lplc7" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.905809 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326285 660 reflector.go:138] object-"default"/"default-token-6f6s5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-6f6s5" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.906038 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326362 660 reflector.go:138] object-"kube-system"/"metrics-server-token-psb75": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-psb75" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.909799 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.502566 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-mkbf8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-mkbf8" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.910015 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.502668 660 reflector.go:138] object-"kube-system"/"kindnet-token-vgl5d": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-vgl5d" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.910223 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.502755 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.917275 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:47 old-k8s-version-999319 kubelet[660]: E0731 19:53:47.779236 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:05.917817 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:47 old-k8s-version-999319 kubelet[660]: E0731 19:53:47.853186 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.925569 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:59 old-k8s-version-999319 kubelet[660]: E0731 19:53:59.662479 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:05.927294 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:12 old-k8s-version-999319 kubelet[660]: E0731 19:54:12.651399 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.928128 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:19 old-k8s-version-999319 kubelet[660]: E0731 19:54:19.033897 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.928588 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:20 old-k8s-version-999319 kubelet[660]: E0731 19:54:20.059133 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.931053 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:24 old-k8s-version-999319 kubelet[660]: E0731 19:54:24.660795 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:05.931387 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:27 old-k8s-version-999319 kubelet[660]: E0731 19:54:27.144378 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.931918 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:39 old-k8s-version-999319 kubelet[660]: E0731 19:54:39.652527 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.935474 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:41 old-k8s-version-999319 kubelet[660]: E0731 19:54:41.099787 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.935861 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:47 old-k8s-version-999319 kubelet[660]: E0731 19:54:47.145251 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.936102 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:50 old-k8s-version-999319 kubelet[660]: E0731 19:54:50.651415 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.936467 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:00 old-k8s-version-999319 kubelet[660]: E0731 19:55:00.651577 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.938923 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:05 old-k8s-version-999319 kubelet[660]: E0731 19:55:05.661609 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:05.939584 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:13 old-k8s-version-999319 kubelet[660]: E0731 19:55:13.193809 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.939915 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:17 old-k8s-version-999319 kubelet[660]: E0731 19:55:17.143615 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.940104 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:19 old-k8s-version-999319 kubelet[660]: E0731 19:55:19.655910 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.940431 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:30 old-k8s-version-999319 kubelet[660]: E0731 19:55:30.651529 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.940618 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:30 old-k8s-version-999319 kubelet[660]: E0731 19:55:30.652416 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.940941 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:45 old-k8s-version-999319 kubelet[660]: E0731 19:55:45.654062 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.941123 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:45 old-k8s-version-999319 kubelet[660]: E0731 19:55:45.656760 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.941714 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:58 old-k8s-version-999319 kubelet[660]: E0731 19:55:58.303877 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.941898 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:59 old-k8s-version-999319 kubelet[660]: E0731 19:55:59.651595 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.942221 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:07 old-k8s-version-999319 kubelet[660]: E0731 19:56:07.143590 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.942400 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:12 old-k8s-version-999319 kubelet[660]: E0731 19:56:12.651197 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.942728 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:18 old-k8s-version-999319 kubelet[660]: E0731 19:56:18.650980 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.942910 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:25 old-k8s-version-999319 kubelet[660]: E0731 19:56:25.651335 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.943234 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:33 old-k8s-version-999319 kubelet[660]: E0731 19:56:33.652433 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.945847 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:39 old-k8s-version-999319 kubelet[660]: E0731 19:56:39.670766 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:05.946261 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:48 old-k8s-version-999319 kubelet[660]: E0731 19:56:48.650963 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.946476 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:52 old-k8s-version-999319 kubelet[660]: E0731 19:56:52.651443 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.946870 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:02 old-k8s-version-999319 kubelet[660]: E0731 19:57:02.650941 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.947083 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:05 old-k8s-version-999319 kubelet[660]: E0731 19:57:05.651361 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.947455 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:13 old-k8s-version-999319 kubelet[660]: E0731 19:57:13.651436 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.947676 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:20 old-k8s-version-999319 kubelet[660]: E0731 19:57:20.651249 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.948365 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:27 old-k8s-version-999319 kubelet[660]: E0731 19:57:27.526272 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.948582 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:31 old-k8s-version-999319 kubelet[660]: E0731 19:57:31.652529 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.948933 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:37 old-k8s-version-999319 kubelet[660]: E0731 19:57:37.143623 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.949139 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:43 old-k8s-version-999319 kubelet[660]: E0731 19:57:43.653235 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.949584 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:50 old-k8s-version-999319 kubelet[660]: E0731 19:57:50.650903 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.949812 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:57 old-k8s-version-999319 kubelet[660]: E0731 19:57:57.652175 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.950165 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:02 old-k8s-version-999319 kubelet[660]: E0731 19:58:02.650971 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.950387 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:08 old-k8s-version-999319 kubelet[660]: E0731 19:58:08.651308 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.950745 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:15 old-k8s-version-999319 kubelet[660]: E0731 19:58:15.651144 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.950954 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:21 old-k8s-version-999319 kubelet[660]: E0731 19:58:21.651270 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.951352 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:29 old-k8s-version-999319 kubelet[660]: E0731 19:58:29.651437 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.951583 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:36 old-k8s-version-999319 kubelet[660]: E0731 19:58:36.651450 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.951997 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:42 old-k8s-version-999319 kubelet[660]: E0731 19:58:42.650974 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.952210 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:47 old-k8s-version-999319 kubelet[660]: E0731 19:58:47.652087 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.952572 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:57 old-k8s-version-999319 kubelet[660]: E0731 19:58:57.651908 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.952788 1082506 logs.go:138] Found kubelet problem: Jul 31 19:59:01 old-k8s-version-999319 kubelet[660]: E0731 19:59:01.651281 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 19:59:05.952812 1082506 logs.go:123] Gathering logs for dmesg ...
I0731 19:59:05.952839 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0731 19:59:05.972054 1082506 logs.go:123] Gathering logs for coredns [d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e] ...
I0731 19:59:05.972132 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e"
I0731 19:59:06.019377 1082506 logs.go:123] Gathering logs for kube-scheduler [58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d] ...
I0731 19:59:06.019411 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d"
I0731 19:59:06.076074 1082506 logs.go:123] Gathering logs for etcd [efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc] ...
I0731 19:59:06.076109 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc"
I0731 19:59:06.133660 1082506 logs.go:123] Gathering logs for container status ...
I0731 19:59:06.133741 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0731 19:59:06.209391 1082506 logs.go:123] Gathering logs for describe nodes ...
I0731 19:59:06.209469 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0731 19:59:06.463171 1082506 logs.go:123] Gathering logs for kube-controller-manager [687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf] ...
I0731 19:59:06.463203 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf"
I0731 19:59:06.557924 1082506 logs.go:123] Gathering logs for kindnet [58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd] ...
I0731 19:59:06.558001 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd"
I0731 19:59:06.618940 1082506 logs.go:123] Gathering logs for containerd ...
I0731 19:59:06.619017 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0731 19:59:06.698602 1082506 logs.go:123] Gathering logs for kube-scheduler [5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983] ...
I0731 19:59:06.698642 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983"
I0731 19:59:06.745241 1082506 logs.go:123] Gathering logs for kube-proxy [c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51] ...
I0731 19:59:06.745274 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51"
I0731 19:59:06.802039 1082506 logs.go:123] Gathering logs for kube-proxy [9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f] ...
I0731 19:59:06.802071 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f"
I0731 19:59:06.867340 1082506 logs.go:123] Gathering logs for kindnet [fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54] ...
I0731 19:59:06.867373 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54"
I0731 19:59:06.935195 1082506 logs.go:123] Gathering logs for kube-apiserver [01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb] ...
I0731 19:59:06.935231 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb"
I0731 19:59:07.007752 1082506 logs.go:123] Gathering logs for kube-apiserver [e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691] ...
I0731 19:59:07.007794 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691"
I0731 19:59:07.088963 1082506 logs.go:123] Gathering logs for etcd [7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8] ...
I0731 19:59:07.089004 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8"
I0731 19:59:07.188274 1082506 logs.go:123] Gathering logs for coredns [bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046] ...
I0731 19:59:07.188305 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046"
I0731 19:59:07.245432 1082506 logs.go:123] Gathering logs for storage-provisioner [72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74] ...
I0731 19:59:07.245468 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74"
I0731 19:59:07.296429 1082506 out.go:304] Setting ErrFile to fd 2...
I0731 19:59:07.296461 1082506 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0731 19:59:07.296539 1082506 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0731 19:59:07.296553 1082506 out.go:239] Jul 31 19:58:36 old-k8s-version-999319 kubelet[660]: E0731 19:58:36.651450 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:58:36 old-k8s-version-999319 kubelet[660]: E0731 19:58:36.651450 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:07.296562 1082506 out.go:239] Jul 31 19:58:42 old-k8s-version-999319 kubelet[660]: E0731 19:58:42.650974 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
Jul 31 19:58:42 old-k8s-version-999319 kubelet[660]: E0731 19:58:42.650974 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:07.296590 1082506 out.go:239] Jul 31 19:58:47 old-k8s-version-999319 kubelet[660]: E0731 19:58:47.652087 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:58:47 old-k8s-version-999319 kubelet[660]: E0731 19:58:47.652087 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:07.296606 1082506 out.go:239] Jul 31 19:58:57 old-k8s-version-999319 kubelet[660]: E0731 19:58:57.651908 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
Jul 31 19:58:57 old-k8s-version-999319 kubelet[660]: E0731 19:58:57.651908 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:07.296633 1082506 out.go:239] Jul 31 19:59:01 old-k8s-version-999319 kubelet[660]: E0731 19:59:01.651281 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:59:01 old-k8s-version-999319 kubelet[660]: E0731 19:59:01.651281 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 19:59:07.296640 1082506 out.go:304] Setting ErrFile to fd 2...
I0731 19:59:07.296660 1082506 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 19:59:17.298728 1082506 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0731 19:59:17.310556 1082506 api_server.go:72] duration metric: took 5m47.661794382s to wait for apiserver process to appear ...
I0731 19:59:17.310582 1082506 api_server.go:88] waiting for apiserver healthz status ...
I0731 19:59:17.310616 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0731 19:59:17.310675 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0731 19:59:17.349686 1082506 cri.go:89] found id: "01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb"
I0731 19:59:17.349707 1082506 cri.go:89] found id: "e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691"
I0731 19:59:17.349712 1082506 cri.go:89] found id: ""
I0731 19:59:17.349719 1082506 logs.go:276] 2 containers: [01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691]
I0731 19:59:17.349775 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.353277 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.356636 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0731 19:59:17.356704 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0731 19:59:17.395690 1082506 cri.go:89] found id: "7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8"
I0731 19:59:17.395711 1082506 cri.go:89] found id: "efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc"
I0731 19:59:17.395716 1082506 cri.go:89] found id: ""
I0731 19:59:17.395723 1082506 logs.go:276] 2 containers: [7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8 efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc]
I0731 19:59:17.395780 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.399272 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.402692 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0731 19:59:17.402760 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0731 19:59:17.449904 1082506 cri.go:89] found id: "d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e"
I0731 19:59:17.449928 1082506 cri.go:89] found id: "bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046"
I0731 19:59:17.449932 1082506 cri.go:89] found id: ""
I0731 19:59:17.449939 1082506 logs.go:276] 2 containers: [d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046]
I0731 19:59:17.450007 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.458521 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.462154 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0731 19:59:17.462238 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0731 19:59:17.519204 1082506 cri.go:89] found id: "5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983"
I0731 19:59:17.519265 1082506 cri.go:89] found id: "58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d"
I0731 19:59:17.519270 1082506 cri.go:89] found id: ""
I0731 19:59:17.519277 1082506 logs.go:276] 2 containers: [5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983 58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d]
I0731 19:59:17.519351 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.523225 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.528493 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0731 19:59:17.528588 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0731 19:59:17.606126 1082506 cri.go:89] found id: "c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51"
I0731 19:59:17.606160 1082506 cri.go:89] found id: "9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f"
I0731 19:59:17.606168 1082506 cri.go:89] found id: ""
I0731 19:59:17.606181 1082506 logs.go:276] 2 containers: [c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51 9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f]
I0731 19:59:17.606260 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.610898 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.616822 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0731 19:59:17.616915 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0731 19:59:17.713124 1082506 cri.go:89] found id: "82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513"
I0731 19:59:17.713159 1082506 cri.go:89] found id: "687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf"
I0731 19:59:17.713165 1082506 cri.go:89] found id: ""
I0731 19:59:17.713172 1082506 logs.go:276] 2 containers: [82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513 687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf]
I0731 19:59:17.713235 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.721102 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.725802 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0731 19:59:17.725890 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0731 19:59:17.801302 1082506 cri.go:89] found id: "fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54"
I0731 19:59:17.801330 1082506 cri.go:89] found id: "58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd"
I0731 19:59:17.801334 1082506 cri.go:89] found id: ""
I0731 19:59:17.801350 1082506 logs.go:276] 2 containers: [fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54 58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd]
I0731 19:59:17.801431 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.808124 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.812836 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0731 19:59:17.812933 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0731 19:59:17.913160 1082506 cri.go:89] found id: "3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb"
I0731 19:59:17.913183 1082506 cri.go:89] found id: ""
I0731 19:59:17.913191 1082506 logs.go:276] 1 containers: [3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb]
I0731 19:59:17.913259 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.922904 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0731 19:59:17.922992 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0731 19:59:18.003697 1082506 cri.go:89] found id: "72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74"
I0731 19:59:18.003777 1082506 cri.go:89] found id: "d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d"
I0731 19:59:18.003796 1082506 cri.go:89] found id: ""
I0731 19:59:18.003814 1082506 logs.go:276] 2 containers: [72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74 d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d]
I0731 19:59:18.003909 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:18.013469 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:18.020306 1082506 logs.go:123] Gathering logs for kube-apiserver [e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691] ...
I0731 19:59:18.020387 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691"
I0731 19:59:18.103786 1082506 logs.go:123] Gathering logs for kube-proxy [c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51] ...
I0731 19:59:18.103864 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51"
I0731 19:59:18.172697 1082506 logs.go:123] Gathering logs for kube-controller-manager [687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf] ...
I0731 19:59:18.172723 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf"
I0731 19:59:18.257038 1082506 logs.go:123] Gathering logs for kindnet [fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54] ...
I0731 19:59:18.257117 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54"
I0731 19:59:18.353221 1082506 logs.go:123] Gathering logs for containerd ...
I0731 19:59:18.353304 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0731 19:59:18.426034 1082506 logs.go:123] Gathering logs for kubernetes-dashboard [3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb] ...
I0731 19:59:18.426117 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb"
I0731 19:59:18.509031 1082506 logs.go:123] Gathering logs for storage-provisioner [d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d] ...
I0731 19:59:18.509116 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d"
I0731 19:59:18.555693 1082506 logs.go:123] Gathering logs for dmesg ...
I0731 19:59:18.555766 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0731 19:59:18.576469 1082506 logs.go:123] Gathering logs for describe nodes ...
I0731 19:59:18.576548 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0731 19:59:18.754875 1082506 logs.go:123] Gathering logs for etcd [7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8] ...
I0731 19:59:18.754946 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8"
I0731 19:59:18.820148 1082506 logs.go:123] Gathering logs for coredns [bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046] ...
I0731 19:59:18.820216 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046"
I0731 19:59:18.866915 1082506 logs.go:123] Gathering logs for kube-scheduler [58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d] ...
I0731 19:59:18.866987 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d"
I0731 19:59:18.998393 1082506 logs.go:123] Gathering logs for kube-controller-manager [82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513] ...
I0731 19:59:18.998463 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513"
I0731 19:59:19.167570 1082506 logs.go:123] Gathering logs for kubelet ...
I0731 19:59:19.167652 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0731 19:59:19.255787 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326038 660 reflector.go:138] object-"kube-system"/"coredns-token-gj262": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-gj262" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.256083 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326155 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.256338 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326225 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-lplc7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-lplc7" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.256573 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326285 660 reflector.go:138] object-"default"/"default-token-6f6s5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-6f6s5" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.256815 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326362 660 reflector.go:138] object-"kube-system"/"metrics-server-token-psb75": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-psb75" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.260559 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.502566 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-mkbf8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-mkbf8" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.262033 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.502668 660 reflector.go:138] object-"kube-system"/"kindnet-token-vgl5d": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-vgl5d" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.262272 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.502755 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.269280 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:47 old-k8s-version-999319 kubelet[660]: E0731 19:53:47.779236 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:19.269942 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:47 old-k8s-version-999319 kubelet[660]: E0731 19:53:47.853186 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.273727 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:59 old-k8s-version-999319 kubelet[660]: E0731 19:53:59.662479 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:19.275635 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:12 old-k8s-version-999319 kubelet[660]: E0731 19:54:12.651399 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.276477 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:19 old-k8s-version-999319 kubelet[660]: E0731 19:54:19.033897 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.276962 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:20 old-k8s-version-999319 kubelet[660]: E0731 19:54:20.059133 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.279671 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:24 old-k8s-version-999319 kubelet[660]: E0731 19:54:24.660795 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:19.280045 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:27 old-k8s-version-999319 kubelet[660]: E0731 19:54:27.144378 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.280588 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:39 old-k8s-version-999319 kubelet[660]: E0731 19:54:39.652527 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.281203 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:41 old-k8s-version-999319 kubelet[660]: E0731 19:54:41.099787 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.281557 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:47 old-k8s-version-999319 kubelet[660]: E0731 19:54:47.145251 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.281767 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:50 old-k8s-version-999319 kubelet[660]: E0731 19:54:50.651415 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.282120 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:00 old-k8s-version-999319 kubelet[660]: E0731 19:55:00.651577 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.284689 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:05 old-k8s-version-999319 kubelet[660]: E0731 19:55:05.661609 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:19.285312 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:13 old-k8s-version-999319 kubelet[660]: E0731 19:55:13.193809 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.285682 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:17 old-k8s-version-999319 kubelet[660]: E0731 19:55:17.143615 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.285890 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:19 old-k8s-version-999319 kubelet[660]: E0731 19:55:19.655910 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.286243 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:30 old-k8s-version-999319 kubelet[660]: E0731 19:55:30.651529 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.286449 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:30 old-k8s-version-999319 kubelet[660]: E0731 19:55:30.652416 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.286802 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:45 old-k8s-version-999319 kubelet[660]: E0731 19:55:45.654062 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.287008 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:45 old-k8s-version-999319 kubelet[660]: E0731 19:55:45.656760 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.287621 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:58 old-k8s-version-999319 kubelet[660]: E0731 19:55:58.303877 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.287831 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:59 old-k8s-version-999319 kubelet[660]: E0731 19:55:59.651595 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.288188 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:07 old-k8s-version-999319 kubelet[660]: E0731 19:56:07.143590 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.288433 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:12 old-k8s-version-999319 kubelet[660]: E0731 19:56:12.651197 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.288765 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:18 old-k8s-version-999319 kubelet[660]: E0731 19:56:18.650980 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.288948 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:25 old-k8s-version-999319 kubelet[660]: E0731 19:56:25.651335 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.289274 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:33 old-k8s-version-999319 kubelet[660]: E0731 19:56:33.652433 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.291724 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:39 old-k8s-version-999319 kubelet[660]: E0731 19:56:39.670766 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:19.292056 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:48 old-k8s-version-999319 kubelet[660]: E0731 19:56:48.650963 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.292244 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:52 old-k8s-version-999319 kubelet[660]: E0731 19:56:52.651443 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.292572 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:02 old-k8s-version-999319 kubelet[660]: E0731 19:57:02.650941 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.292756 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:05 old-k8s-version-999319 kubelet[660]: E0731 19:57:05.651361 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.293081 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:13 old-k8s-version-999319 kubelet[660]: E0731 19:57:13.651436 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.293262 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:20 old-k8s-version-999319 kubelet[660]: E0731 19:57:20.651249 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.293848 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:27 old-k8s-version-999319 kubelet[660]: E0731 19:57:27.526272 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.294030 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:31 old-k8s-version-999319 kubelet[660]: E0731 19:57:31.652529 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.294356 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:37 old-k8s-version-999319 kubelet[660]: E0731 19:57:37.143623 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.294535 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:43 old-k8s-version-999319 kubelet[660]: E0731 19:57:43.653235 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.294876 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:50 old-k8s-version-999319 kubelet[660]: E0731 19:57:50.650903 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.295054 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:57 old-k8s-version-999319 kubelet[660]: E0731 19:57:57.652175 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.295383 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:02 old-k8s-version-999319 kubelet[660]: E0731 19:58:02.650971 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.295563 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:08 old-k8s-version-999319 kubelet[660]: E0731 19:58:08.651308 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.295886 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:15 old-k8s-version-999319 kubelet[660]: E0731 19:58:15.651144 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.296120 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:21 old-k8s-version-999319 kubelet[660]: E0731 19:58:21.651270 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.296472 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:29 old-k8s-version-999319 kubelet[660]: E0731 19:58:29.651437 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.296678 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:36 old-k8s-version-999319 kubelet[660]: E0731 19:58:36.651450 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.297028 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:42 old-k8s-version-999319 kubelet[660]: E0731 19:58:42.650974 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.297236 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:47 old-k8s-version-999319 kubelet[660]: E0731 19:58:47.652087 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.297586 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:57 old-k8s-version-999319 kubelet[660]: E0731 19:58:57.651908 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.297792 1082506 logs.go:138] Found kubelet problem: Jul 31 19:59:01 old-k8s-version-999319 kubelet[660]: E0731 19:59:01.651281 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.298140 1082506 logs.go:138] Found kubelet problem: Jul 31 19:59:12 old-k8s-version-999319 kubelet[660]: E0731 19:59:12.651599 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.298357 1082506 logs.go:138] Found kubelet problem: Jul 31 19:59:15 old-k8s-version-999319 kubelet[660]: E0731 19:59:15.653028 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 19:59:19.298383 1082506 logs.go:123] Gathering logs for coredns [d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e] ...
I0731 19:59:19.298412 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e"
I0731 19:59:19.368391 1082506 logs.go:123] Gathering logs for kube-scheduler [5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983] ...
I0731 19:59:19.368415 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983"
I0731 19:59:19.413483 1082506 logs.go:123] Gathering logs for kube-proxy [9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f] ...
I0731 19:59:19.413557 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f"
I0731 19:59:19.477240 1082506 logs.go:123] Gathering logs for kindnet [58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd] ...
I0731 19:59:19.477315 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd"
I0731 19:59:19.567246 1082506 logs.go:123] Gathering logs for kube-apiserver [01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb] ...
I0731 19:59:19.567327 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb"
I0731 19:59:19.700187 1082506 logs.go:123] Gathering logs for etcd [efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc] ...
I0731 19:59:19.700261 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc"
I0731 19:59:19.771744 1082506 logs.go:123] Gathering logs for storage-provisioner [72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74] ...
I0731 19:59:19.771871 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74"
I0731 19:59:19.816586 1082506 logs.go:123] Gathering logs for container status ...
I0731 19:59:19.816663 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0731 19:59:19.939478 1082506 out.go:304] Setting ErrFile to fd 2...
I0731 19:59:19.939551 1082506 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0731 19:59:19.939634 1082506 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0731 19:59:19.939670 1082506 out.go:239] Jul 31 19:58:47 old-k8s-version-999319 kubelet[660]: E0731 19:58:47.652087 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:58:47 old-k8s-version-999319 kubelet[660]: E0731 19:58:47.652087 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.939824 1082506 out.go:239] Jul 31 19:58:57 old-k8s-version-999319 kubelet[660]: E0731 19:58:57.651908 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
Jul 31 19:58:57 old-k8s-version-999319 kubelet[660]: E0731 19:58:57.651908 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.939855 1082506 out.go:239] Jul 31 19:59:01 old-k8s-version-999319 kubelet[660]: E0731 19:59:01.651281 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:59:01 old-k8s-version-999319 kubelet[660]: E0731 19:59:01.651281 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.939946 1082506 out.go:239] Jul 31 19:59:12 old-k8s-version-999319 kubelet[660]: E0731 19:59:12.651599 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
Jul 31 19:59:12 old-k8s-version-999319 kubelet[660]: E0731 19:59:12.651599 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.940105 1082506 out.go:239] Jul 31 19:59:15 old-k8s-version-999319 kubelet[660]: E0731 19:59:15.653028 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:59:15 old-k8s-version-999319 kubelet[660]: E0731 19:59:15.653028 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 19:59:19.940155 1082506 out.go:304] Setting ErrFile to fd 2...
I0731 19:59:19.940175 1082506 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 19:59:29.941626 1082506 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0731 19:59:29.950828 1082506 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0731 19:59:29.953595 1082506 out.go:177]
W0731 19:59:29.956128 1082506 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0731 19:59:29.956175 1082506 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0731 19:59:29.956195 1082506 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0731 19:59:29.956206 1082506 out.go:239] *
*
W0731 19:59:29.957204 1082506 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0731 19:59:29.959874 1082506 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-999319 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-999319
helpers_test.go:235: (dbg) docker inspect old-k8s-version-999319:
-- stdout --
[
{
"Id": "fa28e34b5bdea530309a8784a4b2e8ee02bbc2c3f917308254c75567d7f2acfa",
"Created": "2024-07-31T19:50:29.839039988Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1082714,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-07-31T19:53:22.932841161Z",
"FinishedAt": "2024-07-31T19:53:21.966350287Z"
},
"Image": "sha256:2cd84ab2172023a68162f38a55db46353562cea41552fd8e8bdec97b31b2c495",
"ResolvConfPath": "/var/lib/docker/containers/fa28e34b5bdea530309a8784a4b2e8ee02bbc2c3f917308254c75567d7f2acfa/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/fa28e34b5bdea530309a8784a4b2e8ee02bbc2c3f917308254c75567d7f2acfa/hostname",
"HostsPath": "/var/lib/docker/containers/fa28e34b5bdea530309a8784a4b2e8ee02bbc2c3f917308254c75567d7f2acfa/hosts",
"LogPath": "/var/lib/docker/containers/fa28e34b5bdea530309a8784a4b2e8ee02bbc2c3f917308254c75567d7f2acfa/fa28e34b5bdea530309a8784a4b2e8ee02bbc2c3f917308254c75567d7f2acfa-json.log",
"Name": "/old-k8s-version-999319",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-999319:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-999319",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/40071b570293cdaaa22f1e1b3fa866060b129e58d34a579a956aac594ef4375b-init/diff:/var/lib/docker/overlay2/fccd17adb62efbc3c6f2368e02306d5c6127fc9b30e1fa9df5131dd095182896/diff",
"MergedDir": "/var/lib/docker/overlay2/40071b570293cdaaa22f1e1b3fa866060b129e58d34a579a956aac594ef4375b/merged",
"UpperDir": "/var/lib/docker/overlay2/40071b570293cdaaa22f1e1b3fa866060b129e58d34a579a956aac594ef4375b/diff",
"WorkDir": "/var/lib/docker/overlay2/40071b570293cdaaa22f1e1b3fa866060b129e58d34a579a956aac594ef4375b/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-999319",
"Source": "/var/lib/docker/volumes/old-k8s-version-999319/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-999319",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-999319",
"name.minikube.sigs.k8s.io": "old-k8s-version-999319",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "abc7fec2e7dd73101c030d62fdb22d6ec0350591dde306087103ad3d047bd954",
"SandboxKey": "/var/run/docker/netns/abc7fec2e7dd",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33854"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33855"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33858"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33856"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33857"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-999319": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:55:02",
"DriverOpts": null,
"NetworkID": "e385c966a2a46635251b53057716776280451f02f73c3861934033548a7f777f",
"EndpointID": "a3bc78a6b8638627d890e0ed49ade5198d8de4512f3fb6266f5363508e3147b3",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-999319",
"fa28e34b5bde"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-999319 -n old-k8s-version-999319
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-999319 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-999319 logs -n 25: (2.08419293s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| start | -p force-systemd-flag-341888 | force-systemd-flag-341888 | jenkins | v1.33.1 | 31 Jul 24 19:49 UTC | 31 Jul 24 19:49 UTC |
| | --memory=2048 --force-systemd | | | | | |
| | --alsologtostderr | | | | | |
| | -v=5 --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-flag-341888 | force-systemd-flag-341888 | jenkins | v1.33.1 | 31 Jul 24 19:49 UTC | 31 Jul 24 19:49 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-flag-341888 | force-systemd-flag-341888 | jenkins | v1.33.1 | 31 Jul 24 19:49 UTC | 31 Jul 24 19:49 UTC |
| start | -p cert-options-084435 | cert-options-084435 | jenkins | v1.33.1 | 31 Jul 24 19:49 UTC | 31 Jul 24 19:50 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-084435 ssh | cert-options-084435 | jenkins | v1.33.1 | 31 Jul 24 19:50 UTC | 31 Jul 24 19:50 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-084435 -- sudo | cert-options-084435 | jenkins | v1.33.1 | 31 Jul 24 19:50 UTC | 31 Jul 24 19:50 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-084435 | cert-options-084435 | jenkins | v1.33.1 | 31 Jul 24 19:50 UTC | 31 Jul 24 19:50 UTC |
| start | -p old-k8s-version-999319 | old-k8s-version-999319 | jenkins | v1.33.1 | 31 Jul 24 19:50 UTC | 31 Jul 24 19:52 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-934421 | cert-expiration-934421 | jenkins | v1.33.1 | 31 Jul 24 19:52 UTC | 31 Jul 24 19:52 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-934421 | cert-expiration-934421 | jenkins | v1.33.1 | 31 Jul 24 19:52 UTC | 31 Jul 24 19:52 UTC |
| start | -p no-preload-431062 --memory=2200 | no-preload-431062 | jenkins | v1.33.1 | 31 Jul 24 19:52 UTC | 31 Jul 24 19:53 UTC |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0-beta.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-999319 | old-k8s-version-999319 | jenkins | v1.33.1 | 31 Jul 24 19:53 UTC | 31 Jul 24 19:53 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-999319 | old-k8s-version-999319 | jenkins | v1.33.1 | 31 Jul 24 19:53 UTC | 31 Jul 24 19:53 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-999319 | old-k8s-version-999319 | jenkins | v1.33.1 | 31 Jul 24 19:53 UTC | 31 Jul 24 19:53 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-999319 | old-k8s-version-999319 | jenkins | v1.33.1 | 31 Jul 24 19:53 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-431062 | no-preload-431062 | jenkins | v1.33.1 | 31 Jul 24 19:53 UTC | 31 Jul 24 19:53 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-431062 | no-preload-431062 | jenkins | v1.33.1 | 31 Jul 24 19:53 UTC | 31 Jul 24 19:54 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-431062 | no-preload-431062 | jenkins | v1.33.1 | 31 Jul 24 19:54 UTC | 31 Jul 24 19:54 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-431062 --memory=2200 | no-preload-431062 | jenkins | v1.33.1 | 31 Jul 24 19:54 UTC | 31 Jul 24 19:58 UTC |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0-beta.0 | | | | | |
| image | no-preload-431062 image list | no-preload-431062 | jenkins | v1.33.1 | 31 Jul 24 19:58 UTC | 31 Jul 24 19:58 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-431062 | no-preload-431062 | jenkins | v1.33.1 | 31 Jul 24 19:58 UTC | 31 Jul 24 19:58 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-431062 | no-preload-431062 | jenkins | v1.33.1 | 31 Jul 24 19:58 UTC | 31 Jul 24 19:58 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-431062 | no-preload-431062 | jenkins | v1.33.1 | 31 Jul 24 19:58 UTC | 31 Jul 24 19:58 UTC |
| delete | -p no-preload-431062 | no-preload-431062 | jenkins | v1.33.1 | 31 Jul 24 19:58 UTC | 31 Jul 24 19:58 UTC |
| start | -p embed-certs-992019 | embed-certs-992019 | jenkins | v1.33.1 | 31 Jul 24 19:58 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.3 | | | | | |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/07/31 19:58:52
Running on machine: ip-172-31-29-130
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0731 19:58:52.153739 1091966 out.go:291] Setting OutFile to fd 1 ...
I0731 19:58:52.153893 1091966 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 19:58:52.153904 1091966 out.go:304] Setting ErrFile to fd 2...
I0731 19:58:52.153910 1091966 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 19:58:52.154160 1091966 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19356-869736/.minikube/bin
I0731 19:58:52.154563 1091966 out.go:298] Setting JSON to false
I0731 19:58:52.155599 1091966 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":13272,"bootTime":1722442661,"procs":232,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
I0731 19:58:52.155670 1091966 start.go:139] virtualization:
I0731 19:58:52.158279 1091966 out.go:177] * [embed-certs-992019] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0731 19:58:52.160443 1091966 out.go:177] - MINIKUBE_LOCATION=19356
I0731 19:58:52.160638 1091966 notify.go:220] Checking for updates...
I0731 19:58:52.164249 1091966 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0731 19:58:52.166241 1091966 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19356-869736/kubeconfig
I0731 19:58:52.167801 1091966 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19356-869736/.minikube
I0731 19:58:52.170319 1091966 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0731 19:58:52.171940 1091966 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0731 19:58:52.174253 1091966 config.go:182] Loaded profile config "old-k8s-version-999319": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0731 19:58:52.174359 1091966 driver.go:392] Setting default libvirt URI to qemu:///system
I0731 19:58:52.195251 1091966 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0731 19:58:52.195422 1091966 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0731 19:58:52.250331 1091966 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-31 19:58:52.240427586 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0731 19:58:52.250476 1091966 docker.go:307] overlay module found
I0731 19:58:52.252814 1091966 out.go:177] * Using the docker driver based on user configuration
I0731 19:58:52.254696 1091966 start.go:297] selected driver: docker
I0731 19:58:52.254714 1091966 start.go:901] validating driver "docker" against <nil>
I0731 19:58:52.254728 1091966 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0731 19:58:52.255335 1091966 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0731 19:58:52.306956 1091966 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-31 19:58:52.297841732 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0731 19:58:52.307118 1091966 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0731 19:58:52.307371 1091966 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0731 19:58:52.309421 1091966 out.go:177] * Using Docker driver with root privileges
I0731 19:58:52.311275 1091966 cni.go:84] Creating CNI manager for ""
I0731 19:58:52.311304 1091966 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0731 19:58:52.311322 1091966 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0731 19:58:52.311405 1091966 start.go:340] cluster config:
{Name:embed-certs-992019 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-992019 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0731 19:58:52.313669 1091966 out.go:177] * Starting "embed-certs-992019" primary control-plane node in "embed-certs-992019" cluster
I0731 19:58:52.315482 1091966 cache.go:121] Beginning downloading kic base image for docker with containerd
I0731 19:58:52.317141 1091966 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0731 19:58:48.525341 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:51.026762 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:52.318816 1091966 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
I0731 19:58:52.318872 1091966 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19356-869736/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4
I0731 19:58:52.318881 1091966 cache.go:56] Caching tarball of preloaded images
I0731 19:58:52.318950 1091966 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
I0731 19:58:52.318960 1091966 preload.go:172] Found /home/jenkins/minikube-integration/19356-869736/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0731 19:58:52.318971 1091966 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on containerd
I0731 19:58:52.319084 1091966 profile.go:143] Saving config to /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/config.json ...
I0731 19:58:52.319102 1091966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/config.json: {Name:mkaaa07871007c01880e760686f11f9e0da24fbe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
W0731 19:58:52.344851 1091966 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
I0731 19:58:52.344870 1091966 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0731 19:58:52.344946 1091966 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0731 19:58:52.344964 1091966 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0731 19:58:52.344969 1091966 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0731 19:58:52.344977 1091966 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0731 19:58:52.344982 1091966 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0731 19:58:52.480628 1091966 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0731 19:58:52.480668 1091966 cache.go:194] Successfully downloaded all kic artifacts
I0731 19:58:52.480706 1091966 start.go:360] acquireMachinesLock for embed-certs-992019: {Name:mk6dfabfdd9df45c5e38a3e2fd62dbcbe20472e7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0731 19:58:52.481150 1091966 start.go:364] duration metric: took 418.337µs to acquireMachinesLock for "embed-certs-992019"
I0731 19:58:52.481190 1091966 start.go:93] Provisioning new machine with config: &{Name:embed-certs-992019 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-992019 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0731 19:58:52.481283 1091966 start.go:125] createHost starting for "" (driver="docker")
I0731 19:58:52.483444 1091966 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0731 19:58:52.483692 1091966 start.go:159] libmachine.API.Create for "embed-certs-992019" (driver="docker")
I0731 19:58:52.483738 1091966 client.go:168] LocalClient.Create starting
I0731 19:58:52.483815 1091966 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca.pem
I0731 19:58:52.483854 1091966 main.go:141] libmachine: Decoding PEM data...
I0731 19:58:52.483872 1091966 main.go:141] libmachine: Parsing certificate...
I0731 19:58:52.483934 1091966 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19356-869736/.minikube/certs/cert.pem
I0731 19:58:52.483960 1091966 main.go:141] libmachine: Decoding PEM data...
I0731 19:58:52.483998 1091966 main.go:141] libmachine: Parsing certificate...
I0731 19:58:52.484368 1091966 cli_runner.go:164] Run: docker network inspect embed-certs-992019 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0731 19:58:52.502095 1091966 cli_runner.go:211] docker network inspect embed-certs-992019 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0731 19:58:52.502173 1091966 network_create.go:284] running [docker network inspect embed-certs-992019] to gather additional debugging logs...
I0731 19:58:52.502198 1091966 cli_runner.go:164] Run: docker network inspect embed-certs-992019
W0731 19:58:52.521965 1091966 cli_runner.go:211] docker network inspect embed-certs-992019 returned with exit code 1
I0731 19:58:52.522011 1091966 network_create.go:287] error running [docker network inspect embed-certs-992019]: docker network inspect embed-certs-992019: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-992019 not found
I0731 19:58:52.522023 1091966 network_create.go:289] output of [docker network inspect embed-certs-992019]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-992019 not found
** /stderr **
I0731 19:58:52.522122 1091966 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0731 19:58:52.538041 1091966 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-dea138d4524a IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:26:fb:b2:16} reservation:<nil>}
I0731 19:58:52.538506 1091966 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-fdd9a8bd3b82 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:9a:58:dc:f2} reservation:<nil>}
I0731 19:58:52.538946 1091966 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-f44836207d08 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:df:a0:ca:2e} reservation:<nil>}
I0731 19:58:52.539636 1091966 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40018ce2e0}
I0731 19:58:52.539695 1091966 network_create.go:124] attempt to create docker network embed-certs-992019 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0731 19:58:52.539773 1091966 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-992019 embed-certs-992019
I0731 19:58:52.608009 1091966 network_create.go:108] docker network embed-certs-992019 192.168.76.0/24 created
I0731 19:58:52.608091 1091966 kic.go:121] calculated static IP "192.168.76.2" for the "embed-certs-992019" container
I0731 19:58:52.608187 1091966 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0731 19:58:52.622673 1091966 cli_runner.go:164] Run: docker volume create embed-certs-992019 --label name.minikube.sigs.k8s.io=embed-certs-992019 --label created_by.minikube.sigs.k8s.io=true
I0731 19:58:52.645429 1091966 oci.go:103] Successfully created a docker volume embed-certs-992019
I0731 19:58:52.645505 1091966 cli_runner.go:164] Run: docker run --rm --name embed-certs-992019-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-992019 --entrypoint /usr/bin/test -v embed-certs-992019:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -d /var/lib
I0731 19:58:53.265744 1091966 oci.go:107] Successfully prepared a docker volume embed-certs-992019
I0731 19:58:53.265791 1091966 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
I0731 19:58:53.265811 1091966 kic.go:194] Starting extracting preloaded images to volume ...
I0731 19:58:53.265908 1091966 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19356-869736/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-992019:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -I lz4 -xf /preloaded.tar -C /extractDir
I0731 19:58:53.521080 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:55.521184 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:58:59.128334 1091966 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19356-869736/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-992019:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -I lz4 -xf /preloaded.tar -C /extractDir: (5.862386163s)
I0731 19:58:59.128368 1091966 kic.go:203] duration metric: took 5.862553256s to extract preloaded images to volume ...
W0731 19:58:59.128518 1091966 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0731 19:58:59.128633 1091966 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0731 19:58:59.197990 1091966 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-992019 --name embed-certs-992019 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-992019 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-992019 --network embed-certs-992019 --ip 192.168.76.2 --volume embed-certs-992019:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7
I0731 19:58:59.580901 1091966 cli_runner.go:164] Run: docker container inspect embed-certs-992019 --format={{.State.Running}}
I0731 19:58:59.598541 1091966 cli_runner.go:164] Run: docker container inspect embed-certs-992019 --format={{.State.Status}}
I0731 19:58:59.617753 1091966 cli_runner.go:164] Run: docker exec embed-certs-992019 stat /var/lib/dpkg/alternatives/iptables
I0731 19:58:59.689887 1091966 oci.go:144] the created container "embed-certs-992019" has a running status.
I0731 19:58:59.689923 1091966 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19356-869736/.minikube/machines/embed-certs-992019/id_rsa...
I0731 19:59:00.661085 1091966 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19356-869736/.minikube/machines/embed-certs-992019/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0731 19:59:00.686519 1091966 cli_runner.go:164] Run: docker container inspect embed-certs-992019 --format={{.State.Status}}
I0731 19:59:00.709394 1091966 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0731 19:59:00.709414 1091966 kic_runner.go:114] Args: [docker exec --privileged embed-certs-992019 chown docker:docker /home/docker/.ssh/authorized_keys]
I0731 19:59:00.791351 1091966 cli_runner.go:164] Run: docker container inspect embed-certs-992019 --format={{.State.Status}}
I0731 19:59:00.816748 1091966 machine.go:94] provisionDockerMachine start ...
I0731 19:59:00.816837 1091966 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-992019
I0731 19:59:00.837137 1091966 main.go:141] libmachine: Using SSH client type: native
I0731 19:59:00.837437 1091966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33864 <nil> <nil>}
I0731 19:59:00.837454 1091966 main.go:141] libmachine: About to run SSH command:
hostname
I0731 19:59:00.991650 1091966 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-992019
I0731 19:59:00.991716 1091966 ubuntu.go:169] provisioning hostname "embed-certs-992019"
I0731 19:59:00.991812 1091966 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-992019
I0731 19:59:01.011547 1091966 main.go:141] libmachine: Using SSH client type: native
I0731 19:59:01.011792 1091966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33864 <nil> <nil>}
I0731 19:59:01.011803 1091966 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-992019 && echo "embed-certs-992019" | sudo tee /etc/hostname
I0731 19:59:01.164948 1091966 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-992019
I0731 19:59:01.165037 1091966 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-992019
I0731 19:59:01.189813 1091966 main.go:141] libmachine: Using SSH client type: native
I0731 19:59:01.190065 1091966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33864 <nil> <nil>}
I0731 19:59:01.190090 1091966 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-992019' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-992019/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-992019' | sudo tee -a /etc/hosts;
fi
fi
I0731 19:59:01.328662 1091966 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0731 19:59:01.328694 1091966 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19356-869736/.minikube CaCertPath:/home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19356-869736/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19356-869736/.minikube}
I0731 19:59:01.328727 1091966 ubuntu.go:177] setting up certificates
I0731 19:59:01.328741 1091966 provision.go:84] configureAuth start
I0731 19:59:01.328824 1091966 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-992019
I0731 19:59:01.351955 1091966 provision.go:143] copyHostCerts
I0731 19:59:01.352130 1091966 exec_runner.go:144] found /home/jenkins/minikube-integration/19356-869736/.minikube/ca.pem, removing ...
I0731 19:59:01.352165 1091966 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19356-869736/.minikube/ca.pem
I0731 19:59:01.352253 1091966 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19356-869736/.minikube/ca.pem (1078 bytes)
I0731 19:59:01.352355 1091966 exec_runner.go:144] found /home/jenkins/minikube-integration/19356-869736/.minikube/cert.pem, removing ...
I0731 19:59:01.352366 1091966 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19356-869736/.minikube/cert.pem
I0731 19:59:01.352394 1091966 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19356-869736/.minikube/cert.pem (1123 bytes)
I0731 19:59:01.352455 1091966 exec_runner.go:144] found /home/jenkins/minikube-integration/19356-869736/.minikube/key.pem, removing ...
I0731 19:59:01.352464 1091966 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19356-869736/.minikube/key.pem
I0731 19:59:01.352489 1091966 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19356-869736/.minikube/key.pem (1679 bytes)
I0731 19:59:01.352543 1091966 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19356-869736/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca-key.pem org=jenkins.embed-certs-992019 san=[127.0.0.1 192.168.76.2 embed-certs-992019 localhost minikube]
I0731 19:59:01.807642 1091966 provision.go:177] copyRemoteCerts
I0731 19:59:01.807767 1091966 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0731 19:59:01.807843 1091966 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-992019
I0731 19:59:01.824524 1091966 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33864 SSHKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/embed-certs-992019/id_rsa Username:docker}
I0731 19:59:01.925382 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0731 19:59:01.951444 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0731 19:59:01.978506 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0731 19:59:02.006819 1091966 provision.go:87] duration metric: took 678.054824ms to configureAuth
I0731 19:59:02.006847 1091966 ubuntu.go:193] setting minikube options for container-runtime
I0731 19:59:02.007070 1091966 config.go:182] Loaded profile config "embed-certs-992019": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0731 19:59:02.007080 1091966 machine.go:97] duration metric: took 1.190313335s to provisionDockerMachine
I0731 19:59:02.007087 1091966 client.go:171] duration metric: took 9.523340008s to LocalClient.Create
I0731 19:59:02.007105 1091966 start.go:167] duration metric: took 9.523412236s to libmachine.API.Create "embed-certs-992019"
I0731 19:59:02.007113 1091966 start.go:293] postStartSetup for "embed-certs-992019" (driver="docker")
I0731 19:59:02.007124 1091966 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0731 19:59:02.007184 1091966 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0731 19:59:02.007236 1091966 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-992019
I0731 19:59:02.028195 1091966 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33864 SSHKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/embed-certs-992019/id_rsa Username:docker}
I0731 19:59:02.125270 1091966 ssh_runner.go:195] Run: cat /etc/os-release
I0731 19:59:02.128582 1091966 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0731 19:59:02.128625 1091966 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0731 19:59:02.128637 1091966 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0731 19:59:02.128645 1091966 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0731 19:59:02.128660 1091966 filesync.go:126] Scanning /home/jenkins/minikube-integration/19356-869736/.minikube/addons for local assets ...
I0731 19:59:02.128719 1091966 filesync.go:126] Scanning /home/jenkins/minikube-integration/19356-869736/.minikube/files for local assets ...
I0731 19:59:02.128807 1091966 filesync.go:149] local asset: /home/jenkins/minikube-integration/19356-869736/.minikube/files/etc/ssl/certs/8751262.pem -> 8751262.pem in /etc/ssl/certs
I0731 19:59:02.128917 1091966 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0731 19:59:02.137816 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/files/etc/ssl/certs/8751262.pem --> /etc/ssl/certs/8751262.pem (1708 bytes)
I0731 19:58:57.528703 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:59:00.024507 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:59:02.163694 1091966 start.go:296] duration metric: took 156.560054ms for postStartSetup
I0731 19:59:02.164104 1091966 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-992019
I0731 19:59:02.180395 1091966 profile.go:143] Saving config to /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/config.json ...
I0731 19:59:02.180695 1091966 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0731 19:59:02.180749 1091966 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-992019
I0731 19:59:02.196440 1091966 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33864 SSHKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/embed-certs-992019/id_rsa Username:docker}
I0731 19:59:02.289043 1091966 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0731 19:59:02.293385 1091966 start.go:128] duration metric: took 9.812084246s to createHost
I0731 19:59:02.293408 1091966 start.go:83] releasing machines lock for "embed-certs-992019", held for 9.812239606s
I0731 19:59:02.293498 1091966 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-992019
I0731 19:59:02.310561 1091966 ssh_runner.go:195] Run: cat /version.json
I0731 19:59:02.310579 1091966 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0731 19:59:02.310617 1091966 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-992019
I0731 19:59:02.310636 1091966 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-992019
I0731 19:59:02.329854 1091966 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33864 SSHKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/embed-certs-992019/id_rsa Username:docker}
I0731 19:59:02.337701 1091966 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33864 SSHKeyPath:/home/jenkins/minikube-integration/19356-869736/.minikube/machines/embed-certs-992019/id_rsa Username:docker}
I0731 19:59:02.419310 1091966 ssh_runner.go:195] Run: systemctl --version
I0731 19:59:02.549766 1091966 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0731 19:59:02.554716 1091966 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0731 19:59:02.580411 1091966 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0731 19:59:02.580488 1091966 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0731 19:59:02.608784 1091966 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0731 19:59:02.608805 1091966 start.go:495] detecting cgroup driver to use...
I0731 19:59:02.608837 1091966 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0731 19:59:02.608891 1091966 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0731 19:59:02.621206 1091966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0731 19:59:02.632529 1091966 docker.go:217] disabling cri-docker service (if available) ...
I0731 19:59:02.632589 1091966 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0731 19:59:02.646270 1091966 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0731 19:59:02.660981 1091966 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0731 19:59:02.754582 1091966 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0731 19:59:02.867072 1091966 docker.go:233] disabling docker service ...
I0731 19:59:02.867182 1091966 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0731 19:59:02.899666 1091966 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0731 19:59:02.912448 1091966 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0731 19:59:03.012731 1091966 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0731 19:59:03.110316 1091966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0731 19:59:03.122406 1091966 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0731 19:59:03.140309 1091966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0731 19:59:03.151661 1091966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0731 19:59:03.162606 1091966 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0731 19:59:03.162704 1091966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0731 19:59:03.173048 1091966 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0731 19:59:03.183479 1091966 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0731 19:59:03.193843 1091966 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0731 19:59:03.204016 1091966 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0731 19:59:03.213696 1091966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0731 19:59:03.223828 1091966 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0731 19:59:03.233675 1091966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0731 19:59:03.243769 1091966 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0731 19:59:03.253290 1091966 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0731 19:59:03.263499 1091966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 19:59:03.350184 1091966 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0731 19:59:03.494310 1091966 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0731 19:59:03.494426 1091966 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0731 19:59:03.498766 1091966 start.go:563] Will wait 60s for crictl version
I0731 19:59:03.498871 1091966 ssh_runner.go:195] Run: which crictl
I0731 19:59:03.502288 1091966 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0731 19:59:03.549237 1091966 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.19
RuntimeApiVersion: v1
I0731 19:59:03.549355 1091966 ssh_runner.go:195] Run: containerd --version
I0731 19:59:03.572463 1091966 ssh_runner.go:195] Run: containerd --version
I0731 19:59:03.600082 1091966 out.go:177] * Preparing Kubernetes v1.30.3 on containerd 1.7.19 ...
I0731 19:59:03.601942 1091966 cli_runner.go:164] Run: docker network inspect embed-certs-992019 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0731 19:59:03.617015 1091966 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0731 19:59:03.620477 1091966 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0731 19:59:03.631481 1091966 kubeadm.go:883] updating cluster {Name:embed-certs-992019 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-992019 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0731 19:59:03.631620 1091966 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
I0731 19:59:03.631685 1091966 ssh_runner.go:195] Run: sudo crictl images --output json
I0731 19:59:03.679667 1091966 containerd.go:627] all images are preloaded for containerd runtime.
I0731 19:59:03.679692 1091966 containerd.go:534] Images already preloaded, skipping extraction
I0731 19:59:03.679755 1091966 ssh_runner.go:195] Run: sudo crictl images --output json
I0731 19:59:03.716204 1091966 containerd.go:627] all images are preloaded for containerd runtime.
I0731 19:59:03.716229 1091966 cache_images.go:84] Images are preloaded, skipping loading
I0731 19:59:03.716239 1091966 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.30.3 containerd true true} ...
I0731 19:59:03.716380 1091966 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-992019 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.30.3 ClusterName:embed-certs-992019 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0731 19:59:03.716451 1091966 ssh_runner.go:195] Run: sudo crictl info
I0731 19:59:03.753934 1091966 cni.go:84] Creating CNI manager for ""
I0731 19:59:03.753955 1091966 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0731 19:59:03.753964 1091966 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0731 19:59:03.754020 1091966 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-992019 NodeName:embed-certs-992019 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0731 19:59:03.754164 1091966 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "embed-certs-992019"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.3
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0731 19:59:03.754236 1091966 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3
I0731 19:59:03.763135 1091966 binaries.go:44] Found k8s binaries, skipping transfer
I0731 19:59:03.763204 1091966 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0731 19:59:03.772085 1091966 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
I0731 19:59:03.791260 1091966 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0731 19:59:03.809880 1091966 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes)
I0731 19:59:03.828256 1091966 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0731 19:59:03.831726 1091966 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0731 19:59:03.842508 1091966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 19:59:03.932407 1091966 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0731 19:59:03.948504 1091966 certs.go:68] Setting up /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019 for IP: 192.168.76.2
I0731 19:59:03.948523 1091966 certs.go:194] generating shared ca certs ...
I0731 19:59:03.948540 1091966 certs.go:226] acquiring lock for ca certs: {Name:mkbe8972b65e866e00919db4c1d4ac947f84a312 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 19:59:03.948721 1091966 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19356-869736/.minikube/ca.key
I0731 19:59:03.948793 1091966 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19356-869736/.minikube/proxy-client-ca.key
I0731 19:59:03.948807 1091966 certs.go:256] generating profile certs ...
I0731 19:59:03.948880 1091966 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/client.key
I0731 19:59:03.948898 1091966 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/client.crt with IP's: []
I0731 19:59:04.514396 1091966 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/client.crt ...
I0731 19:59:04.514431 1091966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/client.crt: {Name:mk91bae16422a5ba0dee1f86fd2eb6792dfb4af3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 19:59:04.515150 1091966 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/client.key ...
I0731 19:59:04.515173 1091966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/client.key: {Name:mk47dd3f2c2daa0e7e7db7db87206ea176d2e1c8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 19:59:04.516034 1091966 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/apiserver.key.efc90e7a
I0731 19:59:04.516102 1091966 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/apiserver.crt.efc90e7a with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.76.2]
I0731 19:59:04.730037 1091966 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/apiserver.crt.efc90e7a ...
I0731 19:59:04.730069 1091966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/apiserver.crt.efc90e7a: {Name:mk0695843b6680e76e53edca8f3aec17ecb249c5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 19:59:04.730265 1091966 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/apiserver.key.efc90e7a ...
I0731 19:59:04.730281 1091966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/apiserver.key.efc90e7a: {Name:mk3f6b865aeb08e5f133892f3c6d0f193d926ad7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 19:59:04.730807 1091966 certs.go:381] copying /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/apiserver.crt.efc90e7a -> /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/apiserver.crt
I0731 19:59:04.730907 1091966 certs.go:385] copying /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/apiserver.key.efc90e7a -> /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/apiserver.key
I0731 19:59:04.730982 1091966 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/proxy-client.key
I0731 19:59:04.731005 1091966 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/proxy-client.crt with IP's: []
I0731 19:59:05.074602 1091966 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/proxy-client.crt ...
I0731 19:59:05.074640 1091966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/proxy-client.crt: {Name:mk63001ecbbb2337dbf521c124a47c4b59ec01ae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 19:59:05.075426 1091966 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/proxy-client.key ...
I0731 19:59:05.075463 1091966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/proxy-client.key: {Name:mk80a4b2009d98f135d568a9e94760c1c52ec735 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 19:59:05.076117 1091966 certs.go:484] found cert: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/875126.pem (1338 bytes)
W0731 19:59:05.076182 1091966 certs.go:480] ignoring /home/jenkins/minikube-integration/19356-869736/.minikube/certs/875126_empty.pem, impossibly tiny 0 bytes
I0731 19:59:05.076192 1091966 certs.go:484] found cert: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca-key.pem (1679 bytes)
I0731 19:59:05.076230 1091966 certs.go:484] found cert: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/ca.pem (1078 bytes)
I0731 19:59:05.076261 1091966 certs.go:484] found cert: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/cert.pem (1123 bytes)
I0731 19:59:05.076302 1091966 certs.go:484] found cert: /home/jenkins/minikube-integration/19356-869736/.minikube/certs/key.pem (1679 bytes)
I0731 19:59:05.076361 1091966 certs.go:484] found cert: /home/jenkins/minikube-integration/19356-869736/.minikube/files/etc/ssl/certs/8751262.pem (1708 bytes)
I0731 19:59:05.077013 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0731 19:59:05.108861 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0731 19:59:05.138817 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0731 19:59:05.167619 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0731 19:59:05.194964 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0731 19:59:05.220889 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0731 19:59:05.247608 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0731 19:59:05.275187 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/profiles/embed-certs-992019/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1671 bytes)
I0731 19:59:05.306475 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/certs/875126.pem --> /usr/share/ca-certificates/875126.pem (1338 bytes)
I0731 19:59:05.333159 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/files/etc/ssl/certs/8751262.pem --> /usr/share/ca-certificates/8751262.pem (1708 bytes)
I0731 19:59:05.358754 1091966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19356-869736/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0731 19:59:05.385077 1091966 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0731 19:59:05.405941 1091966 ssh_runner.go:195] Run: openssl version
I0731 19:59:05.412442 1091966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/875126.pem && ln -fs /usr/share/ca-certificates/875126.pem /etc/ssl/certs/875126.pem"
I0731 19:59:05.424880 1091966 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/875126.pem
I0731 19:59:05.429148 1091966 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 31 19:13 /usr/share/ca-certificates/875126.pem
I0731 19:59:05.429219 1091966 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/875126.pem
I0731 19:59:05.438140 1091966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/875126.pem /etc/ssl/certs/51391683.0"
I0731 19:59:05.448530 1091966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8751262.pem && ln -fs /usr/share/ca-certificates/8751262.pem /etc/ssl/certs/8751262.pem"
I0731 19:59:05.459653 1091966 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8751262.pem
I0731 19:59:05.463840 1091966 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 31 19:13 /usr/share/ca-certificates/8751262.pem
I0731 19:59:05.463910 1091966 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8751262.pem
I0731 19:59:05.471501 1091966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8751262.pem /etc/ssl/certs/3ec20f2e.0"
I0731 19:59:05.481331 1091966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0731 19:59:05.492481 1091966 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0731 19:59:05.496906 1091966 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 31 19:03 /usr/share/ca-certificates/minikubeCA.pem
I0731 19:59:05.496968 1091966 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0731 19:59:05.505741 1091966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0731 19:59:05.519393 1091966 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0731 19:59:05.523609 1091966 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0731 19:59:05.523671 1091966 kubeadm.go:392] StartCluster: {Name:embed-certs-992019 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-992019 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fal
se CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0731 19:59:05.523751 1091966 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0731 19:59:05.523825 1091966 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0731 19:59:05.588538 1091966 cri.go:89] found id: ""
I0731 19:59:05.588673 1091966 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0731 19:59:05.605158 1091966 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0731 19:59:05.628438 1091966 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0731 19:59:05.628557 1091966 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0731 19:59:05.640486 1091966 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0731 19:59:05.640560 1091966 kubeadm.go:157] found existing configuration files:
I0731 19:59:05.640651 1091966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0731 19:59:05.665210 1091966 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0731 19:59:05.665350 1091966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0731 19:59:05.686374 1091966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0731 19:59:05.695366 1091966 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0731 19:59:05.695498 1091966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0731 19:59:05.705325 1091966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0731 19:59:05.714576 1091966 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0731 19:59:05.714692 1091966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0731 19:59:05.735500 1091966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0731 19:59:05.749284 1091966 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0731 19:59:05.749348 1091966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0731 19:59:05.764449 1091966 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0731 19:59:05.820282 1091966 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3
I0731 19:59:05.820346 1091966 kubeadm.go:310] [preflight] Running pre-flight checks
I0731 19:59:05.911852 1091966 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0731 19:59:05.911920 1091966 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1066-aws[0m
I0731 19:59:05.911954 1091966 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0731 19:59:05.912008 1091966 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0731 19:59:05.912056 1091966 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0731 19:59:05.912101 1091966 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0731 19:59:05.912147 1091966 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0731 19:59:05.912194 1091966 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0731 19:59:05.912241 1091966 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0731 19:59:05.912284 1091966 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0731 19:59:05.912330 1091966 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0731 19:59:05.912374 1091966 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0731 19:59:06.010820 1091966 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0731 19:59:06.010943 1091966 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0731 19:59:06.011035 1091966 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0731 19:59:06.349043 1091966 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0731 19:59:06.351905 1091966 out.go:204] - Generating certificates and keys ...
I0731 19:59:06.352014 1091966 kubeadm.go:310] [certs] Using existing ca certificate authority
I0731 19:59:06.352081 1091966 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0731 19:59:02.520251 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:59:04.521311 1082506 pod_ready.go:102] pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace has status "Ready":"False"
I0731 19:59:05.022474 1082506 pod_ready.go:81] duration metric: took 4m0.008595809s for pod "metrics-server-9975d5f86-kfslp" in "kube-system" namespace to be "Ready" ...
E0731 19:59:05.022503 1082506 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0731 19:59:05.022512 1082506 pod_ready.go:38] duration metric: took 5m18.595572288s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0731 19:59:05.022526 1082506 api_server.go:52] waiting for apiserver process to appear ...
I0731 19:59:05.022557 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0731 19:59:05.022628 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0731 19:59:05.067499 1082506 cri.go:89] found id: "01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb"
I0731 19:59:05.067518 1082506 cri.go:89] found id: "e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691"
I0731 19:59:05.067523 1082506 cri.go:89] found id: ""
I0731 19:59:05.067530 1082506 logs.go:276] 2 containers: [01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691]
I0731 19:59:05.067588 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.071675 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.075774 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0731 19:59:05.075847 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0731 19:59:05.156855 1082506 cri.go:89] found id: "7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8"
I0731 19:59:05.156874 1082506 cri.go:89] found id: "efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc"
I0731 19:59:05.156878 1082506 cri.go:89] found id: ""
I0731 19:59:05.156885 1082506 logs.go:276] 2 containers: [7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8 efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc]
I0731 19:59:05.156941 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.161462 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.166177 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0731 19:59:05.166245 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0731 19:59:05.221663 1082506 cri.go:89] found id: "d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e"
I0731 19:59:05.221680 1082506 cri.go:89] found id: "bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046"
I0731 19:59:05.221685 1082506 cri.go:89] found id: ""
I0731 19:59:05.221691 1082506 logs.go:276] 2 containers: [d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046]
I0731 19:59:05.221754 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.225845 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.231004 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0731 19:59:05.231135 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0731 19:59:05.287518 1082506 cri.go:89] found id: "5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983"
I0731 19:59:05.287551 1082506 cri.go:89] found id: "58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d"
I0731 19:59:05.287557 1082506 cri.go:89] found id: ""
I0731 19:59:05.287564 1082506 logs.go:276] 2 containers: [5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983 58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d]
I0731 19:59:05.287636 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.291755 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.295567 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0731 19:59:05.295665 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0731 19:59:05.354786 1082506 cri.go:89] found id: "c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51"
I0731 19:59:05.354858 1082506 cri.go:89] found id: "9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f"
I0731 19:59:05.354875 1082506 cri.go:89] found id: ""
I0731 19:59:05.354895 1082506 logs.go:276] 2 containers: [c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51 9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f]
I0731 19:59:05.354972 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.371718 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.376095 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0731 19:59:05.376204 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0731 19:59:05.431441 1082506 cri.go:89] found id: "82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513"
I0731 19:59:05.431506 1082506 cri.go:89] found id: "687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf"
I0731 19:59:05.431523 1082506 cri.go:89] found id: ""
I0731 19:59:05.431544 1082506 logs.go:276] 2 containers: [82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513 687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf]
I0731 19:59:05.431648 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.435719 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.439948 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0731 19:59:05.440062 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0731 19:59:05.489676 1082506 cri.go:89] found id: "fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54"
I0731 19:59:05.489745 1082506 cri.go:89] found id: "58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd"
I0731 19:59:05.489763 1082506 cri.go:89] found id: ""
I0731 19:59:05.489784 1082506 logs.go:276] 2 containers: [fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54 58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd]
I0731 19:59:05.489860 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.494637 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.498880 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0731 19:59:05.498982 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0731 19:59:05.560427 1082506 cri.go:89] found id: "72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74"
I0731 19:59:05.560499 1082506 cri.go:89] found id: "d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d"
I0731 19:59:05.560516 1082506 cri.go:89] found id: ""
I0731 19:59:05.560536 1082506 logs.go:276] 2 containers: [72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74 d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d]
I0731 19:59:05.560619 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.564346 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.570278 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0731 19:59:05.570365 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0731 19:59:05.645984 1082506 cri.go:89] found id: "3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb"
I0731 19:59:05.646013 1082506 cri.go:89] found id: ""
I0731 19:59:05.646022 1082506 logs.go:276] 1 containers: [3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb]
I0731 19:59:05.646093 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:05.650106 1082506 logs.go:123] Gathering logs for kube-controller-manager [82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513] ...
I0731 19:59:05.650176 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513"
I0731 19:59:05.743927 1082506 logs.go:123] Gathering logs for storage-provisioner [d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d] ...
I0731 19:59:05.744033 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d"
I0731 19:59:05.801342 1082506 logs.go:123] Gathering logs for kubernetes-dashboard [3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb] ...
I0731 19:59:05.801417 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb"
I0731 19:59:05.851853 1082506 logs.go:123] Gathering logs for kubelet ...
I0731 19:59:05.851933 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0731 19:59:05.903952 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326038 660 reflector.go:138] object-"kube-system"/"coredns-token-gj262": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-gj262" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.905276 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326155 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.905558 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326225 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-lplc7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-lplc7" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.905809 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326285 660 reflector.go:138] object-"default"/"default-token-6f6s5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-6f6s5" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.906038 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326362 660 reflector.go:138] object-"kube-system"/"metrics-server-token-psb75": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-psb75" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.909799 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.502566 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-mkbf8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-mkbf8" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.910015 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.502668 660 reflector.go:138] object-"kube-system"/"kindnet-token-vgl5d": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-vgl5d" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.910223 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.502755 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:05.917275 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:47 old-k8s-version-999319 kubelet[660]: E0731 19:53:47.779236 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:05.917817 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:47 old-k8s-version-999319 kubelet[660]: E0731 19:53:47.853186 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.925569 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:59 old-k8s-version-999319 kubelet[660]: E0731 19:53:59.662479 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:05.927294 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:12 old-k8s-version-999319 kubelet[660]: E0731 19:54:12.651399 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.928128 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:19 old-k8s-version-999319 kubelet[660]: E0731 19:54:19.033897 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.928588 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:20 old-k8s-version-999319 kubelet[660]: E0731 19:54:20.059133 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.931053 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:24 old-k8s-version-999319 kubelet[660]: E0731 19:54:24.660795 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:05.931387 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:27 old-k8s-version-999319 kubelet[660]: E0731 19:54:27.144378 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.931918 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:39 old-k8s-version-999319 kubelet[660]: E0731 19:54:39.652527 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.935474 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:41 old-k8s-version-999319 kubelet[660]: E0731 19:54:41.099787 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.935861 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:47 old-k8s-version-999319 kubelet[660]: E0731 19:54:47.145251 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.936102 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:50 old-k8s-version-999319 kubelet[660]: E0731 19:54:50.651415 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.936467 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:00 old-k8s-version-999319 kubelet[660]: E0731 19:55:00.651577 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.938923 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:05 old-k8s-version-999319 kubelet[660]: E0731 19:55:05.661609 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:05.939584 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:13 old-k8s-version-999319 kubelet[660]: E0731 19:55:13.193809 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.939915 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:17 old-k8s-version-999319 kubelet[660]: E0731 19:55:17.143615 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.940104 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:19 old-k8s-version-999319 kubelet[660]: E0731 19:55:19.655910 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.940431 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:30 old-k8s-version-999319 kubelet[660]: E0731 19:55:30.651529 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.940618 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:30 old-k8s-version-999319 kubelet[660]: E0731 19:55:30.652416 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.940941 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:45 old-k8s-version-999319 kubelet[660]: E0731 19:55:45.654062 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.941123 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:45 old-k8s-version-999319 kubelet[660]: E0731 19:55:45.656760 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.941714 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:58 old-k8s-version-999319 kubelet[660]: E0731 19:55:58.303877 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.941898 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:59 old-k8s-version-999319 kubelet[660]: E0731 19:55:59.651595 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.942221 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:07 old-k8s-version-999319 kubelet[660]: E0731 19:56:07.143590 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.942400 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:12 old-k8s-version-999319 kubelet[660]: E0731 19:56:12.651197 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.942728 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:18 old-k8s-version-999319 kubelet[660]: E0731 19:56:18.650980 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.942910 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:25 old-k8s-version-999319 kubelet[660]: E0731 19:56:25.651335 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.943234 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:33 old-k8s-version-999319 kubelet[660]: E0731 19:56:33.652433 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.945847 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:39 old-k8s-version-999319 kubelet[660]: E0731 19:56:39.670766 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:05.946261 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:48 old-k8s-version-999319 kubelet[660]: E0731 19:56:48.650963 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.946476 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:52 old-k8s-version-999319 kubelet[660]: E0731 19:56:52.651443 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.946870 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:02 old-k8s-version-999319 kubelet[660]: E0731 19:57:02.650941 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.947083 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:05 old-k8s-version-999319 kubelet[660]: E0731 19:57:05.651361 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.947455 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:13 old-k8s-version-999319 kubelet[660]: E0731 19:57:13.651436 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.947676 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:20 old-k8s-version-999319 kubelet[660]: E0731 19:57:20.651249 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.948365 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:27 old-k8s-version-999319 kubelet[660]: E0731 19:57:27.526272 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.948582 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:31 old-k8s-version-999319 kubelet[660]: E0731 19:57:31.652529 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.948933 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:37 old-k8s-version-999319 kubelet[660]: E0731 19:57:37.143623 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.949139 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:43 old-k8s-version-999319 kubelet[660]: E0731 19:57:43.653235 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.949584 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:50 old-k8s-version-999319 kubelet[660]: E0731 19:57:50.650903 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.949812 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:57 old-k8s-version-999319 kubelet[660]: E0731 19:57:57.652175 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.950165 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:02 old-k8s-version-999319 kubelet[660]: E0731 19:58:02.650971 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.950387 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:08 old-k8s-version-999319 kubelet[660]: E0731 19:58:08.651308 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.950745 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:15 old-k8s-version-999319 kubelet[660]: E0731 19:58:15.651144 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.950954 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:21 old-k8s-version-999319 kubelet[660]: E0731 19:58:21.651270 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.951352 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:29 old-k8s-version-999319 kubelet[660]: E0731 19:58:29.651437 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.951583 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:36 old-k8s-version-999319 kubelet[660]: E0731 19:58:36.651450 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.951997 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:42 old-k8s-version-999319 kubelet[660]: E0731 19:58:42.650974 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.952210 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:47 old-k8s-version-999319 kubelet[660]: E0731 19:58:47.652087 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:05.952572 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:57 old-k8s-version-999319 kubelet[660]: E0731 19:58:57.651908 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:05.952788 1082506 logs.go:138] Found kubelet problem: Jul 31 19:59:01 old-k8s-version-999319 kubelet[660]: E0731 19:59:01.651281 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 19:59:05.952812 1082506 logs.go:123] Gathering logs for dmesg ...
I0731 19:59:05.952839 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0731 19:59:05.972054 1082506 logs.go:123] Gathering logs for coredns [d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e] ...
I0731 19:59:05.972132 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e"
I0731 19:59:06.019377 1082506 logs.go:123] Gathering logs for kube-scheduler [58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d] ...
I0731 19:59:06.019411 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d"
I0731 19:59:06.076074 1082506 logs.go:123] Gathering logs for etcd [efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc] ...
I0731 19:59:06.076109 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc"
I0731 19:59:06.133660 1082506 logs.go:123] Gathering logs for container status ...
I0731 19:59:06.133741 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0731 19:59:06.209391 1082506 logs.go:123] Gathering logs for describe nodes ...
I0731 19:59:06.209469 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0731 19:59:06.463171 1082506 logs.go:123] Gathering logs for kube-controller-manager [687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf] ...
I0731 19:59:06.463203 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf"
I0731 19:59:06.557924 1082506 logs.go:123] Gathering logs for kindnet [58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd] ...
I0731 19:59:06.558001 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd"
I0731 19:59:06.618940 1082506 logs.go:123] Gathering logs for containerd ...
I0731 19:59:06.619017 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0731 19:59:06.698602 1082506 logs.go:123] Gathering logs for kube-scheduler [5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983] ...
I0731 19:59:06.698642 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983"
I0731 19:59:06.745241 1082506 logs.go:123] Gathering logs for kube-proxy [c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51] ...
I0731 19:59:06.745274 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51"
I0731 19:59:06.802039 1082506 logs.go:123] Gathering logs for kube-proxy [9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f] ...
I0731 19:59:06.802071 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f"
I0731 19:59:06.867340 1082506 logs.go:123] Gathering logs for kindnet [fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54] ...
I0731 19:59:06.867373 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54"
I0731 19:59:06.935195 1082506 logs.go:123] Gathering logs for kube-apiserver [01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb] ...
I0731 19:59:06.935231 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb"
I0731 19:59:07.007752 1082506 logs.go:123] Gathering logs for kube-apiserver [e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691] ...
I0731 19:59:07.007794 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691"
I0731 19:59:07.088963 1082506 logs.go:123] Gathering logs for etcd [7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8] ...
I0731 19:59:07.089004 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8"
I0731 19:59:07.188274 1082506 logs.go:123] Gathering logs for coredns [bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046] ...
I0731 19:59:07.188305 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046"
I0731 19:59:07.245432 1082506 logs.go:123] Gathering logs for storage-provisioner [72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74] ...
I0731 19:59:07.245468 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74"
I0731 19:59:07.296429 1082506 out.go:304] Setting ErrFile to fd 2...
I0731 19:59:07.296461 1082506 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0731 19:59:07.296539 1082506 out.go:239] X Problems detected in kubelet:
W0731 19:59:07.296553 1082506 out.go:239] Jul 31 19:58:36 old-k8s-version-999319 kubelet[660]: E0731 19:58:36.651450 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:07.296562 1082506 out.go:239] Jul 31 19:58:42 old-k8s-version-999319 kubelet[660]: E0731 19:58:42.650974 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:07.296590 1082506 out.go:239] Jul 31 19:58:47 old-k8s-version-999319 kubelet[660]: E0731 19:58:47.652087 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:07.296606 1082506 out.go:239] Jul 31 19:58:57 old-k8s-version-999319 kubelet[660]: E0731 19:58:57.651908 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:07.296633 1082506 out.go:239] Jul 31 19:59:01 old-k8s-version-999319 kubelet[660]: E0731 19:59:01.651281 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 19:59:07.296640 1082506 out.go:304] Setting ErrFile to fd 2...
I0731 19:59:07.296660 1082506 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 19:59:07.176213 1091966 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0731 19:59:07.923942 1091966 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0731 19:59:08.209998 1091966 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0731 19:59:08.581388 1091966 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0731 19:59:09.006287 1091966 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0731 19:59:09.007035 1091966 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [embed-certs-992019 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0731 19:59:10.281622 1091966 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0731 19:59:10.281785 1091966 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [embed-certs-992019 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0731 19:59:10.467954 1091966 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0731 19:59:11.334185 1091966 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0731 19:59:11.793119 1091966 kubeadm.go:310] [certs] Generating "sa" key and public key
I0731 19:59:11.793397 1091966 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0731 19:59:12.273073 1091966 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0731 19:59:13.715420 1091966 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0731 19:59:14.593908 1091966 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0731 19:59:15.297197 1091966 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0731 19:59:15.842443 1091966 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0731 19:59:15.843385 1091966 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0731 19:59:15.846279 1091966 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0731 19:59:15.848407 1091966 out.go:204] - Booting up control plane ...
I0731 19:59:15.848507 1091966 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0731 19:59:15.848583 1091966 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0731 19:59:15.849840 1091966 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0731 19:59:15.864021 1091966 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0731 19:59:15.865147 1091966 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0731 19:59:15.865197 1091966 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0731 19:59:15.970271 1091966 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0731 19:59:15.970359 1091966 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
I0731 19:59:17.298728 1082506 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0731 19:59:17.310556 1082506 api_server.go:72] duration metric: took 5m47.661794382s to wait for apiserver process to appear ...
I0731 19:59:17.310582 1082506 api_server.go:88] waiting for apiserver healthz status ...
I0731 19:59:17.310616 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0731 19:59:17.310675 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0731 19:59:17.349686 1082506 cri.go:89] found id: "01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb"
I0731 19:59:17.349707 1082506 cri.go:89] found id: "e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691"
I0731 19:59:17.349712 1082506 cri.go:89] found id: ""
I0731 19:59:17.349719 1082506 logs.go:276] 2 containers: [01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691]
I0731 19:59:17.349775 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.353277 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.356636 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0731 19:59:17.356704 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0731 19:59:17.395690 1082506 cri.go:89] found id: "7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8"
I0731 19:59:17.395711 1082506 cri.go:89] found id: "efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc"
I0731 19:59:17.395716 1082506 cri.go:89] found id: ""
I0731 19:59:17.395723 1082506 logs.go:276] 2 containers: [7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8 efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc]
I0731 19:59:17.395780 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.399272 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.402692 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0731 19:59:17.402760 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0731 19:59:17.449904 1082506 cri.go:89] found id: "d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e"
I0731 19:59:17.449928 1082506 cri.go:89] found id: "bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046"
I0731 19:59:17.449932 1082506 cri.go:89] found id: ""
I0731 19:59:17.449939 1082506 logs.go:276] 2 containers: [d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046]
I0731 19:59:17.450007 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.458521 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.462154 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0731 19:59:17.462238 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0731 19:59:17.471777 1091966 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.501623402s
I0731 19:59:17.471863 1091966 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0731 19:59:17.519204 1082506 cri.go:89] found id: "5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983"
I0731 19:59:17.519265 1082506 cri.go:89] found id: "58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d"
I0731 19:59:17.519270 1082506 cri.go:89] found id: ""
I0731 19:59:17.519277 1082506 logs.go:276] 2 containers: [5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983 58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d]
I0731 19:59:17.519351 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.523225 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.528493 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0731 19:59:17.528588 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0731 19:59:17.606126 1082506 cri.go:89] found id: "c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51"
I0731 19:59:17.606160 1082506 cri.go:89] found id: "9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f"
I0731 19:59:17.606168 1082506 cri.go:89] found id: ""
I0731 19:59:17.606181 1082506 logs.go:276] 2 containers: [c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51 9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f]
I0731 19:59:17.606260 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.610898 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.616822 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0731 19:59:17.616915 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0731 19:59:17.713124 1082506 cri.go:89] found id: "82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513"
I0731 19:59:17.713159 1082506 cri.go:89] found id: "687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf"
I0731 19:59:17.713165 1082506 cri.go:89] found id: ""
I0731 19:59:17.713172 1082506 logs.go:276] 2 containers: [82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513 687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf]
I0731 19:59:17.713235 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.721102 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.725802 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0731 19:59:17.725890 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0731 19:59:17.801302 1082506 cri.go:89] found id: "fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54"
I0731 19:59:17.801330 1082506 cri.go:89] found id: "58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd"
I0731 19:59:17.801334 1082506 cri.go:89] found id: ""
I0731 19:59:17.801350 1082506 logs.go:276] 2 containers: [fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54 58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd]
I0731 19:59:17.801431 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.808124 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.812836 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0731 19:59:17.812933 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0731 19:59:17.913160 1082506 cri.go:89] found id: "3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb"
I0731 19:59:17.913183 1082506 cri.go:89] found id: ""
I0731 19:59:17.913191 1082506 logs.go:276] 1 containers: [3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb]
I0731 19:59:17.913259 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:17.922904 1082506 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0731 19:59:17.922992 1082506 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0731 19:59:18.003697 1082506 cri.go:89] found id: "72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74"
I0731 19:59:18.003777 1082506 cri.go:89] found id: "d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d"
I0731 19:59:18.003796 1082506 cri.go:89] found id: ""
I0731 19:59:18.003814 1082506 logs.go:276] 2 containers: [72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74 d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d]
I0731 19:59:18.003909 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:18.013469 1082506 ssh_runner.go:195] Run: which crictl
I0731 19:59:18.020306 1082506 logs.go:123] Gathering logs for kube-apiserver [e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691] ...
I0731 19:59:18.020387 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691"
I0731 19:59:18.103786 1082506 logs.go:123] Gathering logs for kube-proxy [c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51] ...
I0731 19:59:18.103864 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51"
I0731 19:59:18.172697 1082506 logs.go:123] Gathering logs for kube-controller-manager [687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf] ...
I0731 19:59:18.172723 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf"
I0731 19:59:18.257038 1082506 logs.go:123] Gathering logs for kindnet [fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54] ...
I0731 19:59:18.257117 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54"
I0731 19:59:18.353221 1082506 logs.go:123] Gathering logs for containerd ...
I0731 19:59:18.353304 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0731 19:59:18.426034 1082506 logs.go:123] Gathering logs for kubernetes-dashboard [3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb] ...
I0731 19:59:18.426117 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb"
I0731 19:59:18.509031 1082506 logs.go:123] Gathering logs for storage-provisioner [d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d] ...
I0731 19:59:18.509116 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d"
I0731 19:59:18.555693 1082506 logs.go:123] Gathering logs for dmesg ...
I0731 19:59:18.555766 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0731 19:59:18.576469 1082506 logs.go:123] Gathering logs for describe nodes ...
I0731 19:59:18.576548 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0731 19:59:18.754875 1082506 logs.go:123] Gathering logs for etcd [7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8] ...
I0731 19:59:18.754946 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8"
I0731 19:59:18.820148 1082506 logs.go:123] Gathering logs for coredns [bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046] ...
I0731 19:59:18.820216 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046"
I0731 19:59:18.866915 1082506 logs.go:123] Gathering logs for kube-scheduler [58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d] ...
I0731 19:59:18.866987 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d"
I0731 19:59:18.998393 1082506 logs.go:123] Gathering logs for kube-controller-manager [82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513] ...
I0731 19:59:18.998463 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513"
I0731 19:59:19.167570 1082506 logs.go:123] Gathering logs for kubelet ...
I0731 19:59:19.167652 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0731 19:59:19.255787 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326038 660 reflector.go:138] object-"kube-system"/"coredns-token-gj262": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-gj262" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.256083 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326155 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.256338 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326225 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-lplc7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-lplc7" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.256573 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326285 660 reflector.go:138] object-"default"/"default-token-6f6s5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-6f6s5" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.256815 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.326362 660 reflector.go:138] object-"kube-system"/"metrics-server-token-psb75": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-psb75" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.260559 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.502566 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-mkbf8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-mkbf8" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.262033 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.502668 660 reflector.go:138] object-"kube-system"/"kindnet-token-vgl5d": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-vgl5d" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.262272 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:46 old-k8s-version-999319 kubelet[660]: E0731 19:53:46.502755 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-999319" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-999319' and this object
W0731 19:59:19.269280 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:47 old-k8s-version-999319 kubelet[660]: E0731 19:53:47.779236 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:19.269942 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:47 old-k8s-version-999319 kubelet[660]: E0731 19:53:47.853186 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.273727 1082506 logs.go:138] Found kubelet problem: Jul 31 19:53:59 old-k8s-version-999319 kubelet[660]: E0731 19:53:59.662479 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:19.275635 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:12 old-k8s-version-999319 kubelet[660]: E0731 19:54:12.651399 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.276477 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:19 old-k8s-version-999319 kubelet[660]: E0731 19:54:19.033897 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.276962 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:20 old-k8s-version-999319 kubelet[660]: E0731 19:54:20.059133 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.279671 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:24 old-k8s-version-999319 kubelet[660]: E0731 19:54:24.660795 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:19.280045 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:27 old-k8s-version-999319 kubelet[660]: E0731 19:54:27.144378 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.280588 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:39 old-k8s-version-999319 kubelet[660]: E0731 19:54:39.652527 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.281203 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:41 old-k8s-version-999319 kubelet[660]: E0731 19:54:41.099787 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.281557 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:47 old-k8s-version-999319 kubelet[660]: E0731 19:54:47.145251 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.281767 1082506 logs.go:138] Found kubelet problem: Jul 31 19:54:50 old-k8s-version-999319 kubelet[660]: E0731 19:54:50.651415 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.282120 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:00 old-k8s-version-999319 kubelet[660]: E0731 19:55:00.651577 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.284689 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:05 old-k8s-version-999319 kubelet[660]: E0731 19:55:05.661609 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:19.285312 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:13 old-k8s-version-999319 kubelet[660]: E0731 19:55:13.193809 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.285682 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:17 old-k8s-version-999319 kubelet[660]: E0731 19:55:17.143615 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.285890 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:19 old-k8s-version-999319 kubelet[660]: E0731 19:55:19.655910 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.286243 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:30 old-k8s-version-999319 kubelet[660]: E0731 19:55:30.651529 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.286449 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:30 old-k8s-version-999319 kubelet[660]: E0731 19:55:30.652416 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.286802 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:45 old-k8s-version-999319 kubelet[660]: E0731 19:55:45.654062 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.287008 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:45 old-k8s-version-999319 kubelet[660]: E0731 19:55:45.656760 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.287621 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:58 old-k8s-version-999319 kubelet[660]: E0731 19:55:58.303877 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.287831 1082506 logs.go:138] Found kubelet problem: Jul 31 19:55:59 old-k8s-version-999319 kubelet[660]: E0731 19:55:59.651595 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.288188 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:07 old-k8s-version-999319 kubelet[660]: E0731 19:56:07.143590 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.288433 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:12 old-k8s-version-999319 kubelet[660]: E0731 19:56:12.651197 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.288765 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:18 old-k8s-version-999319 kubelet[660]: E0731 19:56:18.650980 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.288948 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:25 old-k8s-version-999319 kubelet[660]: E0731 19:56:25.651335 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.289274 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:33 old-k8s-version-999319 kubelet[660]: E0731 19:56:33.652433 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.291724 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:39 old-k8s-version-999319 kubelet[660]: E0731 19:56:39.670766 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0731 19:59:19.292056 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:48 old-k8s-version-999319 kubelet[660]: E0731 19:56:48.650963 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.292244 1082506 logs.go:138] Found kubelet problem: Jul 31 19:56:52 old-k8s-version-999319 kubelet[660]: E0731 19:56:52.651443 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.292572 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:02 old-k8s-version-999319 kubelet[660]: E0731 19:57:02.650941 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.292756 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:05 old-k8s-version-999319 kubelet[660]: E0731 19:57:05.651361 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.293081 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:13 old-k8s-version-999319 kubelet[660]: E0731 19:57:13.651436 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.293262 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:20 old-k8s-version-999319 kubelet[660]: E0731 19:57:20.651249 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.293848 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:27 old-k8s-version-999319 kubelet[660]: E0731 19:57:27.526272 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.294030 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:31 old-k8s-version-999319 kubelet[660]: E0731 19:57:31.652529 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.294356 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:37 old-k8s-version-999319 kubelet[660]: E0731 19:57:37.143623 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.294535 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:43 old-k8s-version-999319 kubelet[660]: E0731 19:57:43.653235 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.294876 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:50 old-k8s-version-999319 kubelet[660]: E0731 19:57:50.650903 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.295054 1082506 logs.go:138] Found kubelet problem: Jul 31 19:57:57 old-k8s-version-999319 kubelet[660]: E0731 19:57:57.652175 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.295383 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:02 old-k8s-version-999319 kubelet[660]: E0731 19:58:02.650971 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.295563 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:08 old-k8s-version-999319 kubelet[660]: E0731 19:58:08.651308 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.295886 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:15 old-k8s-version-999319 kubelet[660]: E0731 19:58:15.651144 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.296120 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:21 old-k8s-version-999319 kubelet[660]: E0731 19:58:21.651270 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.296472 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:29 old-k8s-version-999319 kubelet[660]: E0731 19:58:29.651437 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.296678 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:36 old-k8s-version-999319 kubelet[660]: E0731 19:58:36.651450 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.297028 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:42 old-k8s-version-999319 kubelet[660]: E0731 19:58:42.650974 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.297236 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:47 old-k8s-version-999319 kubelet[660]: E0731 19:58:47.652087 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.297586 1082506 logs.go:138] Found kubelet problem: Jul 31 19:58:57 old-k8s-version-999319 kubelet[660]: E0731 19:58:57.651908 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.297792 1082506 logs.go:138] Found kubelet problem: Jul 31 19:59:01 old-k8s-version-999319 kubelet[660]: E0731 19:59:01.651281 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.298140 1082506 logs.go:138] Found kubelet problem: Jul 31 19:59:12 old-k8s-version-999319 kubelet[660]: E0731 19:59:12.651599 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.298357 1082506 logs.go:138] Found kubelet problem: Jul 31 19:59:15 old-k8s-version-999319 kubelet[660]: E0731 19:59:15.653028 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 19:59:19.298383 1082506 logs.go:123] Gathering logs for coredns [d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e] ...
I0731 19:59:19.298412 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e"
I0731 19:59:19.368391 1082506 logs.go:123] Gathering logs for kube-scheduler [5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983] ...
I0731 19:59:19.368415 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983"
I0731 19:59:19.413483 1082506 logs.go:123] Gathering logs for kube-proxy [9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f] ...
I0731 19:59:19.413557 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f"
I0731 19:59:19.477240 1082506 logs.go:123] Gathering logs for kindnet [58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd] ...
I0731 19:59:19.477315 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd"
I0731 19:59:19.567246 1082506 logs.go:123] Gathering logs for kube-apiserver [01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb] ...
I0731 19:59:19.567327 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb"
I0731 19:59:19.700187 1082506 logs.go:123] Gathering logs for etcd [efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc] ...
I0731 19:59:19.700261 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc"
I0731 19:59:19.771744 1082506 logs.go:123] Gathering logs for storage-provisioner [72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74] ...
I0731 19:59:19.771871 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74"
I0731 19:59:19.816586 1082506 logs.go:123] Gathering logs for container status ...
I0731 19:59:19.816663 1082506 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0731 19:59:19.939478 1082506 out.go:304] Setting ErrFile to fd 2...
I0731 19:59:19.939551 1082506 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0731 19:59:19.939634 1082506 out.go:239] X Problems detected in kubelet:
W0731 19:59:19.939670 1082506 out.go:239] Jul 31 19:58:47 old-k8s-version-999319 kubelet[660]: E0731 19:58:47.652087 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.939824 1082506 out.go:239] Jul 31 19:58:57 old-k8s-version-999319 kubelet[660]: E0731 19:58:57.651908 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.939855 1082506 out.go:239] Jul 31 19:59:01 old-k8s-version-999319 kubelet[660]: E0731 19:59:01.651281 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 19:59:19.939946 1082506 out.go:239] Jul 31 19:59:12 old-k8s-version-999319 kubelet[660]: E0731 19:59:12.651599 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
W0731 19:59:19.940105 1082506 out.go:239] Jul 31 19:59:15 old-k8s-version-999319 kubelet[660]: E0731 19:59:15.653028 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 19:59:19.940155 1082506 out.go:304] Setting ErrFile to fd 2...
I0731 19:59:19.940175 1082506 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 19:59:25.473284 1091966 kubeadm.go:310] [api-check] The API server is healthy after 8.001778205s
I0731 19:59:25.496101 1091966 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0731 19:59:25.514211 1091966 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0731 19:59:25.548304 1091966 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0731 19:59:25.548626 1091966 kubeadm.go:310] [mark-control-plane] Marking the node embed-certs-992019 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0731 19:59:25.568955 1091966 kubeadm.go:310] [bootstrap-token] Using token: 406ecz.t1nv5wvysf58digk
I0731 19:59:25.571638 1091966 out.go:204] - Configuring RBAC rules ...
I0731 19:59:25.571755 1091966 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0731 19:59:25.579047 1091966 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0731 19:59:25.589295 1091966 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0731 19:59:25.597024 1091966 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0731 19:59:25.604093 1091966 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0731 19:59:25.611086 1091966 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0731 19:59:25.884745 1091966 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0731 19:59:26.324318 1091966 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0731 19:59:26.888353 1091966 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0731 19:59:26.888377 1091966 kubeadm.go:310]
I0731 19:59:26.888437 1091966 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0731 19:59:26.888448 1091966 kubeadm.go:310]
I0731 19:59:26.888522 1091966 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0731 19:59:26.888531 1091966 kubeadm.go:310]
I0731 19:59:26.888556 1091966 kubeadm.go:310] mkdir -p $HOME/.kube
I0731 19:59:26.888616 1091966 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0731 19:59:26.888668 1091966 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0731 19:59:26.888676 1091966 kubeadm.go:310]
I0731 19:59:26.888728 1091966 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0731 19:59:26.888735 1091966 kubeadm.go:310]
I0731 19:59:26.888780 1091966 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0731 19:59:26.888788 1091966 kubeadm.go:310]
I0731 19:59:26.888838 1091966 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0731 19:59:26.888914 1091966 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0731 19:59:26.888985 1091966 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0731 19:59:26.888993 1091966 kubeadm.go:310]
I0731 19:59:26.889074 1091966 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0731 19:59:26.889152 1091966 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0731 19:59:26.889160 1091966 kubeadm.go:310]
I0731 19:59:26.889240 1091966 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 406ecz.t1nv5wvysf58digk \
I0731 19:59:26.889346 1091966 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:7a01e8c927e8a08c935d40d398866dcf727930424da8423f6bba3d0a537bef6a \
I0731 19:59:26.889374 1091966 kubeadm.go:310] --control-plane
I0731 19:59:26.889382 1091966 kubeadm.go:310]
I0731 19:59:26.889464 1091966 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0731 19:59:26.889471 1091966 kubeadm.go:310]
I0731 19:59:26.889549 1091966 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 406ecz.t1nv5wvysf58digk \
I0731 19:59:26.889651 1091966 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:7a01e8c927e8a08c935d40d398866dcf727930424da8423f6bba3d0a537bef6a
I0731 19:59:26.896272 1091966 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1066-aws\n", err: exit status 1
I0731 19:59:26.896396 1091966 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0731 19:59:26.896422 1091966 cni.go:84] Creating CNI manager for ""
I0731 19:59:26.896431 1091966 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0731 19:59:26.899390 1091966 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0731 19:59:26.902037 1091966 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0731 19:59:26.906251 1091966 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.3/kubectl ...
I0731 19:59:26.906274 1091966 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
I0731 19:59:26.925239 1091966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0731 19:59:29.941626 1082506 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0731 19:59:29.950828 1082506 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0731 19:59:29.953595 1082506 out.go:177]
W0731 19:59:29.956128 1082506 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0731 19:59:29.956175 1082506 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0731 19:59:29.956195 1082506 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0731 19:59:29.956206 1082506 out.go:239] *
W0731 19:59:29.957204 1082506 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0731 19:59:29.959874 1082506 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
97df1a1e21c8b 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 3c5649a682e28 dashboard-metrics-scraper-8d5bb5db8-knhfd
3c70cd281bfa3 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 eb02017c07edd kubernetes-dashboard-cd95d586-qvmsq
72d8c6e05f5ca ba04bb24b9575 5 minutes ago Running storage-provisioner 1 938c06c7a1554 storage-provisioner
fb4106e5127c9 f42786f8afd22 5 minutes ago Running kindnet-cni 1 2440c9dbccd3e kindnet-vbfh8
d5916d3c1b8b8 db91994f4ee8f 5 minutes ago Running coredns 1 6720b7779cad4 coredns-74ff55c5b-d5xpg
da27d785f1cab 1611cd07b61d5 5 minutes ago Running busybox 1 14d742b7326d9 busybox
c27bfb85a8993 25a5233254979 5 minutes ago Running kube-proxy 1 5a37de10de1be kube-proxy-ph6qj
82968c5bcee87 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 1a72d010c0acf kube-controller-manager-old-k8s-version-999319
7953f192cfc12 05b738aa1bc63 5 minutes ago Running etcd 1 5d3ef7704c896 etcd-old-k8s-version-999319
5e2e7876abaed e7605f88f17d6 5 minutes ago Running kube-scheduler 1 5d9eef430000b kube-scheduler-old-k8s-version-999319
01f1432126417 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 7be5c58e64e0d kube-apiserver-old-k8s-version-999319
33ab13142f8f0 1611cd07b61d5 6 minutes ago Exited busybox 0 f049d9d6cfc85 busybox
bce7adb274e02 db91994f4ee8f 7 minutes ago Exited coredns 0 bfa391be53e91 coredns-74ff55c5b-d5xpg
58af0330787aa f42786f8afd22 8 minutes ago Exited kindnet-cni 0 2a92015b80890 kindnet-vbfh8
d9c49c55a10b4 ba04bb24b9575 8 minutes ago Exited storage-provisioner 0 f6ec61550d5dd storage-provisioner
9970a97500874 25a5233254979 8 minutes ago Exited kube-proxy 0 4dda2108544c4 kube-proxy-ph6qj
efef7c2442098 05b738aa1bc63 8 minutes ago Exited etcd 0 6005259bc5acf etcd-old-k8s-version-999319
687df68ee4a40 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 c57216bbeb11d kube-controller-manager-old-k8s-version-999319
e0b060a9966c6 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 11d92b4ae9c97 kube-apiserver-old-k8s-version-999319
58fd9a7cff39a e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 9001b1341e995 kube-scheduler-old-k8s-version-999319
==> containerd <==
Jul 31 19:55:57 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:55:57.673063706Z" level=info msg="CreateContainer within sandbox \"3c5649a682e280955a0f14450f443008b6e7b789b809dda3d7677562c58ddb80\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"4800ee1cbb8d803b234e430013b35cf2e71e4e110fde6589e1d68fa83b3ad618\""
Jul 31 19:55:57 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:55:57.675309416Z" level=info msg="StartContainer for \"4800ee1cbb8d803b234e430013b35cf2e71e4e110fde6589e1d68fa83b3ad618\""
Jul 31 19:55:57 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:55:57.741407499Z" level=info msg="StartContainer for \"4800ee1cbb8d803b234e430013b35cf2e71e4e110fde6589e1d68fa83b3ad618\" returns successfully"
Jul 31 19:55:57 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:55:57.774026655Z" level=info msg="shim disconnected" id=4800ee1cbb8d803b234e430013b35cf2e71e4e110fde6589e1d68fa83b3ad618 namespace=k8s.io
Jul 31 19:55:57 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:55:57.774091482Z" level=warning msg="cleaning up after shim disconnected" id=4800ee1cbb8d803b234e430013b35cf2e71e4e110fde6589e1d68fa83b3ad618 namespace=k8s.io
Jul 31 19:55:57 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:55:57.774102116Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Jul 31 19:55:58 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:55:58.310125071Z" level=info msg="RemoveContainer for \"9bbc17eafb4bd3a23f32e5ff55896943064ede0ee9c4b1309f8c1db8d307a74b\""
Jul 31 19:55:58 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:55:58.317604511Z" level=info msg="RemoveContainer for \"9bbc17eafb4bd3a23f32e5ff55896943064ede0ee9c4b1309f8c1db8d307a74b\" returns successfully"
Jul 31 19:56:39 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:56:39.656095726Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:56:39 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:56:39.661944639Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Jul 31 19:56:39 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:56:39.663355766Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jul 31 19:56:39 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:56:39.663466156Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Jul 31 19:57:26 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:57:26.652882523Z" level=info msg="CreateContainer within sandbox \"3c5649a682e280955a0f14450f443008b6e7b789b809dda3d7677562c58ddb80\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Jul 31 19:57:26 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:57:26.666410682Z" level=info msg="CreateContainer within sandbox \"3c5649a682e280955a0f14450f443008b6e7b789b809dda3d7677562c58ddb80\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"97df1a1e21c8b6657e3377c21adeee6e1fd65d8afb5977f8eb422fb4a996827f\""
Jul 31 19:57:26 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:57:26.667190136Z" level=info msg="StartContainer for \"97df1a1e21c8b6657e3377c21adeee6e1fd65d8afb5977f8eb422fb4a996827f\""
Jul 31 19:57:26 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:57:26.733277958Z" level=info msg="StartContainer for \"97df1a1e21c8b6657e3377c21adeee6e1fd65d8afb5977f8eb422fb4a996827f\" returns successfully"
Jul 31 19:57:26 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:57:26.762180882Z" level=info msg="shim disconnected" id=97df1a1e21c8b6657e3377c21adeee6e1fd65d8afb5977f8eb422fb4a996827f namespace=k8s.io
Jul 31 19:57:26 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:57:26.762241230Z" level=warning msg="cleaning up after shim disconnected" id=97df1a1e21c8b6657e3377c21adeee6e1fd65d8afb5977f8eb422fb4a996827f namespace=k8s.io
Jul 31 19:57:26 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:57:26.762251674Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Jul 31 19:57:27 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:57:27.524863043Z" level=info msg="RemoveContainer for \"4800ee1cbb8d803b234e430013b35cf2e71e4e110fde6589e1d68fa83b3ad618\""
Jul 31 19:57:27 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:57:27.529713036Z" level=info msg="RemoveContainer for \"4800ee1cbb8d803b234e430013b35cf2e71e4e110fde6589e1d68fa83b3ad618\" returns successfully"
Jul 31 19:59:27 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:59:27.658226477Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:59:27 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:59:27.724921330Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Jul 31 19:59:27 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:59:27.726878021Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jul 31 19:59:27 old-k8s-version-999319 containerd[569]: time="2024-07-31T19:59:27.726988853Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
==> coredns [bce7adb274e02c4fde18447e894390516a365304dc9d788a519fbf8c660b9046] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:43251 - 36896 "HINFO IN 7380748134897045625.1867943140204821493. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.021749305s
==> coredns [d5916d3c1b8b8d41756b6015f74f0b5610095b7f90f02cbeeb96e5f2f2e78e5e] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:56363 - 15315 "HINFO IN 2161839143360033520.4760471725718982679. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.023041561s
==> describe nodes <==
Name: old-k8s-version-999319
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-999319
kubernetes.io/os=linux
minikube.k8s.io/commit=5d3a875a2675af218d215883e61010adcc3d415c
minikube.k8s.io/name=old-k8s-version-999319
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_07_31T19_51_06_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 31 Jul 2024 19:51:03 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-999319
AcquireTime: <unset>
RenewTime: Wed, 31 Jul 2024 19:59:29 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 31 Jul 2024 19:54:46 +0000 Wed, 31 Jul 2024 19:50:56 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 31 Jul 2024 19:54:46 +0000 Wed, 31 Jul 2024 19:50:56 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 31 Jul 2024 19:54:46 +0000 Wed, 31 Jul 2024 19:50:56 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 31 Jul 2024 19:54:46 +0000 Wed, 31 Jul 2024 19:51:21 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-999319
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
System Info:
Machine ID: b638f1ccfd944c7baf2033410ec8aebd
System UUID: 7b5a02c9-8f6e-41b4-b932-1b4c46ebd096
Boot ID: 4d780d07-e0b6-4100-90a0-378b2440c397
Kernel Version: 5.15.0-1066-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.19
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m33s
kube-system coredns-74ff55c5b-d5xpg 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m10s
kube-system etcd-old-k8s-version-999319 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m17s
kube-system kindnet-vbfh8 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m10s
kube-system kube-apiserver-old-k8s-version-999319 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m17s
kube-system kube-controller-manager-old-k8s-version-999319 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m17s
kube-system kube-proxy-ph6qj 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m10s
kube-system kube-scheduler-old-k8s-version-999319 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m17s
kube-system metrics-server-9975d5f86-kfslp 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m21s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m8s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-knhfd 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m27s
kubernetes-dashboard kubernetes-dashboard-cd95d586-qvmsq 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m27s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m36s (x4 over 8m36s) kubelet Node old-k8s-version-999319 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m36s (x4 over 8m36s) kubelet Node old-k8s-version-999319 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m36s (x4 over 8m36s) kubelet Node old-k8s-version-999319 status is now: NodeHasSufficientPID
Normal Starting 8m17s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m17s kubelet Node old-k8s-version-999319 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m17s kubelet Node old-k8s-version-999319 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m17s kubelet Node old-k8s-version-999319 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m17s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m10s kubelet Node old-k8s-version-999319 status is now: NodeReady
Normal Starting 8m9s kube-proxy Starting kube-proxy.
Normal Starting 5m54s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m54s (x8 over 5m54s) kubelet Node old-k8s-version-999319 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m54s (x8 over 5m54s) kubelet Node old-k8s-version-999319 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m54s (x7 over 5m54s) kubelet Node old-k8s-version-999319 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m54s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m43s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.001095] FS-Cache: O-key=[8] '2bd4c90000000000'
[ +0.000721] FS-Cache: N-cookie c=00000030 [p=00000027 fl=2 nc=0 na=1]
[ +0.000956] FS-Cache: N-cookie d=00000000a01ac76f{9p.inode} n=000000004d7afc2d
[ +0.001078] FS-Cache: N-key=[8] '2bd4c90000000000'
[ +0.005187] FS-Cache: Duplicate cookie detected
[ +0.000719] FS-Cache: O-cookie c=0000002a [p=00000027 fl=226 nc=0 na=1]
[ +0.000992] FS-Cache: O-cookie d=00000000a01ac76f{9p.inode} n=000000001642e544
[ +0.001111] FS-Cache: O-key=[8] '2bd4c90000000000'
[ +0.000747] FS-Cache: N-cookie c=00000031 [p=00000027 fl=2 nc=0 na=1]
[ +0.000958] FS-Cache: N-cookie d=00000000a01ac76f{9p.inode} n=000000005641e714
[ +0.001100] FS-Cache: N-key=[8] '2bd4c90000000000'
[ +3.419914] FS-Cache: Duplicate cookie detected
[ +0.000720] FS-Cache: O-cookie c=00000028 [p=00000027 fl=226 nc=0 na=1]
[ +0.001065] FS-Cache: O-cookie d=00000000a01ac76f{9p.inode} n=000000002d699c86
[ +0.001061] FS-Cache: O-key=[8] '2ad4c90000000000'
[ +0.000727] FS-Cache: N-cookie c=00000033 [p=00000027 fl=2 nc=0 na=1]
[ +0.000940] FS-Cache: N-cookie d=00000000a01ac76f{9p.inode} n=0000000090dc7303
[ +0.001123] FS-Cache: N-key=[8] '2ad4c90000000000'
[ +0.288002] FS-Cache: Duplicate cookie detected
[ +0.000746] FS-Cache: O-cookie c=0000002d [p=00000027 fl=226 nc=0 na=1]
[ +0.000988] FS-Cache: O-cookie d=00000000a01ac76f{9p.inode} n=0000000095892291
[ +0.001075] FS-Cache: O-key=[8] '30d4c90000000000'
[ +0.000761] FS-Cache: N-cookie c=00000034 [p=00000027 fl=2 nc=0 na=1]
[ +0.000989] FS-Cache: N-cookie d=00000000a01ac76f{9p.inode} n=00000000817a5212
[ +0.001091] FS-Cache: N-key=[8] '30d4c90000000000'
==> etcd [7953f192cfc127245e2cb26e4ed14504a42a18365fcbcb68a718e066f36657d8] <==
2024-07-31 19:55:31.579410 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:55:41.579392 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:55:51.579462 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:56:01.579478 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:56:11.579576 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:56:21.579535 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:56:31.579472 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:56:41.579645 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:56:51.579352 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:57:01.579499 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:57:11.579468 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:57:21.579343 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:57:31.579537 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:57:41.579564 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:57:51.580112 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:58:01.579452 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:58:11.579464 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:58:21.580699 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:58:31.579542 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:58:41.579420 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:58:51.579598 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:59:01.580170 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:59:11.579691 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:59:21.579380 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:59:31.579504 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [efef7c2442098ea93d96764ad0a852b726aadc98844df138fc8b9daa711caefc] <==
raft2024/07/31 19:50:56 INFO: 9f0758e1c58a86ed is starting a new election at term 1
raft2024/07/31 19:50:56 INFO: 9f0758e1c58a86ed became candidate at term 2
raft2024/07/31 19:50:56 INFO: 9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2
raft2024/07/31 19:50:56 INFO: 9f0758e1c58a86ed became leader at term 2
raft2024/07/31 19:50:56 INFO: raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2
2024-07-31 19:50:56.900626 I | embed: ready to serve client requests
2024-07-31 19:50:56.902282 I | embed: serving client requests on 127.0.0.1:2379
2024-07-31 19:50:56.902480 I | etcdserver: setting up the initial cluster version to 3.4
2024-07-31 19:50:56.902924 I | etcdserver: published {Name:old-k8s-version-999319 ClientURLs:[https://192.168.85.2:2379]} to cluster 68eaea490fab4e05
2024-07-31 19:50:56.915134 N | etcdserver/membership: set the initial cluster version to 3.4
2024-07-31 19:50:56.915483 I | embed: ready to serve client requests
2024-07-31 19:50:56.932430 I | embed: serving client requests on 192.168.85.2:2379
2024-07-31 19:50:56.940196 I | etcdserver/api: enabled capabilities for version 3.4
2024-07-31 19:51:15.991040 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:51:20.623437 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:51:30.623806 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:51:40.623570 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:51:50.625029 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:52:00.623819 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:52:10.623532 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:52:20.623797 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:52:30.623561 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:52:40.623616 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:52:50.623838 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 19:53:00.623726 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
19:59:31 up 3:41, 0 users, load average: 1.34, 1.55, 2.04
Linux old-k8s-version-999319 5.15.0-1066-aws #72~20.04.1-Ubuntu SMP Sat Jul 20 07:44:07 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [58af0330787aac8706aaf29ca04da25a6d73a064f31c043a44d268cabbb2e5bd] <==
E0731 19:51:59.638461 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0731 19:52:05.455386 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0731 19:52:05.455423 1 main.go:299] handling current node
W0731 19:52:09.263886 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0731 19:52:09.263923 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0731 19:52:15.455840 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0731 19:52:15.455876 1 main.go:299] handling current node
W0731 19:52:21.193341 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0731 19:52:21.193375 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0731 19:52:25.455219 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0731 19:52:25.455266 1 main.go:299] handling current node
I0731 19:52:35.455859 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0731 19:52:35.455894 1 main.go:299] handling current node
I0731 19:52:45.455904 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0731 19:52:45.455942 1 main.go:299] handling current node
W0731 19:52:47.008498 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0731 19:52:47.011903 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
W0731 19:52:49.316442 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0731 19:52:49.316476 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
W0731 19:52:54.391522 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0731 19:52:54.391559 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0731 19:52:55.455389 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0731 19:52:55.455434 1 main.go:299] handling current node
I0731 19:53:05.457642 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0731 19:53:05.457867 1 main.go:299] handling current node
==> kindnet [fb4106e5127c9eb13e217b4307eb18b4237c2f9d149a1de3a14ee9f049435e54] <==
I0731 19:58:19.831334 1 main.go:299] handling current node
I0731 19:58:29.831416 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0731 19:58:29.831450 1 main.go:299] handling current node
W0731 19:58:35.845014 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0731 19:58:35.845054 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0731 19:58:39.832283 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0731 19:58:39.832323 1 main.go:299] handling current node
I0731 19:58:49.831651 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0731 19:58:49.831694 1 main.go:299] handling current node
W0731 19:58:57.524213 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0731 19:58:57.524312 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0731 19:58:59.831255 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0731 19:58:59.831294 1 main.go:299] handling current node
W0731 19:59:01.095437 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0731 19:59:01.095574 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0731 19:59:09.831997 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0731 19:59:09.832034 1 main.go:299] handling current node
W0731 19:59:10.067052 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0731 19:59:10.067370 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0731 19:59:19.831802 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0731 19:59:19.831838 1 main.go:299] handling current node
I0731 19:59:29.831381 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0731 19:59:29.831421 1 main.go:299] handling current node
W0731 19:59:31.732070 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0731 19:59:31.732107 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
==> kube-apiserver [01f1432126417b08e533fb98c178259c78f91cb3e0dff8015187a9ede63b0fdb] <==
I0731 19:56:10.202747 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 19:56:10.202922 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0731 19:56:47.162635 1 client.go:360] parsed scheme: "passthrough"
I0731 19:56:47.162683 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 19:56:47.162692 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0731 19:56:49.212939 1 handler_proxy.go:102] no RequestInfo found in the context
E0731 19:56:49.213009 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0731 19:56:49.213017 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0731 19:57:26.448681 1 client.go:360] parsed scheme: "passthrough"
I0731 19:57:26.448730 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 19:57:26.448739 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0731 19:58:06.392256 1 client.go:360] parsed scheme: "passthrough"
I0731 19:58:06.392429 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 19:58:06.392449 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0731 19:58:45.990191 1 client.go:360] parsed scheme: "passthrough"
I0731 19:58:45.990406 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 19:58:45.990496 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0731 19:58:47.541875 1 handler_proxy.go:102] no RequestInfo found in the context
E0731 19:58:47.544292 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0731 19:58:47.544349 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0731 19:59:30.475297 1 client.go:360] parsed scheme: "passthrough"
I0731 19:59:30.475371 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 19:59:30.475379 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [e0b060a9966c6c3acef5c0846a609e58251acea52124a2258e7e8edd0f6bd691] <==
I0731 19:51:03.971672 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0731 19:51:03.971714 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0731 19:51:03.981205 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0731 19:51:03.985230 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0731 19:51:03.985252 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0731 19:51:04.469410 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0731 19:51:04.507181 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0731 19:51:04.579455 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
I0731 19:51:04.580764 1 controller.go:606] quota admission added evaluator for: endpoints
I0731 19:51:04.584904 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0731 19:51:05.672667 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0731 19:51:06.115085 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0731 19:51:06.168332 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0731 19:51:14.636492 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0731 19:51:21.598917 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0731 19:51:21.681936 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0731 19:51:27.596812 1 client.go:360] parsed scheme: "passthrough"
I0731 19:51:27.596855 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 19:51:27.596864 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0731 19:52:10.189811 1 client.go:360] parsed scheme: "passthrough"
I0731 19:52:10.189879 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 19:52:10.189888 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0731 19:52:45.055121 1 client.go:360] parsed scheme: "passthrough"
I0731 19:52:45.055173 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 19:52:45.055369 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [687df68ee4a40dad8f19813c2530f0eb00c90cde78e105e7c95e13e58e7646cf] <==
I0731 19:51:21.683420 1 shared_informer.go:247] Caches are synced for namespace
I0731 19:51:21.685048 1 range_allocator.go:373] Set node old-k8s-version-999319 PodCIDR to [10.244.0.0/24]
I0731 19:51:21.705010 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-d5xpg"
I0731 19:51:21.718844 1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator
I0731 19:51:21.751034 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-ph6qj"
I0731 19:51:21.756160 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-vbfh8"
I0731 19:51:21.817837 1 shared_informer.go:247] Caches are synced for attach detach
I0731 19:51:21.829716 1 shared_informer.go:247] Caches are synced for resource quota
I0731 19:51:21.852599 1 shared_informer.go:247] Caches are synced for resource quota
E0731 19:51:21.866243 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"fa5cf7dd-e534-4f0d-b0fc-8e4a177e079d", ResourceVersion:"398", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63858052266, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x400033ce80), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x400033cf60)}, v1.ManagedFieldsEntry{Manager:"kube-co
ntroller-manager", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x400033cf80), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x400033cfa0)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x400033cfc0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElastic
BlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x4001b1d140), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSour
ce)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x400033cfe0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSo
urce)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x400033d000), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil),
Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil),
WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x400033d060)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"F
ile", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x40003cd080), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4000f1de68), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40003fe620), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)
(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x4000207de0)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4000f1deb8)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:1, NumberReady:0, ObservedGeneration:1, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:1, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest ve
rsion and try again
I0731 19:51:21.877395 1 shared_informer.go:247] Caches are synced for persistent volume
I0731 19:51:21.881200 1 shared_informer.go:247] Caches are synced for PVC protection
I0731 19:51:21.887493 1 shared_informer.go:247] Caches are synced for expand
I0731 19:51:21.892378 1 shared_informer.go:247] Caches are synced for stateful set
I0731 19:51:22.008538 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0731 19:51:22.290751 1 shared_informer.go:247] Caches are synced for garbage collector
I0731 19:51:22.290775 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0731 19:51:22.309463 1 shared_informer.go:247] Caches are synced for garbage collector
I0731 19:51:23.482450 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0731 19:51:23.520347 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-k5lc9"
I0731 19:51:26.590662 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0731 19:53:09.144354 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
I0731 19:53:09.194086 1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"metrics-server-9975d5f86-\" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount \"metrics-server\" not found"
E0731 19:53:09.232090 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with pods "metrics-server-9975d5f86-" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount "metrics-server" not found
I0731 19:53:10.275642 1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: metrics-server-9975d5f86-kfslp"
==> kube-controller-manager [82968c5bcee87e601d969e0048b8055f59020c809360845c178bafe903b92513] <==
I0731 19:55:11.757457 1 request.go:655] Throttling request took 1.048389897s, request: GET:https://192.168.85.2:8443/apis/admissionregistration.k8s.io/v1beta1?timeout=32s
W0731 19:55:12.608822 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 19:55:36.319378 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 19:55:44.259369 1 request.go:655] Throttling request took 1.04823748s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0731 19:55:45.111311 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 19:56:06.821239 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 19:56:16.761757 1 request.go:655] Throttling request took 1.048237886s, request: GET:https://192.168.85.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
W0731 19:56:17.613221 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 19:56:37.323278 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 19:56:49.263797 1 request.go:655] Throttling request took 1.048461892s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0731 19:56:50.115225 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 19:57:07.825292 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 19:57:21.765799 1 request.go:655] Throttling request took 1.048338048s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0731 19:57:22.617098 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 19:57:38.327053 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 19:57:54.267677 1 request.go:655] Throttling request took 1.048384227s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0731 19:57:55.119056 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 19:58:08.857724 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 19:58:26.769524 1 request.go:655] Throttling request took 1.048363131s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0731 19:58:27.621019 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 19:58:39.359485 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 19:58:59.271570 1 request.go:655] Throttling request took 1.04842845s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0731 19:59:00.130097 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 19:59:09.861644 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 19:59:31.780859 1 request.go:655] Throttling request took 1.048228018s, request: GET:https://192.168.85.2:8443/apis/batch/v1?timeout=32s
==> kube-proxy [9970a97500874a0cb3473688a5b1cfc074aa0025150daa850079240980fb671f] <==
I0731 19:51:22.709865 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0731 19:51:22.710051 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0731 19:51:22.795440 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0731 19:51:22.795540 1 server_others.go:185] Using iptables Proxier.
I0731 19:51:22.795775 1 server.go:650] Version: v1.20.0
I0731 19:51:22.797368 1 config.go:315] Starting service config controller
I0731 19:51:22.797397 1 shared_informer.go:240] Waiting for caches to sync for service config
I0731 19:51:22.798135 1 config.go:224] Starting endpoint slice config controller
I0731 19:51:22.798141 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0731 19:51:22.904741 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0731 19:51:22.917529 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [c27bfb85a8993d8659f2b97fe6f47d42c712704ebcb53014c3b33423a32ffc51] <==
I0731 19:53:48.776880 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0731 19:53:48.777150 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0731 19:53:48.811751 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0731 19:53:48.811837 1 server_others.go:185] Using iptables Proxier.
I0731 19:53:48.812091 1 server.go:650] Version: v1.20.0
I0731 19:53:48.812844 1 config.go:315] Starting service config controller
I0731 19:53:48.812852 1 shared_informer.go:240] Waiting for caches to sync for service config
I0731 19:53:48.812868 1 config.go:224] Starting endpoint slice config controller
I0731 19:53:48.812871 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0731 19:53:48.913216 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0731 19:53:48.913454 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [58fd9a7cff39aca380cd51e0d434fc18db6f36f0b857eac329028c513df8d14d] <==
W0731 19:51:03.206536 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0731 19:51:03.206572 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0731 19:51:03.207028 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0731 19:51:03.207050 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0731 19:51:03.260957 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0731 19:51:03.265809 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0731 19:51:03.265895 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0731 19:51:03.265932 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0731 19:51:03.269566 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0731 19:51:03.271664 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0731 19:51:03.272897 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0731 19:51:03.284352 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0731 19:51:03.284806 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0731 19:51:03.287160 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0731 19:51:03.287408 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0731 19:51:03.287640 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0731 19:51:03.287853 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0731 19:51:03.288128 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0731 19:51:03.288337 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0731 19:51:03.288465 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0731 19:51:04.225131 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0731 19:51:04.306753 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0731 19:51:04.323317 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0731 19:51:04.331433 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0731 19:51:06.367126 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [5e2e7876abaed6de48471205ab97b31ee8ce95cdc14d0c776398a48cedb89983] <==
I0731 19:53:41.277079 1 serving.go:331] Generated self-signed cert in-memory
W0731 19:53:46.512833 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0731 19:53:46.512878 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0731 19:53:46.512888 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0731 19:53:46.512894 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0731 19:53:46.748533 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0731 19:53:46.748615 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0731 19:53:46.748621 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0731 19:53:46.748638 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0731 19:53:46.851622 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Jul 31 19:57:57 old-k8s-version-999319 kubelet[660]: E0731 19:57:57.652175 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:58:02 old-k8s-version-999319 kubelet[660]: I0731 19:58:02.650609 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 97df1a1e21c8b6657e3377c21adeee6e1fd65d8afb5977f8eb422fb4a996827f
Jul 31 19:58:02 old-k8s-version-999319 kubelet[660]: E0731 19:58:02.650971 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
Jul 31 19:58:08 old-k8s-version-999319 kubelet[660]: E0731 19:58:08.651308 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:58:15 old-k8s-version-999319 kubelet[660]: I0731 19:58:15.650754 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 97df1a1e21c8b6657e3377c21adeee6e1fd65d8afb5977f8eb422fb4a996827f
Jul 31 19:58:15 old-k8s-version-999319 kubelet[660]: E0731 19:58:15.651144 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
Jul 31 19:58:21 old-k8s-version-999319 kubelet[660]: E0731 19:58:21.651270 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:58:29 old-k8s-version-999319 kubelet[660]: I0731 19:58:29.650653 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 97df1a1e21c8b6657e3377c21adeee6e1fd65d8afb5977f8eb422fb4a996827f
Jul 31 19:58:29 old-k8s-version-999319 kubelet[660]: E0731 19:58:29.651437 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
Jul 31 19:58:36 old-k8s-version-999319 kubelet[660]: E0731 19:58:36.651450 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:58:42 old-k8s-version-999319 kubelet[660]: I0731 19:58:42.650635 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 97df1a1e21c8b6657e3377c21adeee6e1fd65d8afb5977f8eb422fb4a996827f
Jul 31 19:58:42 old-k8s-version-999319 kubelet[660]: E0731 19:58:42.650974 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
Jul 31 19:58:47 old-k8s-version-999319 kubelet[660]: E0731 19:58:47.652087 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:58:57 old-k8s-version-999319 kubelet[660]: I0731 19:58:57.651282 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 97df1a1e21c8b6657e3377c21adeee6e1fd65d8afb5977f8eb422fb4a996827f
Jul 31 19:58:57 old-k8s-version-999319 kubelet[660]: E0731 19:58:57.651908 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
Jul 31 19:59:01 old-k8s-version-999319 kubelet[660]: E0731 19:59:01.651281 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:59:12 old-k8s-version-999319 kubelet[660]: I0731 19:59:12.650574 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 97df1a1e21c8b6657e3377c21adeee6e1fd65d8afb5977f8eb422fb4a996827f
Jul 31 19:59:12 old-k8s-version-999319 kubelet[660]: E0731 19:59:12.651599 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
Jul 31 19:59:15 old-k8s-version-999319 kubelet[660]: E0731 19:59:15.653028 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 19:59:26 old-k8s-version-999319 kubelet[660]: I0731 19:59:26.650653 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 97df1a1e21c8b6657e3377c21adeee6e1fd65d8afb5977f8eb422fb4a996827f
Jul 31 19:59:26 old-k8s-version-999319 kubelet[660]: E0731 19:59:26.650999 660 pod_workers.go:191] Error syncing pod d6a098fd-28fc-4101-9cc7-0e8fd15a39bb ("dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-knhfd_kubernetes-dashboard(d6a098fd-28fc-4101-9cc7-0e8fd15a39bb)"
Jul 31 19:59:27 old-k8s-version-999319 kubelet[660]: E0731 19:59:27.727191 660 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Jul 31 19:59:27 old-k8s-version-999319 kubelet[660]: E0731 19:59:27.727259 660 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Jul 31 19:59:27 old-k8s-version-999319 kubelet[660]: E0731 19:59:27.727415 660 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-psb75,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-kfslp_kube-system(a16958a
9-583e-4a40-88c6-814db9d72b88): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Jul 31 19:59:27 old-k8s-version-999319 kubelet[660]: E0731 19:59:27.727449 660 pod_workers.go:191] Error syncing pod a16958a9-583e-4a40-88c6-814db9d72b88 ("metrics-server-9975d5f86-kfslp_kube-system(a16958a9-583e-4a40-88c6-814db9d72b88)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
==> kubernetes-dashboard [3c70cd281bfa33ae7fce1d50ba01bb29daa1dbee781e324edea068872c556adb] <==
2024/07/31 19:54:10 Using namespace: kubernetes-dashboard
2024/07/31 19:54:10 Using in-cluster config to connect to apiserver
2024/07/31 19:54:10 Using secret token for csrf signing
2024/07/31 19:54:10 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/07/31 19:54:10 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/07/31 19:54:11 Successful initial request to the apiserver, version: v1.20.0
2024/07/31 19:54:11 Generating JWE encryption key
2024/07/31 19:54:11 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/07/31 19:54:11 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/07/31 19:54:11 Initializing JWE encryption key from synchronized object
2024/07/31 19:54:11 Creating in-cluster Sidecar client
2024/07/31 19:54:11 Serving insecurely on HTTP port: 9090
2024/07/31 19:54:11 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 19:54:41 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 19:55:11 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 19:55:41 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 19:56:11 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 19:56:41 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 19:57:11 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 19:57:41 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 19:58:11 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 19:58:41 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 19:59:11 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 19:54:10 Starting overwatch
==> storage-provisioner [72d8c6e05f5caf9c920a9b83e4043898dc85847faf4e839d10136af0bfcc1a74] <==
I0731 19:53:50.395059 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0731 19:53:50.406464 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0731 19:53:50.406516 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0731 19:54:07.856548 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0731 19:54:07.856940 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-999319_de7c435c-d198-400a-ad71-6cad7a382d52!
I0731 19:54:07.858489 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"482f7fe6-5fbb-4dd4-bcc2-c899e299236d", APIVersion:"v1", ResourceVersion:"778", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-999319_de7c435c-d198-400a-ad71-6cad7a382d52 became leader
I0731 19:54:07.957836 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-999319_de7c435c-d198-400a-ad71-6cad7a382d52!
==> storage-provisioner [d9c49c55a10b4cdb5190b6450366127d8d0eb6d4d12c5337c2ce6dff7516e20d] <==
I0731 19:51:24.069043 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0731 19:51:24.117147 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0731 19:51:24.117224 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0731 19:51:24.129237 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0731 19:51:24.130451 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-999319_f386d5a0-f572-4d52-8fcc-decc17e2ccd3!
I0731 19:51:24.141733 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"482f7fe6-5fbb-4dd4-bcc2-c899e299236d", APIVersion:"v1", ResourceVersion:"463", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-999319_f386d5a0-f572-4d52-8fcc-decc17e2ccd3 became leader
I0731 19:51:24.230884 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-999319_f386d5a0-f572-4d52-8fcc-decc17e2ccd3!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-999319 -n old-k8s-version-999319
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-999319 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-kfslp
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-999319 describe pod metrics-server-9975d5f86-kfslp
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-999319 describe pod metrics-server-9975d5f86-kfslp: exit status 1 (101.784702ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-kfslp" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-999319 describe pod metrics-server-9975d5f86-kfslp: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (370.89s)