=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-394049 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E0827 23:52:35.569285 1739715 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/functional-572102/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-394049 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 80 (6m9.717898009s)
-- stdout --
* [old-k8s-version-394049] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19522
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19522-1734325/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19522-1734325/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
* Using the docker driver based on existing profile
* Starting "old-k8s-version-394049" primary control-plane node in "old-k8s-version-394049" cluster
* Pulling base image v0.0.44-1724667927-19511 ...
* Restarting existing docker container for "old-k8s-version-394049" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.20 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-394049 addons enable metrics-server
* Enabled addons: metrics-server, default-storageclass, storage-provisioner, dashboard
-- /stdout --
** stderr **
I0827 23:52:02.736896 1945499 out.go:345] Setting OutFile to fd 1 ...
I0827 23:52:02.737201 1945499 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0827 23:52:02.737231 1945499 out.go:358] Setting ErrFile to fd 2...
I0827 23:52:02.737253 1945499 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0827 23:52:02.737642 1945499 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19522-1734325/.minikube/bin
I0827 23:52:02.738253 1945499 out.go:352] Setting JSON to false
I0827 23:52:02.739604 1945499 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":27272,"bootTime":1724775451,"procs":186,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1068-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0827 23:52:02.739741 1945499 start.go:139] virtualization:
I0827 23:52:02.743561 1945499 out.go:177] * [old-k8s-version-394049] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0827 23:52:02.747038 1945499 notify.go:220] Checking for updates...
I0827 23:52:02.749669 1945499 out.go:177] - MINIKUBE_LOCATION=19522
I0827 23:52:02.751917 1945499 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0827 23:52:02.754183 1945499 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19522-1734325/kubeconfig
I0827 23:52:02.756062 1945499 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19522-1734325/.minikube
I0827 23:52:02.758574 1945499 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0827 23:52:02.760764 1945499 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0827 23:52:02.763588 1945499 config.go:182] Loaded profile config "old-k8s-version-394049": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0827 23:52:02.766539 1945499 out.go:177] * Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
I0827 23:52:02.768765 1945499 driver.go:392] Setting default libvirt URI to qemu:///system
I0827 23:52:02.815002 1945499 docker.go:123] docker version: linux-27.2.0:Docker Engine - Community
I0827 23:52:02.815134 1945499 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0827 23:52:02.905821 1945499 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:58 OomKillDisable:true NGoroutines:68 SystemTime:2024-08-27 23:52:02.889656145 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214843392 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0827 23:52:02.905928 1945499 docker.go:307] overlay module found
I0827 23:52:02.908034 1945499 out.go:177] * Using the docker driver based on existing profile
I0827 23:52:02.910131 1945499 start.go:297] selected driver: docker
I0827 23:52:02.910147 1945499 start.go:901] validating driver "docker" against &{Name:old-k8s-version-394049 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-394049 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0827 23:52:02.910276 1945499 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0827 23:52:02.910874 1945499 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0827 23:52:02.998135 1945499 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:58 OomKillDisable:true NGoroutines:68 SystemTime:2024-08-27 23:52:02.985495161 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214843392 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0827 23:52:02.998536 1945499 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0827 23:52:02.998567 1945499 cni.go:84] Creating CNI manager for ""
I0827 23:52:02.998576 1945499 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0827 23:52:02.998615 1945499 start.go:340] cluster config:
{Name:old-k8s-version-394049 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-394049 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0827 23:52:03.000829 1945499 out.go:177] * Starting "old-k8s-version-394049" primary control-plane node in "old-k8s-version-394049" cluster
I0827 23:52:03.004287 1945499 cache.go:121] Beginning downloading kic base image for docker with containerd
I0827 23:52:03.010214 1945499 out.go:177] * Pulling base image v0.0.44-1724667927-19511 ...
I0827 23:52:03.015681 1945499 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0827 23:52:03.015779 1945499 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0827 23:52:03.015804 1945499 cache.go:56] Caching tarball of preloaded images
I0827 23:52:03.015935 1945499 preload.go:172] Found /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0827 23:52:03.015946 1945499 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0827 23:52:03.016071 1945499 profile.go:143] Saving config to /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/old-k8s-version-394049/config.json ...
I0827 23:52:03.016323 1945499 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 in local docker daemon
W0827 23:52:03.037855 1945499 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 is of wrong architecture
I0827 23:52:03.037876 1945499 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 to local cache
I0827 23:52:03.037956 1945499 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 in local cache directory
I0827 23:52:03.037975 1945499 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 in local cache directory, skipping pull
I0827 23:52:03.037980 1945499 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 exists in cache, skipping pull
I0827 23:52:03.037995 1945499 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 as a tarball
I0827 23:52:03.038001 1945499 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 from local cache
I0827 23:52:03.167756 1945499 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 from cached tarball
I0827 23:52:03.167789 1945499 cache.go:194] Successfully downloaded all kic artifacts
I0827 23:52:03.167832 1945499 start.go:360] acquireMachinesLock for old-k8s-version-394049: {Name:mke5f65788ddde90400b946cf7ce5cd43b90aa17 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0827 23:52:03.167895 1945499 start.go:364] duration metric: took 42.617µs to acquireMachinesLock for "old-k8s-version-394049"
I0827 23:52:03.167916 1945499 start.go:96] Skipping create...Using existing machine configuration
I0827 23:52:03.167922 1945499 fix.go:54] fixHost starting:
I0827 23:52:03.168196 1945499 cli_runner.go:164] Run: docker container inspect old-k8s-version-394049 --format={{.State.Status}}
I0827 23:52:03.184926 1945499 fix.go:112] recreateIfNeeded on old-k8s-version-394049: state=Stopped err=<nil>
W0827 23:52:03.184955 1945499 fix.go:138] unexpected machine state, will restart: <nil>
I0827 23:52:03.187243 1945499 out.go:177] * Restarting existing docker container for "old-k8s-version-394049" ...
I0827 23:52:03.189122 1945499 cli_runner.go:164] Run: docker start old-k8s-version-394049
I0827 23:52:03.632139 1945499 cli_runner.go:164] Run: docker container inspect old-k8s-version-394049 --format={{.State.Status}}
I0827 23:52:03.671957 1945499 kic.go:430] container "old-k8s-version-394049" state is running.
I0827 23:52:03.672332 1945499 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-394049
I0827 23:52:03.709277 1945499 profile.go:143] Saving config to /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/old-k8s-version-394049/config.json ...
I0827 23:52:03.709503 1945499 machine.go:93] provisionDockerMachine start ...
I0827 23:52:03.709569 1945499 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-394049
I0827 23:52:03.748704 1945499 main.go:141] libmachine: Using SSH client type: native
I0827 23:52:03.748968 1945499 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33829 <nil> <nil>}
I0827 23:52:03.748977 1945499 main.go:141] libmachine: About to run SSH command:
hostname
I0827 23:52:03.750336 1945499 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:54082->127.0.0.1:33829: read: connection reset by peer
I0827 23:52:06.900136 1945499 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-394049
I0827 23:52:06.900160 1945499 ubuntu.go:169] provisioning hostname "old-k8s-version-394049"
I0827 23:52:06.900227 1945499 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-394049
I0827 23:52:06.923849 1945499 main.go:141] libmachine: Using SSH client type: native
I0827 23:52:06.924088 1945499 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33829 <nil> <nil>}
I0827 23:52:06.924104 1945499 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-394049 && echo "old-k8s-version-394049" | sudo tee /etc/hostname
I0827 23:52:07.093110 1945499 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-394049
I0827 23:52:07.093190 1945499 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-394049
I0827 23:52:07.122461 1945499 main.go:141] libmachine: Using SSH client type: native
I0827 23:52:07.122709 1945499 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33829 <nil> <nil>}
I0827 23:52:07.122728 1945499 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-394049' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-394049/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-394049' | sudo tee -a /etc/hosts;
fi
fi
I0827 23:52:07.276861 1945499 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0827 23:52:07.276928 1945499 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19522-1734325/.minikube CaCertPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19522-1734325/.minikube}
I0827 23:52:07.276961 1945499 ubuntu.go:177] setting up certificates
I0827 23:52:07.277000 1945499 provision.go:84] configureAuth start
I0827 23:52:07.277078 1945499 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-394049
I0827 23:52:07.306217 1945499 provision.go:143] copyHostCerts
I0827 23:52:07.306296 1945499 exec_runner.go:144] found /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.pem, removing ...
I0827 23:52:07.306311 1945499 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.pem
I0827 23:52:07.306389 1945499 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.pem (1078 bytes)
I0827 23:52:07.306502 1945499 exec_runner.go:144] found /home/jenkins/minikube-integration/19522-1734325/.minikube/cert.pem, removing ...
I0827 23:52:07.306513 1945499 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19522-1734325/.minikube/cert.pem
I0827 23:52:07.306546 1945499 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19522-1734325/.minikube/cert.pem (1123 bytes)
I0827 23:52:07.306608 1945499 exec_runner.go:144] found /home/jenkins/minikube-integration/19522-1734325/.minikube/key.pem, removing ...
I0827 23:52:07.306618 1945499 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19522-1734325/.minikube/key.pem
I0827 23:52:07.306642 1945499 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19522-1734325/.minikube/key.pem (1675 bytes)
I0827 23:52:07.306694 1945499 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-394049 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-394049]
I0827 23:52:07.518250 1945499 provision.go:177] copyRemoteCerts
I0827 23:52:07.518329 1945499 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0827 23:52:07.518411 1945499 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-394049
I0827 23:52:07.547996 1945499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33829 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/old-k8s-version-394049/id_rsa Username:docker}
I0827 23:52:07.671308 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0827 23:52:07.700006 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0827 23:52:07.752879 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0827 23:52:07.789704 1945499 provision.go:87] duration metric: took 512.674477ms to configureAuth
I0827 23:52:07.789750 1945499 ubuntu.go:193] setting minikube options for container-runtime
I0827 23:52:07.789941 1945499 config.go:182] Loaded profile config "old-k8s-version-394049": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0827 23:52:07.789954 1945499 machine.go:96] duration metric: took 4.08044372s to provisionDockerMachine
I0827 23:52:07.789962 1945499 start.go:293] postStartSetup for "old-k8s-version-394049" (driver="docker")
I0827 23:52:07.789978 1945499 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0827 23:52:07.790027 1945499 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0827 23:52:07.790069 1945499 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-394049
I0827 23:52:07.814862 1945499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33829 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/old-k8s-version-394049/id_rsa Username:docker}
I0827 23:52:07.930513 1945499 ssh_runner.go:195] Run: cat /etc/os-release
I0827 23:52:07.934416 1945499 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0827 23:52:07.934454 1945499 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0827 23:52:07.934469 1945499 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0827 23:52:07.934477 1945499 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0827 23:52:07.934491 1945499 filesync.go:126] Scanning /home/jenkins/minikube-integration/19522-1734325/.minikube/addons for local assets ...
I0827 23:52:07.934550 1945499 filesync.go:126] Scanning /home/jenkins/minikube-integration/19522-1734325/.minikube/files for local assets ...
I0827 23:52:07.934636 1945499 filesync.go:149] local asset: /home/jenkins/minikube-integration/19522-1734325/.minikube/files/etc/ssl/certs/17397152.pem -> 17397152.pem in /etc/ssl/certs
I0827 23:52:07.934749 1945499 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0827 23:52:07.952801 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/files/etc/ssl/certs/17397152.pem --> /etc/ssl/certs/17397152.pem (1708 bytes)
I0827 23:52:07.993709 1945499 start.go:296] duration metric: took 203.730124ms for postStartSetup
I0827 23:52:07.993880 1945499 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0827 23:52:07.993953 1945499 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-394049
I0827 23:52:08.031045 1945499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33829 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/old-k8s-version-394049/id_rsa Username:docker}
I0827 23:52:08.145431 1945499 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0827 23:52:08.152998 1945499 fix.go:56] duration metric: took 4.985066711s for fixHost
I0827 23:52:08.153021 1945499 start.go:83] releasing machines lock for "old-k8s-version-394049", held for 4.985117745s
I0827 23:52:08.153101 1945499 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-394049
I0827 23:52:08.179555 1945499 ssh_runner.go:195] Run: cat /version.json
I0827 23:52:08.179621 1945499 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-394049
I0827 23:52:08.179854 1945499 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0827 23:52:08.179927 1945499 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-394049
I0827 23:52:08.207571 1945499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33829 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/old-k8s-version-394049/id_rsa Username:docker}
I0827 23:52:08.222877 1945499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33829 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/old-k8s-version-394049/id_rsa Username:docker}
I0827 23:52:08.332009 1945499 ssh_runner.go:195] Run: systemctl --version
I0827 23:52:08.508502 1945499 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0827 23:52:08.513148 1945499 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0827 23:52:08.532169 1945499 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0827 23:52:08.532253 1945499 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0827 23:52:08.542357 1945499 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0827 23:52:08.542427 1945499 start.go:495] detecting cgroup driver to use...
I0827 23:52:08.542475 1945499 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0827 23:52:08.542552 1945499 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0827 23:52:08.557872 1945499 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0827 23:52:08.571573 1945499 docker.go:217] disabling cri-docker service (if available) ...
I0827 23:52:08.571683 1945499 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0827 23:52:08.593593 1945499 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0827 23:52:08.610315 1945499 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0827 23:52:08.764292 1945499 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0827 23:52:08.918359 1945499 docker.go:233] disabling docker service ...
I0827 23:52:08.918498 1945499 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0827 23:52:08.939273 1945499 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0827 23:52:08.960750 1945499 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0827 23:52:09.106158 1945499 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0827 23:52:09.250105 1945499 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0827 23:52:09.270764 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0827 23:52:09.301903 1945499 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0827 23:52:09.312872 1945499 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0827 23:52:09.330687 1945499 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0827 23:52:09.330806 1945499 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0827 23:52:09.347244 1945499 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0827 23:52:09.361296 1945499 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0827 23:52:09.376803 1945499 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0827 23:52:09.389188 1945499 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0827 23:52:09.406637 1945499 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0827 23:52:09.425950 1945499 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0827 23:52:09.445029 1945499 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0827 23:52:09.454326 1945499 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0827 23:52:09.631671 1945499 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0827 23:52:09.973856 1945499 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0827 23:52:09.974010 1945499 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0827 23:52:09.982282 1945499 start.go:563] Will wait 60s for crictl version
I0827 23:52:09.982397 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:52:09.986737 1945499 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0827 23:52:10.075333 1945499 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.20
RuntimeApiVersion: v1
I0827 23:52:10.075449 1945499 ssh_runner.go:195] Run: containerd --version
I0827 23:52:10.132355 1945499 ssh_runner.go:195] Run: containerd --version
I0827 23:52:10.170730 1945499 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.20 ...
I0827 23:52:10.173427 1945499 cli_runner.go:164] Run: docker network inspect old-k8s-version-394049 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0827 23:52:10.194150 1945499 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0827 23:52:10.198804 1945499 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0827 23:52:10.212607 1945499 kubeadm.go:883] updating cluster {Name:old-k8s-version-394049 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-394049 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0827 23:52:10.212747 1945499 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0827 23:52:10.212869 1945499 ssh_runner.go:195] Run: sudo crictl images --output json
I0827 23:52:10.288990 1945499 containerd.go:627] all images are preloaded for containerd runtime.
I0827 23:52:10.289017 1945499 containerd.go:534] Images already preloaded, skipping extraction
I0827 23:52:10.289078 1945499 ssh_runner.go:195] Run: sudo crictl images --output json
I0827 23:52:10.373819 1945499 containerd.go:627] all images are preloaded for containerd runtime.
I0827 23:52:10.373838 1945499 cache_images.go:84] Images are preloaded, skipping loading
I0827 23:52:10.373846 1945499 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I0827 23:52:10.373962 1945499 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-394049 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-394049 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0827 23:52:10.374023 1945499 ssh_runner.go:195] Run: sudo crictl info
I0827 23:52:10.449400 1945499 cni.go:84] Creating CNI manager for ""
I0827 23:52:10.449481 1945499 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0827 23:52:10.449507 1945499 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0827 23:52:10.449560 1945499 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-394049 NodeName:old-k8s-version-394049 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0827 23:52:10.449728 1945499 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-394049"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0827 23:52:10.449840 1945499 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0827 23:52:10.466016 1945499 binaries.go:44] Found k8s binaries, skipping transfer
I0827 23:52:10.466165 1945499 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0827 23:52:10.484472 1945499 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0827 23:52:10.518961 1945499 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0827 23:52:10.544181 1945499 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0827 23:52:10.583035 1945499 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0827 23:52:10.592977 1945499 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0827 23:52:10.612025 1945499 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0827 23:52:10.761920 1945499 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0827 23:52:10.791709 1945499 certs.go:68] Setting up /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/old-k8s-version-394049 for IP: 192.168.76.2
I0827 23:52:10.791745 1945499 certs.go:194] generating shared ca certs ...
I0827 23:52:10.791762 1945499 certs.go:226] acquiring lock for ca certs: {Name:mkd3d47e0a7419f9dbeb7a4e1a68db1090a3adb2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:52:10.791940 1945499 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.key
I0827 23:52:10.791999 1945499 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/proxy-client-ca.key
I0827 23:52:10.792011 1945499 certs.go:256] generating profile certs ...
I0827 23:52:10.792110 1945499 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/old-k8s-version-394049/client.key
I0827 23:52:10.792190 1945499 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/old-k8s-version-394049/apiserver.key.e729be15
I0827 23:52:10.792240 1945499 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/old-k8s-version-394049/proxy-client.key
I0827 23:52:10.792405 1945499 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/1739715.pem (1338 bytes)
W0827 23:52:10.792451 1945499 certs.go:480] ignoring /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/1739715_empty.pem, impossibly tiny 0 bytes
I0827 23:52:10.792464 1945499 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca-key.pem (1675 bytes)
I0827 23:52:10.792490 1945499 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem (1078 bytes)
I0827 23:52:10.792524 1945499 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/cert.pem (1123 bytes)
I0827 23:52:10.792553 1945499 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/key.pem (1675 bytes)
I0827 23:52:10.792607 1945499 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/files/etc/ssl/certs/17397152.pem (1708 bytes)
I0827 23:52:10.793380 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0827 23:52:10.882145 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0827 23:52:10.944855 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0827 23:52:11.007094 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0827 23:52:11.070941 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/old-k8s-version-394049/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0827 23:52:11.120551 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/old-k8s-version-394049/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0827 23:52:11.170729 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/old-k8s-version-394049/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0827 23:52:11.215091 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/old-k8s-version-394049/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0827 23:52:11.242887 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/files/etc/ssl/certs/17397152.pem --> /usr/share/ca-certificates/17397152.pem (1708 bytes)
I0827 23:52:11.270999 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0827 23:52:11.301884 1945499 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/1739715.pem --> /usr/share/ca-certificates/1739715.pem (1338 bytes)
I0827 23:52:11.340253 1945499 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0827 23:52:11.374921 1945499 ssh_runner.go:195] Run: openssl version
I0827 23:52:11.382455 1945499 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/17397152.pem && ln -fs /usr/share/ca-certificates/17397152.pem /etc/ssl/certs/17397152.pem"
I0827 23:52:11.403246 1945499 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/17397152.pem
I0827 23:52:11.408487 1945499 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 27 23:12 /usr/share/ca-certificates/17397152.pem
I0827 23:52:11.408667 1945499 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/17397152.pem
I0827 23:52:11.416133 1945499 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/17397152.pem /etc/ssl/certs/3ec20f2e.0"
I0827 23:52:11.434438 1945499 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0827 23:52:11.449666 1945499 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0827 23:52:11.455877 1945499 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 27 23:02 /usr/share/ca-certificates/minikubeCA.pem
I0827 23:52:11.455977 1945499 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0827 23:52:11.470500 1945499 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0827 23:52:11.486992 1945499 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1739715.pem && ln -fs /usr/share/ca-certificates/1739715.pem /etc/ssl/certs/1739715.pem"
I0827 23:52:11.499904 1945499 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1739715.pem
I0827 23:52:11.504265 1945499 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 27 23:12 /usr/share/ca-certificates/1739715.pem
I0827 23:52:11.504363 1945499 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1739715.pem
I0827 23:52:11.512653 1945499 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1739715.pem /etc/ssl/certs/51391683.0"
I0827 23:52:11.522846 1945499 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0827 23:52:11.527136 1945499 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0827 23:52:11.534681 1945499 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0827 23:52:11.542478 1945499 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0827 23:52:11.550123 1945499 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0827 23:52:11.557935 1945499 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0827 23:52:11.565422 1945499 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0827 23:52:11.572892 1945499 kubeadm.go:392] StartCluster: {Name:old-k8s-version-394049 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-394049 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0827 23:52:11.573000 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0827 23:52:11.573068 1945499 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0827 23:52:11.624547 1945499 cri.go:89] found id: "3c0492b681bf18809e9a23ab9a173d2d830618a5a4009118054601e45bfe2d62"
I0827 23:52:11.624571 1945499 cri.go:89] found id: "575a6ee419e7fe10299e33d8b97f8c2598ad91a8fea4bdd2f0dd5e2db16ada9c"
I0827 23:52:11.624583 1945499 cri.go:89] found id: "592dbdd737e878b0fe0ea4cea6b72f6e640f9c434b17d5af3d98a6c70210e42c"
I0827 23:52:11.624588 1945499 cri.go:89] found id: "afa3d5bad6b52464ebc366db825a3bae7e5c7708a260053326c71f3b698cb205"
I0827 23:52:11.624592 1945499 cri.go:89] found id: "ec54c116a9331e1e0344c99a787d2410df9e7415035a80a4727091fdd518c6d9"
I0827 23:52:11.624595 1945499 cri.go:89] found id: "cb5a0544025d9eeba2b0613deeb98000ece1fd8d335ccd8307d6631b0c79b808"
I0827 23:52:11.624599 1945499 cri.go:89] found id: "8ad8c60d925d8c127982d6c494b2944705246a4e1f900b216029c075b40579c3"
I0827 23:52:11.624602 1945499 cri.go:89] found id: "30ef2c8817f233bf500df3120c006454ceca974e44a9d5b1ccb0d2f184c7a618"
I0827 23:52:11.624606 1945499 cri.go:89] found id: ""
I0827 23:52:11.624664 1945499 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0827 23:52:11.638953 1945499 cri.go:116] JSON = null
W0827 23:52:11.639018 1945499 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0827 23:52:11.639090 1945499 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0827 23:52:11.649546 1945499 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0827 23:52:11.649570 1945499 kubeadm.go:593] restartPrimaryControlPlane start ...
I0827 23:52:11.649630 1945499 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0827 23:52:11.659080 1945499 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0827 23:52:11.659606 1945499 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-394049" does not appear in /home/jenkins/minikube-integration/19522-1734325/kubeconfig
I0827 23:52:11.659736 1945499 kubeconfig.go:62] /home/jenkins/minikube-integration/19522-1734325/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-394049" cluster setting kubeconfig missing "old-k8s-version-394049" context setting]
I0827 23:52:11.660051 1945499 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/kubeconfig: {Name:mkbc2349839e7e640d3be8c9c9dabdbaf532417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:52:11.661816 1945499 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0827 23:52:11.674768 1945499 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I0827 23:52:11.674814 1945499 kubeadm.go:597] duration metric: took 25.237547ms to restartPrimaryControlPlane
I0827 23:52:11.674824 1945499 kubeadm.go:394] duration metric: took 101.98033ms to StartCluster
I0827 23:52:11.674840 1945499 settings.go:142] acquiring lock: {Name:mk2abdfb376a9e7540e648c96e5aaa1709f13213 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:52:11.674903 1945499 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19522-1734325/kubeconfig
I0827 23:52:11.675604 1945499 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/kubeconfig: {Name:mkbc2349839e7e640d3be8c9c9dabdbaf532417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:52:11.675846 1945499 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0827 23:52:11.676242 1945499 config.go:182] Loaded profile config "old-k8s-version-394049": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0827 23:52:11.676205 1945499 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0827 23:52:11.676350 1945499 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-394049"
I0827 23:52:11.676400 1945499 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-394049"
W0827 23:52:11.676411 1945499 addons.go:243] addon storage-provisioner should already be in state true
I0827 23:52:11.676436 1945499 host.go:66] Checking if "old-k8s-version-394049" exists ...
I0827 23:52:11.676440 1945499 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-394049"
I0827 23:52:11.676475 1945499 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-394049"
I0827 23:52:11.676805 1945499 cli_runner.go:164] Run: docker container inspect old-k8s-version-394049 --format={{.State.Status}}
I0827 23:52:11.676983 1945499 cli_runner.go:164] Run: docker container inspect old-k8s-version-394049 --format={{.State.Status}}
I0827 23:52:11.677434 1945499 addons.go:69] Setting dashboard=true in profile "old-k8s-version-394049"
I0827 23:52:11.677470 1945499 addons.go:234] Setting addon dashboard=true in "old-k8s-version-394049"
W0827 23:52:11.677483 1945499 addons.go:243] addon dashboard should already be in state true
I0827 23:52:11.677516 1945499 host.go:66] Checking if "old-k8s-version-394049" exists ...
I0827 23:52:11.678090 1945499 cli_runner.go:164] Run: docker container inspect old-k8s-version-394049 --format={{.State.Status}}
I0827 23:52:11.681782 1945499 out.go:177] * Verifying Kubernetes components...
I0827 23:52:11.682073 1945499 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-394049"
I0827 23:52:11.682106 1945499 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-394049"
W0827 23:52:11.682113 1945499 addons.go:243] addon metrics-server should already be in state true
I0827 23:52:11.682144 1945499 host.go:66] Checking if "old-k8s-version-394049" exists ...
I0827 23:52:11.682599 1945499 cli_runner.go:164] Run: docker container inspect old-k8s-version-394049 --format={{.State.Status}}
I0827 23:52:11.684128 1945499 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0827 23:52:11.749657 1945499 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0827 23:52:11.755515 1945499 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0827 23:52:11.755540 1945499 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0827 23:52:11.755608 1945499 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-394049
I0827 23:52:11.756467 1945499 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-394049"
W0827 23:52:11.756492 1945499 addons.go:243] addon default-storageclass should already be in state true
I0827 23:52:11.756518 1945499 host.go:66] Checking if "old-k8s-version-394049" exists ...
I0827 23:52:11.757188 1945499 cli_runner.go:164] Run: docker container inspect old-k8s-version-394049 --format={{.State.Status}}
I0827 23:52:11.768877 1945499 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0827 23:52:11.771212 1945499 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0827 23:52:11.771237 1945499 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0827 23:52:11.771321 1945499 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-394049
I0827 23:52:11.793690 1945499 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0827 23:52:11.803470 1945499 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0827 23:52:11.806971 1945499 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0827 23:52:11.807000 1945499 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0827 23:52:11.807091 1945499 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-394049
I0827 23:52:11.818644 1945499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33829 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/old-k8s-version-394049/id_rsa Username:docker}
I0827 23:52:11.847776 1945499 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0827 23:52:11.847797 1945499 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0827 23:52:11.847860 1945499 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-394049
I0827 23:52:11.877908 1945499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33829 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/old-k8s-version-394049/id_rsa Username:docker}
I0827 23:52:11.898946 1945499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33829 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/old-k8s-version-394049/id_rsa Username:docker}
I0827 23:52:11.901219 1945499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33829 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/old-k8s-version-394049/id_rsa Username:docker}
I0827 23:52:11.953651 1945499 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0827 23:52:11.973330 1945499 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-394049" to be "Ready" ...
I0827 23:52:12.068719 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0827 23:52:12.167155 1945499 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0827 23:52:12.167224 1945499 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0827 23:52:12.211855 1945499 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0827 23:52:12.211933 1945499 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0827 23:52:12.234788 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0827 23:52:12.250910 1945499 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0827 23:52:12.250990 1945499 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0827 23:52:12.289874 1945499 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0827 23:52:12.289948 1945499 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0827 23:52:12.323195 1945499 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0827 23:52:12.323273 1945499 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0827 23:52:12.360133 1945499 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0827 23:52:12.360212 1945499 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0827 23:52:12.399277 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0827 23:52:12.434447 1945499 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0827 23:52:12.434517 1945499 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0827 23:52:12.492905 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:12.492987 1945499 retry.go:31] will retry after 339.947745ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0827 23:52:12.517632 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:12.517714 1945499 retry.go:31] will retry after 214.072246ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:12.531424 1945499 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0827 23:52:12.531511 1945499 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0827 23:52:12.638876 1945499 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0827 23:52:12.638955 1945499 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W0827 23:52:12.664267 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:12.664348 1945499 retry.go:31] will retry after 180.385878ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:12.680384 1945499 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0827 23:52:12.680456 1945499 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0827 23:52:12.718075 1945499 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0827 23:52:12.718152 1945499 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0827 23:52:12.732537 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0827 23:52:12.762556 1945499 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0827 23:52:12.762635 1945499 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0827 23:52:12.834036 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0827 23:52:12.835196 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0827 23:52:12.845399 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0827 23:52:12.952511 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:12.952594 1945499 retry.go:31] will retry after 258.295816ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0827 23:52:13.207864 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:13.207944 1945499 retry.go:31] will retry after 405.723693ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:13.211348 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0827 23:52:13.245938 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:13.246022 1945499 retry.go:31] will retry after 371.526595ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0827 23:52:13.246077 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:13.246129 1945499 retry.go:31] will retry after 362.91713ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0827 23:52:13.361730 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:13.361824 1945499 retry.go:31] will retry after 561.04576ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:13.609998 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0827 23:52:13.614441 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0827 23:52:13.617940 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0827 23:52:13.888738 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:13.888824 1945499 retry.go:31] will retry after 381.820515ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0827 23:52:13.902025 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:13.902114 1945499 retry.go:31] will retry after 692.100352ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0827 23:52:13.923133 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:13.923227 1945499 retry.go:31] will retry after 528.298021ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:13.923354 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0827 23:52:13.974554 1945499 node_ready.go:53] error getting node "old-k8s-version-394049": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-394049": dial tcp 192.168.76.2:8443: connect: connection refused
W0827 23:52:14.055808 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:14.055901 1945499 retry.go:31] will retry after 995.646912ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:14.271193 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0827 23:52:14.383025 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:14.383108 1945499 retry.go:31] will retry after 1.154942581s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:14.452213 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0827 23:52:14.569965 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:14.570010 1945499 retry.go:31] will retry after 549.99911ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:14.595318 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0827 23:52:14.703719 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:14.703782 1945499 retry.go:31] will retry after 468.596693ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:15.052802 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0827 23:52:15.120380 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0827 23:52:15.172911 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0827 23:52:15.196771 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:15.196821 1945499 retry.go:31] will retry after 810.895713ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0827 23:52:15.305271 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:15.305313 1945499 retry.go:31] will retry after 905.254777ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0827 23:52:15.353566 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:15.353617 1945499 retry.go:31] will retry after 775.609276ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:15.538405 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0827 23:52:15.635746 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:15.635829 1945499 retry.go:31] will retry after 662.97292ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:16.008589 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0827 23:52:16.125637 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:16.125673 1945499 retry.go:31] will retry after 2.412456098s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:16.129933 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0827 23:52:16.211301 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0827 23:52:16.229170 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:16.229208 1945499 retry.go:31] will retry after 2.114056106s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:16.299508 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0827 23:52:16.362615 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:16.362660 1945499 retry.go:31] will retry after 1.074801879s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0827 23:52:16.458072 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:16.458106 1945499 retry.go:31] will retry after 2.100016875s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:16.474784 1945499 node_ready.go:53] error getting node "old-k8s-version-394049": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-394049": dial tcp 192.168.76.2:8443: connect: connection refused
I0827 23:52:17.438515 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0827 23:52:17.547307 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:17.547338 1945499 retry.go:31] will retry after 2.011521984s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:18.343977 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0827 23:52:18.423867 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:18.423901 1945499 retry.go:31] will retry after 3.473516436s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:18.538607 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0827 23:52:18.558918 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0827 23:52:18.644605 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:18.644639 1945499 retry.go:31] will retry after 1.871618423s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0827 23:52:18.662701 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:18.662735 1945499 retry.go:31] will retry after 1.847809249s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:18.974543 1945499 node_ready.go:53] error getting node "old-k8s-version-394049": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-394049": dial tcp 192.168.76.2:8443: connect: connection refused
I0827 23:52:19.559357 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0827 23:52:19.638731 1945499 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:19.638769 1945499 retry.go:31] will retry after 3.439371127s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0827 23:52:20.511669 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0827 23:52:20.517103 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0827 23:52:21.897782 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0827 23:52:23.078701 1945499 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0827 23:52:30.192687 1945499 node_ready.go:49] node "old-k8s-version-394049" has status "Ready":"True"
I0827 23:52:30.192714 1945499 node_ready.go:38] duration metric: took 18.219345112s for node "old-k8s-version-394049" to be "Ready" ...
I0827 23:52:30.192724 1945499 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0827 23:52:30.420629 1945499 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-fbhfc" in "kube-system" namespace to be "Ready" ...
I0827 23:52:30.478056 1945499 pod_ready.go:93] pod "coredns-74ff55c5b-fbhfc" in "kube-system" namespace has status "Ready":"True"
I0827 23:52:30.478124 1945499 pod_ready.go:82] duration metric: took 57.401877ms for pod "coredns-74ff55c5b-fbhfc" in "kube-system" namespace to be "Ready" ...
I0827 23:52:30.478160 1945499 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-394049" in "kube-system" namespace to be "Ready" ...
I0827 23:52:30.496628 1945499 pod_ready.go:93] pod "etcd-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"True"
I0827 23:52:30.496710 1945499 pod_ready.go:82] duration metric: took 18.529328ms for pod "etcd-old-k8s-version-394049" in "kube-system" namespace to be "Ready" ...
I0827 23:52:30.496741 1945499 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-394049" in "kube-system" namespace to be "Ready" ...
I0827 23:52:31.145565 1945499 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (10.628403903s)
I0827 23:52:31.145806 1945499 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.634085896s)
I0827 23:52:31.145828 1945499 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-394049"
I0827 23:52:31.210551 1945499 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (9.312731206s)
I0827 23:52:31.444054 1945499 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (8.365301133s)
I0827 23:52:31.446049 1945499 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-394049 addons enable metrics-server
I0827 23:52:31.448067 1945499 out.go:177] * Enabled addons: metrics-server, default-storageclass, storage-provisioner, dashboard
I0827 23:52:31.449830 1945499 addons.go:510] duration metric: took 19.773624726s for enable addons: enabled=[metrics-server default-storageclass storage-provisioner dashboard]
I0827 23:52:32.504156 1945499 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:52:34.506126 1945499 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:52:37.009959 1945499 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:52:38.505199 1945499 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"True"
I0827 23:52:38.505227 1945499 pod_ready.go:82] duration metric: took 8.008453426s for pod "kube-apiserver-old-k8s-version-394049" in "kube-system" namespace to be "Ready" ...
I0827 23:52:38.505239 1945499 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace to be "Ready" ...
I0827 23:52:40.511668 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:52:42.513025 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:52:45.048761 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:52:47.511787 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:52:49.512423 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:52:52.014455 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:52:54.016827 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:52:56.512467 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:52:58.513315 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:00.517979 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:03.022287 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:05.516715 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:08.017543 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:10.022881 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:12.511436 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:14.511515 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:16.511824 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:18.512595 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:21.017637 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:23.515888 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:25.523375 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:28.012706 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:30.147743 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:32.516483 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:35.017465 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:37.511824 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:39.514454 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:41.514541 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:43.519764 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:46.021968 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:48.023259 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:50.024458 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:52.511505 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:54.513571 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:57.022234 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:59.512743 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:00.513778 1945499 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"True"
I0827 23:54:00.513813 1945499 pod_ready.go:82] duration metric: took 1m22.008565732s for pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace to be "Ready" ...
I0827 23:54:00.513827 1945499 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-d84wl" in "kube-system" namespace to be "Ready" ...
I0827 23:54:00.522113 1945499 pod_ready.go:93] pod "kube-proxy-d84wl" in "kube-system" namespace has status "Ready":"True"
I0827 23:54:00.522142 1945499 pod_ready.go:82] duration metric: took 8.306412ms for pod "kube-proxy-d84wl" in "kube-system" namespace to be "Ready" ...
I0827 23:54:00.522155 1945499 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-394049" in "kube-system" namespace to be "Ready" ...
I0827 23:54:00.528947 1945499 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"True"
I0827 23:54:00.528983 1945499 pod_ready.go:82] duration metric: took 6.820274ms for pod "kube-scheduler-old-k8s-version-394049" in "kube-system" namespace to be "Ready" ...
I0827 23:54:00.528997 1945499 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace to be "Ready" ...
I0827 23:54:02.538013 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:05.049335 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:07.536856 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:09.544754 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:12.036784 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:14.037634 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:16.544787 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:19.036321 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:21.041602 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:23.535686 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:25.536146 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:27.540761 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:30.071722 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:32.538311 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:35.039074 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:37.535387 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:39.537746 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:41.542557 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:44.037226 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:46.535616 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:48.537805 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:50.542500 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:53.036589 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:55.068559 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:57.535050 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:59.536221 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:01.541466 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:04.036840 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:06.037668 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:08.540614 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:11.040996 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:13.536098 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:16.036958 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:18.037758 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:20.059068 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:22.542251 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:25.055999 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:27.549747 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:30.088038 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:32.535845 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:35.042825 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:37.537449 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:39.541413 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:42.036947 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:44.541623 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:47.037061 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:49.536624 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:51.540666 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:54.039877 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:56.041431 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:58.535820 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:00.569693 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:03.036146 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:05.063202 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:07.535319 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:09.542740 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:12.036240 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:14.041915 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:16.538564 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:18.539387 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:20.542941 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:23.035989 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:25.041259 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:27.535751 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:30.051150 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:32.541544 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:35.052137 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:37.541729 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:39.543135 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:42.044288 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:44.536100 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:47.036663 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:49.541661 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:52.041046 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:54.545514 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:57.037925 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:59.537151 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:01.541807 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:04.036301 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:06.037323 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:08.037761 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:10.061967 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:12.085447 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:14.549156 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:17.035779 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:19.036443 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:21.039024 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:23.536705 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:25.537439 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:28.037022 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:30.047408 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:32.535922 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:34.538361 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:37.040054 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:39.543065 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:41.543734 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:44.037557 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:46.535805 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:48.538154 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:51.036087 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:53.039962 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:55.050692 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:57.541257 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:58:00.089363 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:58:00.543555 1945499 pod_ready.go:82] duration metric: took 4m0.014542084s for pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace to be "Ready" ...
E0827 23:58:00.543589 1945499 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0827 23:58:00.543600 1945499 pod_ready.go:39] duration metric: took 5m30.35086527s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0827 23:58:00.543615 1945499 api_server.go:52] waiting for apiserver process to appear ...
I0827 23:58:00.543647 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0827 23:58:00.543719 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0827 23:58:00.597945 1945499 cri.go:89] found id: "236ee37eeeb99bd1460f867c4e7fe387aa435f0c3062f69ba966a2912dcefd98"
I0827 23:58:00.597976 1945499 cri.go:89] found id: "8ad8c60d925d8c127982d6c494b2944705246a4e1f900b216029c075b40579c3"
I0827 23:58:00.597982 1945499 cri.go:89] found id: ""
I0827 23:58:00.597990 1945499 logs.go:276] 2 containers: [236ee37eeeb99bd1460f867c4e7fe387aa435f0c3062f69ba966a2912dcefd98 8ad8c60d925d8c127982d6c494b2944705246a4e1f900b216029c075b40579c3]
I0827 23:58:00.598054 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.602301 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.606401 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0827 23:58:00.606492 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0827 23:58:00.652901 1945499 cri.go:89] found id: "b840f973e99b93adc44783c2e2d337691055b2010c919612e3dadc0ed1482689"
I0827 23:58:00.652924 1945499 cri.go:89] found id: "ec54c116a9331e1e0344c99a787d2410df9e7415035a80a4727091fdd518c6d9"
I0827 23:58:00.652929 1945499 cri.go:89] found id: ""
I0827 23:58:00.652937 1945499 logs.go:276] 2 containers: [b840f973e99b93adc44783c2e2d337691055b2010c919612e3dadc0ed1482689 ec54c116a9331e1e0344c99a787d2410df9e7415035a80a4727091fdd518c6d9]
I0827 23:58:00.653001 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.657090 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.660704 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0827 23:58:00.660777 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0827 23:58:00.699407 1945499 cri.go:89] found id: "ead4d00fa7425edec7434788632e2318593bc3569ef3831b4dc8a50390cfcef7"
I0827 23:58:00.699433 1945499 cri.go:89] found id: "3c0492b681bf18809e9a23ab9a173d2d830618a5a4009118054601e45bfe2d62"
I0827 23:58:00.699438 1945499 cri.go:89] found id: ""
I0827 23:58:00.699446 1945499 logs.go:276] 2 containers: [ead4d00fa7425edec7434788632e2318593bc3569ef3831b4dc8a50390cfcef7 3c0492b681bf18809e9a23ab9a173d2d830618a5a4009118054601e45bfe2d62]
I0827 23:58:00.699516 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.703499 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.707751 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0827 23:58:00.707839 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0827 23:58:00.749347 1945499 cri.go:89] found id: "1a994ea8ba82f081ccc9e2ac0e483d50f83e2ed42aa614b79c8caa2103abf267"
I0827 23:58:00.749421 1945499 cri.go:89] found id: "cb5a0544025d9eeba2b0613deeb98000ece1fd8d335ccd8307d6631b0c79b808"
I0827 23:58:00.749433 1945499 cri.go:89] found id: ""
I0827 23:58:00.749442 1945499 logs.go:276] 2 containers: [1a994ea8ba82f081ccc9e2ac0e483d50f83e2ed42aa614b79c8caa2103abf267 cb5a0544025d9eeba2b0613deeb98000ece1fd8d335ccd8307d6631b0c79b808]
I0827 23:58:00.749515 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.753278 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.756794 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0827 23:58:00.756926 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0827 23:58:00.798299 1945499 cri.go:89] found id: "b794569e1af8dd0a1e24a3b37ce65bee8173206424ae64ce50ae15299bc2ce1e"
I0827 23:58:00.798331 1945499 cri.go:89] found id: "afa3d5bad6b52464ebc366db825a3bae7e5c7708a260053326c71f3b698cb205"
I0827 23:58:00.798337 1945499 cri.go:89] found id: ""
I0827 23:58:00.798344 1945499 logs.go:276] 2 containers: [b794569e1af8dd0a1e24a3b37ce65bee8173206424ae64ce50ae15299bc2ce1e afa3d5bad6b52464ebc366db825a3bae7e5c7708a260053326c71f3b698cb205]
I0827 23:58:00.798412 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.802454 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.806186 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0827 23:58:00.806284 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0827 23:58:00.849117 1945499 cri.go:89] found id: "b80f35939db8aaeb12827ab1e612ae18e95c0c024e797cd5b1ea4629fe4a70ea"
I0827 23:58:00.849140 1945499 cri.go:89] found id: "30ef2c8817f233bf500df3120c006454ceca974e44a9d5b1ccb0d2f184c7a618"
I0827 23:58:00.849145 1945499 cri.go:89] found id: ""
I0827 23:58:00.849153 1945499 logs.go:276] 2 containers: [b80f35939db8aaeb12827ab1e612ae18e95c0c024e797cd5b1ea4629fe4a70ea 30ef2c8817f233bf500df3120c006454ceca974e44a9d5b1ccb0d2f184c7a618]
I0827 23:58:00.849226 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.852721 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.856151 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0827 23:58:00.856227 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0827 23:58:00.899038 1945499 cri.go:89] found id: "1cbb985b30629df7e58845adea1be58296d1c4b309b10502e97ae37f80e864fd"
I0827 23:58:00.899063 1945499 cri.go:89] found id: "575a6ee419e7fe10299e33d8b97f8c2598ad91a8fea4bdd2f0dd5e2db16ada9c"
I0827 23:58:00.899068 1945499 cri.go:89] found id: ""
I0827 23:58:00.899075 1945499 logs.go:276] 2 containers: [1cbb985b30629df7e58845adea1be58296d1c4b309b10502e97ae37f80e864fd 575a6ee419e7fe10299e33d8b97f8c2598ad91a8fea4bdd2f0dd5e2db16ada9c]
I0827 23:58:00.899130 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.903019 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.907211 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0827 23:58:00.907319 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0827 23:58:00.953896 1945499 cri.go:89] found id: "d6670465175a28a741e1eadfb9ec891d36c454066af259c2ba1292e1c2d606d9"
I0827 23:58:00.953964 1945499 cri.go:89] found id: ""
I0827 23:58:00.953978 1945499 logs.go:276] 1 containers: [d6670465175a28a741e1eadfb9ec891d36c454066af259c2ba1292e1c2d606d9]
I0827 23:58:00.954053 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.958271 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0827 23:58:00.958391 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0827 23:58:01.010042 1945499 cri.go:89] found id: "42597d6ccc6c90213fb2f50464c1373d136df2cc9496367789b03fba8d5f25bf"
I0827 23:58:01.010071 1945499 cri.go:89] found id: "592dbdd737e878b0fe0ea4cea6b72f6e640f9c434b17d5af3d98a6c70210e42c"
I0827 23:58:01.010077 1945499 cri.go:89] found id: ""
I0827 23:58:01.010085 1945499 logs.go:276] 2 containers: [42597d6ccc6c90213fb2f50464c1373d136df2cc9496367789b03fba8d5f25bf 592dbdd737e878b0fe0ea4cea6b72f6e640f9c434b17d5af3d98a6c70210e42c]
I0827 23:58:01.010157 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:01.015859 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:01.027889 1945499 logs.go:123] Gathering logs for kubelet ...
I0827 23:58:01.027965 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0827 23:58:01.085733 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:29 old-k8s-version-394049 kubelet[661]: E0827 23:52:29.904499 661 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.085965 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:29 old-k8s-version-394049 kubelet[661]: E0827 23:52:29.905231 661 reflector.go:138] object-"kube-system"/"coredns-token-h2fzw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-h2fzw" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.086179 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:29 old-k8s-version-394049 kubelet[661]: E0827 23:52:29.905317 661 reflector.go:138] object-"kube-system"/"kindnet-token-nhzrn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-nhzrn" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.089944 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:30 old-k8s-version-394049 kubelet[661]: E0827 23:52:30.162229 661 reflector.go:138] object-"kube-system"/"kube-proxy-token-4fdqz": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-4fdqz" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.090154 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:30 old-k8s-version-394049 kubelet[661]: E0827 23:52:30.162511 661 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.090397 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:30 old-k8s-version-394049 kubelet[661]: E0827 23:52:30.162590 661 reflector.go:138] object-"kube-system"/"storage-provisioner-token-dhs5r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-dhs5r" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.090605 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:30 old-k8s-version-394049 kubelet[661]: E0827 23:52:30.162658 661 reflector.go:138] object-"default"/"default-token-bdzp7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-bdzp7" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.090825 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:30 old-k8s-version-394049 kubelet[661]: E0827 23:52:30.162723 661 reflector.go:138] object-"kube-system"/"metrics-server-token-nrslw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-nrslw" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.099068 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:34 old-k8s-version-394049 kubelet[661]: E0827 23:52:34.053654 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0827 23:58:01.099263 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:34 old-k8s-version-394049 kubelet[661]: E0827 23:52:34.649560 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.102070 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:46 old-k8s-version-394049 kubelet[661]: E0827 23:52:46.414539 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0827 23:58:01.102400 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:48 old-k8s-version-394049 kubelet[661]: E0827 23:52:48.165741 661 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-sw62f": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-sw62f" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.105519 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:59 old-k8s-version-394049 kubelet[661]: E0827 23:52:59.405677 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.106456 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:00 old-k8s-version-394049 kubelet[661]: E0827 23:53:00.763341 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.106810 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:01 old-k8s-version-394049 kubelet[661]: E0827 23:53:01.767516 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.107142 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:02 old-k8s-version-394049 kubelet[661]: E0827 23:53:02.770141 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.109947 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:10 old-k8s-version-394049 kubelet[661]: E0827 23:53:10.412938 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0827 23:58:01.110536 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:15 old-k8s-version-394049 kubelet[661]: E0827 23:53:15.810709 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.110863 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:21 old-k8s-version-394049 kubelet[661]: E0827 23:53:21.214756 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.111048 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:23 old-k8s-version-394049 kubelet[661]: E0827 23:53:23.403844 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.111379 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:32 old-k8s-version-394049 kubelet[661]: E0827 23:53:32.403201 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.111565 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:35 old-k8s-version-394049 kubelet[661]: E0827 23:53:35.404624 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.111882 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:47 old-k8s-version-394049 kubelet[661]: E0827 23:53:47.404977 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.112337 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:47 old-k8s-version-394049 kubelet[661]: E0827 23:53:47.913818 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.112668 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:51 old-k8s-version-394049 kubelet[661]: E0827 23:53:51.214411 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.115132 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:59 old-k8s-version-394049 kubelet[661]: E0827 23:53:59.420594 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0827 23:58:01.115465 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:03 old-k8s-version-394049 kubelet[661]: E0827 23:54:03.408451 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.115649 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:13 old-k8s-version-394049 kubelet[661]: E0827 23:54:13.404006 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.115974 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:16 old-k8s-version-394049 kubelet[661]: E0827 23:54:16.404599 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.116158 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:26 old-k8s-version-394049 kubelet[661]: E0827 23:54:26.403617 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.116755 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:32 old-k8s-version-394049 kubelet[661]: E0827 23:54:32.101869 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.116939 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:40 old-k8s-version-394049 kubelet[661]: E0827 23:54:40.403413 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.117265 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:41 old-k8s-version-394049 kubelet[661]: E0827 23:54:41.214563 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.117581 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:54 old-k8s-version-394049 kubelet[661]: E0827 23:54:54.403985 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.117777 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:54 old-k8s-version-394049 kubelet[661]: E0827 23:54:54.404224 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.117960 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:05 old-k8s-version-394049 kubelet[661]: E0827 23:55:05.403501 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.118284 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:08 old-k8s-version-394049 kubelet[661]: E0827 23:55:08.403160 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.118468 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:17 old-k8s-version-394049 kubelet[661]: E0827 23:55:17.404616 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.118793 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:21 old-k8s-version-394049 kubelet[661]: E0827 23:55:21.403616 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.121238 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:29 old-k8s-version-394049 kubelet[661]: E0827 23:55:29.412117 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0827 23:58:01.121567 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:34 old-k8s-version-394049 kubelet[661]: E0827 23:55:34.403137 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.121750 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:43 old-k8s-version-394049 kubelet[661]: E0827 23:55:43.403788 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.122077 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:49 old-k8s-version-394049 kubelet[661]: E0827 23:55:49.404105 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.122261 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:58 old-k8s-version-394049 kubelet[661]: E0827 23:55:58.403447 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.122851 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:01 old-k8s-version-394049 kubelet[661]: E0827 23:56:01.416088 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.123034 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:09 old-k8s-version-394049 kubelet[661]: E0827 23:56:09.404354 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.123360 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:11 old-k8s-version-394049 kubelet[661]: E0827 23:56:11.216894 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.123547 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:23 old-k8s-version-394049 kubelet[661]: E0827 23:56:23.403678 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.123877 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:24 old-k8s-version-394049 kubelet[661]: E0827 23:56:24.403435 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.124062 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:38 old-k8s-version-394049 kubelet[661]: E0827 23:56:38.403581 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.124534 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:39 old-k8s-version-394049 kubelet[661]: E0827 23:56:39.403644 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.124726 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:50 old-k8s-version-394049 kubelet[661]: E0827 23:56:50.403803 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.125058 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:54 old-k8s-version-394049 kubelet[661]: E0827 23:56:54.403100 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.125243 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:03 old-k8s-version-394049 kubelet[661]: E0827 23:57:03.403600 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.125572 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:09 old-k8s-version-394049 kubelet[661]: E0827 23:57:09.403474 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.125757 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:17 old-k8s-version-394049 kubelet[661]: E0827 23:57:17.403665 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.126082 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:22 old-k8s-version-394049 kubelet[661]: E0827 23:57:22.403246 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.126268 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:30 old-k8s-version-394049 kubelet[661]: E0827 23:57:30.403646 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.126596 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:36 old-k8s-version-394049 kubelet[661]: E0827 23:57:36.403163 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.126782 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:43 old-k8s-version-394049 kubelet[661]: E0827 23:57:43.403668 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.127136 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:51 old-k8s-version-394049 kubelet[661]: E0827 23:57:51.403157 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.127321 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:57 old-k8s-version-394049 kubelet[661]: E0827 23:57:57.404181 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0827 23:58:01.127331 1945499 logs.go:123] Gathering logs for etcd [ec54c116a9331e1e0344c99a787d2410df9e7415035a80a4727091fdd518c6d9] ...
I0827 23:58:01.127346 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ec54c116a9331e1e0344c99a787d2410df9e7415035a80a4727091fdd518c6d9"
I0827 23:58:01.173990 1945499 logs.go:123] Gathering logs for kube-controller-manager [30ef2c8817f233bf500df3120c006454ceca974e44a9d5b1ccb0d2f184c7a618] ...
I0827 23:58:01.174026 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 30ef2c8817f233bf500df3120c006454ceca974e44a9d5b1ccb0d2f184c7a618"
I0827 23:58:01.230616 1945499 logs.go:123] Gathering logs for kindnet [1cbb985b30629df7e58845adea1be58296d1c4b309b10502e97ae37f80e864fd] ...
I0827 23:58:01.230650 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1cbb985b30629df7e58845adea1be58296d1c4b309b10502e97ae37f80e864fd"
I0827 23:58:01.275585 1945499 logs.go:123] Gathering logs for storage-provisioner [592dbdd737e878b0fe0ea4cea6b72f6e640f9c434b17d5af3d98a6c70210e42c] ...
I0827 23:58:01.275621 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 592dbdd737e878b0fe0ea4cea6b72f6e640f9c434b17d5af3d98a6c70210e42c"
I0827 23:58:01.321719 1945499 logs.go:123] Gathering logs for kubernetes-dashboard [d6670465175a28a741e1eadfb9ec891d36c454066af259c2ba1292e1c2d606d9] ...
I0827 23:58:01.321752 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d6670465175a28a741e1eadfb9ec891d36c454066af259c2ba1292e1c2d606d9"
I0827 23:58:01.367943 1945499 logs.go:123] Gathering logs for dmesg ...
I0827 23:58:01.367974 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0827 23:58:01.385565 1945499 logs.go:123] Gathering logs for describe nodes ...
I0827 23:58:01.385595 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0827 23:58:01.542426 1945499 logs.go:123] Gathering logs for etcd [b840f973e99b93adc44783c2e2d337691055b2010c919612e3dadc0ed1482689] ...
I0827 23:58:01.542461 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b840f973e99b93adc44783c2e2d337691055b2010c919612e3dadc0ed1482689"
I0827 23:58:01.586413 1945499 logs.go:123] Gathering logs for kube-scheduler [cb5a0544025d9eeba2b0613deeb98000ece1fd8d335ccd8307d6631b0c79b808] ...
I0827 23:58:01.586445 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cb5a0544025d9eeba2b0613deeb98000ece1fd8d335ccd8307d6631b0c79b808"
I0827 23:58:01.634391 1945499 logs.go:123] Gathering logs for kube-proxy [b794569e1af8dd0a1e24a3b37ce65bee8173206424ae64ce50ae15299bc2ce1e] ...
I0827 23:58:01.634426 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b794569e1af8dd0a1e24a3b37ce65bee8173206424ae64ce50ae15299bc2ce1e"
I0827 23:58:01.674602 1945499 logs.go:123] Gathering logs for kube-controller-manager [b80f35939db8aaeb12827ab1e612ae18e95c0c024e797cd5b1ea4629fe4a70ea] ...
I0827 23:58:01.674642 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b80f35939db8aaeb12827ab1e612ae18e95c0c024e797cd5b1ea4629fe4a70ea"
I0827 23:58:01.756052 1945499 logs.go:123] Gathering logs for kindnet [575a6ee419e7fe10299e33d8b97f8c2598ad91a8fea4bdd2f0dd5e2db16ada9c] ...
I0827 23:58:01.756149 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 575a6ee419e7fe10299e33d8b97f8c2598ad91a8fea4bdd2f0dd5e2db16ada9c"
I0827 23:58:01.829677 1945499 logs.go:123] Gathering logs for containerd ...
I0827 23:58:01.829716 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0827 23:58:01.893566 1945499 logs.go:123] Gathering logs for kube-apiserver [236ee37eeeb99bd1460f867c4e7fe387aa435f0c3062f69ba966a2912dcefd98] ...
I0827 23:58:01.893606 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 236ee37eeeb99bd1460f867c4e7fe387aa435f0c3062f69ba966a2912dcefd98"
I0827 23:58:01.975220 1945499 logs.go:123] Gathering logs for coredns [ead4d00fa7425edec7434788632e2318593bc3569ef3831b4dc8a50390cfcef7] ...
I0827 23:58:01.975254 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ead4d00fa7425edec7434788632e2318593bc3569ef3831b4dc8a50390cfcef7"
I0827 23:58:02.039338 1945499 logs.go:123] Gathering logs for coredns [3c0492b681bf18809e9a23ab9a173d2d830618a5a4009118054601e45bfe2d62] ...
I0827 23:58:02.039366 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3c0492b681bf18809e9a23ab9a173d2d830618a5a4009118054601e45bfe2d62"
I0827 23:58:02.085786 1945499 logs.go:123] Gathering logs for kube-scheduler [1a994ea8ba82f081ccc9e2ac0e483d50f83e2ed42aa614b79c8caa2103abf267] ...
I0827 23:58:02.085819 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1a994ea8ba82f081ccc9e2ac0e483d50f83e2ed42aa614b79c8caa2103abf267"
I0827 23:58:02.132044 1945499 logs.go:123] Gathering logs for kube-proxy [afa3d5bad6b52464ebc366db825a3bae7e5c7708a260053326c71f3b698cb205] ...
I0827 23:58:02.132073 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 afa3d5bad6b52464ebc366db825a3bae7e5c7708a260053326c71f3b698cb205"
I0827 23:58:02.179174 1945499 logs.go:123] Gathering logs for storage-provisioner [42597d6ccc6c90213fb2f50464c1373d136df2cc9496367789b03fba8d5f25bf] ...
I0827 23:58:02.179207 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 42597d6ccc6c90213fb2f50464c1373d136df2cc9496367789b03fba8d5f25bf"
I0827 23:58:02.220200 1945499 logs.go:123] Gathering logs for container status ...
I0827 23:58:02.220234 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0827 23:58:02.269966 1945499 logs.go:123] Gathering logs for kube-apiserver [8ad8c60d925d8c127982d6c494b2944705246a4e1f900b216029c075b40579c3] ...
I0827 23:58:02.269997 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8ad8c60d925d8c127982d6c494b2944705246a4e1f900b216029c075b40579c3"
I0827 23:58:02.326500 1945499 out.go:358] Setting ErrFile to fd 2...
I0827 23:58:02.326532 1945499 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0827 23:58:02.326594 1945499 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0827 23:58:02.326608 1945499 out.go:270] Aug 27 23:57:30 old-k8s-version-394049 kubelet[661]: E0827 23:57:30.403646 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 27 23:57:30 old-k8s-version-394049 kubelet[661]: E0827 23:57:30.403646 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:02.326640 1945499 out.go:270] Aug 27 23:57:36 old-k8s-version-394049 kubelet[661]: E0827 23:57:36.403163 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
Aug 27 23:57:36 old-k8s-version-394049 kubelet[661]: E0827 23:57:36.403163 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:02.326647 1945499 out.go:270] Aug 27 23:57:43 old-k8s-version-394049 kubelet[661]: E0827 23:57:43.403668 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 27 23:57:43 old-k8s-version-394049 kubelet[661]: E0827 23:57:43.403668 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:02.326656 1945499 out.go:270] Aug 27 23:57:51 old-k8s-version-394049 kubelet[661]: E0827 23:57:51.403157 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
Aug 27 23:57:51 old-k8s-version-394049 kubelet[661]: E0827 23:57:51.403157 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:02.326661 1945499 out.go:270] Aug 27 23:57:57 old-k8s-version-394049 kubelet[661]: E0827 23:57:57.404181 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 27 23:57:57 old-k8s-version-394049 kubelet[661]: E0827 23:57:57.404181 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0827 23:58:02.326666 1945499 out.go:358] Setting ErrFile to fd 2...
I0827 23:58:02.326675 1945499 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0827 23:58:12.327421 1945499 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0827 23:58:12.341561 1945499 api_server.go:72] duration metric: took 6m0.665672398s to wait for apiserver process to appear ...
I0827 23:58:12.341586 1945499 api_server.go:88] waiting for apiserver healthz status ...
I0827 23:58:12.344259 1945499 out.go:201]
W0827 23:58:12.346377 1945499 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W0827 23:58:12.346407 1945499 out.go:270] *
*
W0827 23:58:12.347367 1945499 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0827 23:58:12.348889 1945499 out.go:201]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-394049 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-394049
helpers_test.go:235: (dbg) docker inspect old-k8s-version-394049:
-- stdout --
[
{
"Id": "95f46ad71ee383734cf3718f7f3f3c15529e0294aea3acb28607ef3943f9dc3e",
"Created": "2024-08-27T23:48:50.60570392Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1945714,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-08-27T23:52:03.421800756Z",
"FinishedAt": "2024-08-27T23:52:02.094063653Z"
},
"Image": "sha256:0985147309945253cbe7e881ef8b47b2eeae8c92bbeecfbcb5398ea2f50c97c6",
"ResolvConfPath": "/var/lib/docker/containers/95f46ad71ee383734cf3718f7f3f3c15529e0294aea3acb28607ef3943f9dc3e/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/95f46ad71ee383734cf3718f7f3f3c15529e0294aea3acb28607ef3943f9dc3e/hostname",
"HostsPath": "/var/lib/docker/containers/95f46ad71ee383734cf3718f7f3f3c15529e0294aea3acb28607ef3943f9dc3e/hosts",
"LogPath": "/var/lib/docker/containers/95f46ad71ee383734cf3718f7f3f3c15529e0294aea3acb28607ef3943f9dc3e/95f46ad71ee383734cf3718f7f3f3c15529e0294aea3acb28607ef3943f9dc3e-json.log",
"Name": "/old-k8s-version-394049",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-394049:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-394049",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/312741932f25c812f3ef031224fd54ab571f33519a8cfc67991c3cc22eae3f76-init/diff:/var/lib/docker/overlay2/dff060cd4e9382e758ba60bffaaeeca22b78e3466a4ecd4887c9950dd9c3672c/diff",
"MergedDir": "/var/lib/docker/overlay2/312741932f25c812f3ef031224fd54ab571f33519a8cfc67991c3cc22eae3f76/merged",
"UpperDir": "/var/lib/docker/overlay2/312741932f25c812f3ef031224fd54ab571f33519a8cfc67991c3cc22eae3f76/diff",
"WorkDir": "/var/lib/docker/overlay2/312741932f25c812f3ef031224fd54ab571f33519a8cfc67991c3cc22eae3f76/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-394049",
"Source": "/var/lib/docker/volumes/old-k8s-version-394049/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-394049",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-394049",
"name.minikube.sigs.k8s.io": "old-k8s-version-394049",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "aafdc2c27186ccdb5b4e3afd3038eb432212d51a8a52a1aac71e0cf9d9b6a496",
"SandboxKey": "/var/run/docker/netns/aafdc2c27186",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33829"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33830"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33833"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33831"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33832"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-394049": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null,
"NetworkID": "c65e05bdf567481634a63e348351321d4d24583b856e3c37a9287645a0b3a702",
"EndpointID": "5f13ada3a7ab726d5ed8794c17bae6be7ec67bcee82a92c1226a89162ab07fbf",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-394049",
"95f46ad71ee3"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-394049 -n old-k8s-version-394049
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-394049 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-394049 logs -n 25: (2.818206733s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| ssh | force-systemd-flag-036455 | force-systemd-flag-036455 | jenkins | v1.33.1 | 27 Aug 24 23:47 UTC | 27 Aug 24 23:47 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-flag-036455 | force-systemd-flag-036455 | jenkins | v1.33.1 | 27 Aug 24 23:47 UTC | 27 Aug 24 23:47 UTC |
| start | -p cert-expiration-303453 | cert-expiration-303453 | jenkins | v1.33.1 | 27 Aug 24 23:47 UTC | 27 Aug 24 23:48 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-908909 | force-systemd-env-908909 | jenkins | v1.33.1 | 27 Aug 24 23:48 UTC | 27 Aug 24 23:48 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-908909 | force-systemd-env-908909 | jenkins | v1.33.1 | 27 Aug 24 23:48 UTC | 27 Aug 24 23:48 UTC |
| start | -p cert-options-806650 | cert-options-806650 | jenkins | v1.33.1 | 27 Aug 24 23:48 UTC | 27 Aug 24 23:48 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-806650 ssh | cert-options-806650 | jenkins | v1.33.1 | 27 Aug 24 23:48 UTC | 27 Aug 24 23:48 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-806650 -- sudo | cert-options-806650 | jenkins | v1.33.1 | 27 Aug 24 23:48 UTC | 27 Aug 24 23:48 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-806650 | cert-options-806650 | jenkins | v1.33.1 | 27 Aug 24 23:48 UTC | 27 Aug 24 23:48 UTC |
| start | -p old-k8s-version-394049 | old-k8s-version-394049 | jenkins | v1.33.1 | 27 Aug 24 23:48 UTC | 27 Aug 24 23:51 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-303453 | cert-expiration-303453 | jenkins | v1.33.1 | 27 Aug 24 23:51 UTC | 27 Aug 24 23:51 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-303453 | cert-expiration-303453 | jenkins | v1.33.1 | 27 Aug 24 23:51 UTC | 27 Aug 24 23:51 UTC |
| start | -p no-preload-710826 | no-preload-710826 | jenkins | v1.33.1 | 27 Aug 24 23:51 UTC | 27 Aug 24 23:52 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-394049 | old-k8s-version-394049 | jenkins | v1.33.1 | 27 Aug 24 23:51 UTC | 27 Aug 24 23:51 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-394049 | old-k8s-version-394049 | jenkins | v1.33.1 | 27 Aug 24 23:51 UTC | 27 Aug 24 23:52 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-394049 | old-k8s-version-394049 | jenkins | v1.33.1 | 27 Aug 24 23:52 UTC | 27 Aug 24 23:52 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-394049 | old-k8s-version-394049 | jenkins | v1.33.1 | 27 Aug 24 23:52 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-710826 | no-preload-710826 | jenkins | v1.33.1 | 27 Aug 24 23:53 UTC | 27 Aug 24 23:53 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-710826 | no-preload-710826 | jenkins | v1.33.1 | 27 Aug 24 23:53 UTC | 27 Aug 24 23:53 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-710826 | no-preload-710826 | jenkins | v1.33.1 | 27 Aug 24 23:53 UTC | 27 Aug 24 23:53 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-710826 | no-preload-710826 | jenkins | v1.33.1 | 27 Aug 24 23:53 UTC | 27 Aug 24 23:57 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| image | no-preload-710826 image list | no-preload-710826 | jenkins | v1.33.1 | 27 Aug 24 23:58 UTC | 27 Aug 24 23:58 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-710826 | no-preload-710826 | jenkins | v1.33.1 | 27 Aug 24 23:58 UTC | 27 Aug 24 23:58 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-710826 | no-preload-710826 | jenkins | v1.33.1 | 27 Aug 24 23:58 UTC | 27 Aug 24 23:58 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-710826 | no-preload-710826 | jenkins | v1.33.1 | 27 Aug 24 23:58 UTC | |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/08/27 23:53:17
Running on machine: ip-172-31-30-239
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0827 23:53:17.696618 1950495 out.go:345] Setting OutFile to fd 1 ...
I0827 23:53:17.696971 1950495 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0827 23:53:17.696984 1950495 out.go:358] Setting ErrFile to fd 2...
I0827 23:53:17.696991 1950495 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0827 23:53:17.697398 1950495 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19522-1734325/.minikube/bin
I0827 23:53:17.697974 1950495 out.go:352] Setting JSON to false
I0827 23:53:17.699165 1950495 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":27347,"bootTime":1724775451,"procs":234,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1068-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0827 23:53:17.699308 1950495 start.go:139] virtualization:
I0827 23:53:17.701896 1950495 out.go:177] * [no-preload-710826] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0827 23:53:17.704232 1950495 out.go:177] - MINIKUBE_LOCATION=19522
I0827 23:53:17.704361 1950495 notify.go:220] Checking for updates...
I0827 23:53:17.707807 1950495 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0827 23:53:17.709529 1950495 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19522-1734325/kubeconfig
I0827 23:53:17.711267 1950495 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19522-1734325/.minikube
I0827 23:53:17.713024 1950495 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0827 23:53:17.714453 1950495 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0827 23:53:14.511515 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:16.511824 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:17.716908 1950495 config.go:182] Loaded profile config "no-preload-710826": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0827 23:53:17.717562 1950495 driver.go:392] Setting default libvirt URI to qemu:///system
I0827 23:53:17.748480 1950495 docker.go:123] docker version: linux-27.2.0:Docker Engine - Community
I0827 23:53:17.748613 1950495 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0827 23:53:17.804552 1950495 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:34 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-27 23:53:17.794314673 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214843392 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0827 23:53:17.804662 1950495 docker.go:307] overlay module found
I0827 23:53:17.806481 1950495 out.go:177] * Using the docker driver based on existing profile
I0827 23:53:17.808323 1950495 start.go:297] selected driver: docker
I0827 23:53:17.808345 1950495 start.go:901] validating driver "docker" against &{Name:no-preload-710826 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:no-preload-710826 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false Mount
String:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0827 23:53:17.808551 1950495 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0827 23:53:17.809227 1950495 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0827 23:53:17.861323 1950495 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:34 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-27 23:53:17.852134116 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214843392 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0827 23:53:17.861688 1950495 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0827 23:53:17.861759 1950495 cni.go:84] Creating CNI manager for ""
I0827 23:53:17.861774 1950495 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0827 23:53:17.861819 1950495 start.go:340] cluster config:
{Name:no-preload-710826 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:no-preload-710826 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0827 23:53:17.864660 1950495 out.go:177] * Starting "no-preload-710826" primary control-plane node in "no-preload-710826" cluster
I0827 23:53:17.866389 1950495 cache.go:121] Beginning downloading kic base image for docker with containerd
I0827 23:53:17.868154 1950495 out.go:177] * Pulling base image v0.0.44-1724667927-19511 ...
I0827 23:53:17.869845 1950495 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0827 23:53:17.869940 1950495 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 in local docker daemon
I0827 23:53:17.869996 1950495 profile.go:143] Saving config to /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/no-preload-710826/config.json ...
I0827 23:53:17.870312 1950495 cache.go:107] acquiring lock: {Name:mka8ce19387b8ecc7182a163d9ad327ce657905d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0827 23:53:17.870396 1950495 cache.go:115] /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I0827 23:53:17.870410 1950495 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 104.474µs
I0827 23:53:17.870419 1950495 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I0827 23:53:17.870435 1950495 cache.go:107] acquiring lock: {Name:mk15630c99494f266f208008f7a1863d161236cd Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0827 23:53:17.870470 1950495 cache.go:115] /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0 exists
I0827 23:53:17.870479 1950495 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.0" -> "/home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0" took 45.726µs
I0827 23:53:17.870486 1950495 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.0 -> /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0 succeeded
I0827 23:53:17.870500 1950495 cache.go:107] acquiring lock: {Name:mk99ed6b473bafdb0df02dcac7f9298cea0b393e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0827 23:53:17.870530 1950495 cache.go:115] /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0 exists
I0827 23:53:17.870539 1950495 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.0" -> "/home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0" took 40.319µs
I0827 23:53:17.870546 1950495 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.0 -> /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0 succeeded
I0827 23:53:17.870555 1950495 cache.go:107] acquiring lock: {Name:mk1e52fef9af06805c4147280fd611fd98eb0833 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0827 23:53:17.870585 1950495 cache.go:115] /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0 exists
I0827 23:53:17.870593 1950495 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.0" -> "/home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0" took 36.512µs
I0827 23:53:17.870650 1950495 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.0 -> /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0 succeeded
I0827 23:53:17.870662 1950495 cache.go:107] acquiring lock: {Name:mk15121a6c6e9f015b380981da645a9205936b44 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0827 23:53:17.870725 1950495 cache.go:115] /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0 exists
I0827 23:53:17.870735 1950495 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.0" -> "/home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0" took 74.288µs
I0827 23:53:17.870741 1950495 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.0 -> /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0 succeeded
I0827 23:53:17.870761 1950495 cache.go:107] acquiring lock: {Name:mk9b39936b51bf5908de462463cfaf08be2cf7c1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0827 23:53:17.870806 1950495 cache.go:115] /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
I0827 23:53:17.870811 1950495 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 52.266µs
I0827 23:53:17.870818 1950495 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
I0827 23:53:17.870806 1950495 cache.go:107] acquiring lock: {Name:mk9547ce0efe22854f48ac74b06eac65b4021bad Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0827 23:53:17.870827 1950495 cache.go:107] acquiring lock: {Name:mk8a8775799538f1dc113727b7d3adfdd7b0bc94 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0827 23:53:17.870856 1950495 cache.go:115] /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
I0827 23:53:17.870861 1950495 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 35.15µs
I0827 23:53:17.870866 1950495 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
I0827 23:53:17.870868 1950495 cache.go:115] /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 exists
I0827 23:53:17.870876 1950495 cache.go:96] cache image "registry.k8s.io/etcd:3.5.15-0" -> "/home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0" took 79.112µs
I0827 23:53:17.870884 1950495 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.15-0 -> /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 succeeded
I0827 23:53:17.870904 1950495 cache.go:87] Successfully saved all images to host disk.
W0827 23:53:17.889844 1950495 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 is of wrong architecture
I0827 23:53:17.889864 1950495 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 to local cache
I0827 23:53:17.889966 1950495 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 in local cache directory
I0827 23:53:17.889988 1950495 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 in local cache directory, skipping pull
I0827 23:53:17.889993 1950495 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 exists in cache, skipping pull
I0827 23:53:17.890006 1950495 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 as a tarball
I0827 23:53:17.890016 1950495 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 from local cache
I0827 23:53:18.056070 1950495 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 from cached tarball
I0827 23:53:18.056111 1950495 cache.go:194] Successfully downloaded all kic artifacts
I0827 23:53:18.056153 1950495 start.go:360] acquireMachinesLock for no-preload-710826: {Name:mkb88246583f0ba141c380b10048d080b70c487f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0827 23:53:18.056224 1950495 start.go:364] duration metric: took 52.561µs to acquireMachinesLock for "no-preload-710826"
I0827 23:53:18.056249 1950495 start.go:96] Skipping create...Using existing machine configuration
I0827 23:53:18.056255 1950495 fix.go:54] fixHost starting:
I0827 23:53:18.056671 1950495 cli_runner.go:164] Run: docker container inspect no-preload-710826 --format={{.State.Status}}
I0827 23:53:18.074518 1950495 fix.go:112] recreateIfNeeded on no-preload-710826: state=Stopped err=<nil>
W0827 23:53:18.074556 1950495 fix.go:138] unexpected machine state, will restart: <nil>
I0827 23:53:18.077957 1950495 out.go:177] * Restarting existing docker container for "no-preload-710826" ...
I0827 23:53:18.079563 1950495 cli_runner.go:164] Run: docker start no-preload-710826
I0827 23:53:18.394828 1950495 cli_runner.go:164] Run: docker container inspect no-preload-710826 --format={{.State.Status}}
I0827 23:53:18.420306 1950495 kic.go:430] container "no-preload-710826" state is running.
I0827 23:53:18.420833 1950495 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-710826
I0827 23:53:18.445733 1950495 profile.go:143] Saving config to /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/no-preload-710826/config.json ...
I0827 23:53:18.445969 1950495 machine.go:93] provisionDockerMachine start ...
I0827 23:53:18.446031 1950495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-710826
I0827 23:53:18.469360 1950495 main.go:141] libmachine: Using SSH client type: native
I0827 23:53:18.469632 1950495 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33834 <nil> <nil>}
I0827 23:53:18.469641 1950495 main.go:141] libmachine: About to run SSH command:
hostname
I0827 23:53:18.470295 1950495 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:43900->127.0.0.1:33834: read: connection reset by peer
I0827 23:53:21.616073 1950495 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-710826
I0827 23:53:21.616099 1950495 ubuntu.go:169] provisioning hostname "no-preload-710826"
I0827 23:53:21.616164 1950495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-710826
I0827 23:53:21.635732 1950495 main.go:141] libmachine: Using SSH client type: native
I0827 23:53:21.635998 1950495 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33834 <nil> <nil>}
I0827 23:53:21.636014 1950495 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-710826 && echo "no-preload-710826" | sudo tee /etc/hostname
I0827 23:53:21.797426 1950495 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-710826
I0827 23:53:21.797528 1950495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-710826
I0827 23:53:21.814439 1950495 main.go:141] libmachine: Using SSH client type: native
I0827 23:53:21.814703 1950495 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33834 <nil> <nil>}
I0827 23:53:21.814726 1950495 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-710826' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-710826/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-710826' | sudo tee -a /etc/hosts;
fi
fi
I0827 23:53:21.960692 1950495 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0827 23:53:21.960723 1950495 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19522-1734325/.minikube CaCertPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19522-1734325/.minikube}
I0827 23:53:21.960748 1950495 ubuntu.go:177] setting up certificates
I0827 23:53:21.960761 1950495 provision.go:84] configureAuth start
I0827 23:53:21.960825 1950495 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-710826
I0827 23:53:21.978419 1950495 provision.go:143] copyHostCerts
I0827 23:53:21.978493 1950495 exec_runner.go:144] found /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.pem, removing ...
I0827 23:53:21.978506 1950495 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.pem
I0827 23:53:21.978582 1950495 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.pem (1078 bytes)
I0827 23:53:21.978696 1950495 exec_runner.go:144] found /home/jenkins/minikube-integration/19522-1734325/.minikube/cert.pem, removing ...
I0827 23:53:21.978707 1950495 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19522-1734325/.minikube/cert.pem
I0827 23:53:21.978736 1950495 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19522-1734325/.minikube/cert.pem (1123 bytes)
I0827 23:53:21.978802 1950495 exec_runner.go:144] found /home/jenkins/minikube-integration/19522-1734325/.minikube/key.pem, removing ...
I0827 23:53:21.978810 1950495 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19522-1734325/.minikube/key.pem
I0827 23:53:21.978836 1950495 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19522-1734325/.minikube/key.pem (1675 bytes)
I0827 23:53:21.978902 1950495 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca-key.pem org=jenkins.no-preload-710826 san=[127.0.0.1 192.168.85.2 localhost minikube no-preload-710826]
I0827 23:53:22.525420 1950495 provision.go:177] copyRemoteCerts
I0827 23:53:22.525490 1950495 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0827 23:53:22.525534 1950495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-710826
I0827 23:53:22.543636 1950495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33834 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/no-preload-710826/id_rsa Username:docker}
I0827 23:53:22.645806 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0827 23:53:22.673205 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0827 23:53:18.512595 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:21.017637 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:22.699115 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0827 23:53:22.725459 1950495 provision.go:87] duration metric: took 764.682951ms to configureAuth
I0827 23:53:22.725487 1950495 ubuntu.go:193] setting minikube options for container-runtime
I0827 23:53:22.725708 1950495 config.go:182] Loaded profile config "no-preload-710826": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0827 23:53:22.725715 1950495 machine.go:96] duration metric: took 4.279738288s to provisionDockerMachine
I0827 23:53:22.725723 1950495 start.go:293] postStartSetup for "no-preload-710826" (driver="docker")
I0827 23:53:22.725733 1950495 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0827 23:53:22.725787 1950495 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0827 23:53:22.725829 1950495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-710826
I0827 23:53:22.743313 1950495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33834 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/no-preload-710826/id_rsa Username:docker}
I0827 23:53:22.845745 1950495 ssh_runner.go:195] Run: cat /etc/os-release
I0827 23:53:22.849014 1950495 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0827 23:53:22.849061 1950495 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0827 23:53:22.849072 1950495 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0827 23:53:22.849096 1950495 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0827 23:53:22.849112 1950495 filesync.go:126] Scanning /home/jenkins/minikube-integration/19522-1734325/.minikube/addons for local assets ...
I0827 23:53:22.849182 1950495 filesync.go:126] Scanning /home/jenkins/minikube-integration/19522-1734325/.minikube/files for local assets ...
I0827 23:53:22.849273 1950495 filesync.go:149] local asset: /home/jenkins/minikube-integration/19522-1734325/.minikube/files/etc/ssl/certs/17397152.pem -> 17397152.pem in /etc/ssl/certs
I0827 23:53:22.849399 1950495 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0827 23:53:22.858445 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/files/etc/ssl/certs/17397152.pem --> /etc/ssl/certs/17397152.pem (1708 bytes)
I0827 23:53:22.883973 1950495 start.go:296] duration metric: took 158.234883ms for postStartSetup
I0827 23:53:22.884103 1950495 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0827 23:53:22.884163 1950495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-710826
I0827 23:53:22.902025 1950495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33834 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/no-preload-710826/id_rsa Username:docker}
I0827 23:53:23.003123 1950495 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0827 23:53:23.013167 1950495 fix.go:56] duration metric: took 4.956903456s for fixHost
I0827 23:53:23.013244 1950495 start.go:83] releasing machines lock for "no-preload-710826", held for 4.957009005s
I0827 23:53:23.013371 1950495 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-710826
I0827 23:53:23.033428 1950495 ssh_runner.go:195] Run: cat /version.json
I0827 23:53:23.033532 1950495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-710826
I0827 23:53:23.033838 1950495 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0827 23:53:23.033905 1950495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-710826
I0827 23:53:23.060717 1950495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33834 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/no-preload-710826/id_rsa Username:docker}
I0827 23:53:23.061254 1950495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33834 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/no-preload-710826/id_rsa Username:docker}
I0827 23:53:23.305856 1950495 ssh_runner.go:195] Run: systemctl --version
I0827 23:53:23.310457 1950495 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0827 23:53:23.314927 1950495 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0827 23:53:23.334104 1950495 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0827 23:53:23.334193 1950495 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0827 23:53:23.344278 1950495 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0827 23:53:23.344322 1950495 start.go:495] detecting cgroup driver to use...
I0827 23:53:23.344415 1950495 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0827 23:53:23.344519 1950495 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0827 23:53:23.358938 1950495 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0827 23:53:23.371215 1950495 docker.go:217] disabling cri-docker service (if available) ...
I0827 23:53:23.371327 1950495 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0827 23:53:23.385487 1950495 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0827 23:53:23.398443 1950495 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0827 23:53:23.502113 1950495 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0827 23:53:23.590966 1950495 docker.go:233] disabling docker service ...
I0827 23:53:23.591077 1950495 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0827 23:53:23.606166 1950495 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0827 23:53:23.618298 1950495 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0827 23:53:23.713960 1950495 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0827 23:53:23.798702 1950495 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0827 23:53:23.811797 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0827 23:53:23.829247 1950495 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0827 23:53:23.841627 1950495 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0827 23:53:23.852046 1950495 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0827 23:53:23.852119 1950495 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0827 23:53:23.862704 1950495 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0827 23:53:23.873506 1950495 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0827 23:53:23.883606 1950495 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0827 23:53:23.894863 1950495 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0827 23:53:23.905094 1950495 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0827 23:53:23.915514 1950495 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0827 23:53:23.926906 1950495 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0827 23:53:23.937794 1950495 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0827 23:53:23.948502 1950495 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0827 23:53:23.957377 1950495 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0827 23:53:24.065185 1950495 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0827 23:53:24.239813 1950495 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0827 23:53:24.239885 1950495 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0827 23:53:24.244810 1950495 start.go:563] Will wait 60s for crictl version
I0827 23:53:24.244874 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:53:24.248728 1950495 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0827 23:53:24.290708 1950495 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.20
RuntimeApiVersion: v1
I0827 23:53:24.290818 1950495 ssh_runner.go:195] Run: containerd --version
I0827 23:53:24.316016 1950495 ssh_runner.go:195] Run: containerd --version
I0827 23:53:24.342879 1950495 out.go:177] * Preparing Kubernetes v1.31.0 on containerd 1.7.20 ...
I0827 23:53:24.345122 1950495 cli_runner.go:164] Run: docker network inspect no-preload-710826 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0827 23:53:24.368559 1950495 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0827 23:53:24.372601 1950495 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0827 23:53:24.384817 1950495 kubeadm.go:883] updating cluster {Name:no-preload-710826 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:no-preload-710826 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenk
ins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0827 23:53:24.384939 1950495 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0827 23:53:24.384983 1950495 ssh_runner.go:195] Run: sudo crictl images --output json
I0827 23:53:24.427485 1950495 containerd.go:627] all images are preloaded for containerd runtime.
I0827 23:53:24.427518 1950495 cache_images.go:84] Images are preloaded, skipping loading
I0827 23:53:24.427527 1950495 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.31.0 containerd true true} ...
I0827 23:53:24.427686 1950495 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-710826 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.31.0 ClusterName:no-preload-710826 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0827 23:53:24.427763 1950495 ssh_runner.go:195] Run: sudo crictl info
I0827 23:53:24.471686 1950495 cni.go:84] Creating CNI manager for ""
I0827 23:53:24.471713 1950495 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0827 23:53:24.471732 1950495 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0827 23:53:24.471789 1950495 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-710826 NodeName:no-preload-710826 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodP
ath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0827 23:53:24.471947 1950495 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "no-preload-710826"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0827 23:53:24.472022 1950495 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0
I0827 23:53:24.482730 1950495 binaries.go:44] Found k8s binaries, skipping transfer
I0827 23:53:24.482809 1950495 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0827 23:53:24.492714 1950495 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (321 bytes)
I0827 23:53:24.522735 1950495 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0827 23:53:24.543828 1950495 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2171 bytes)
I0827 23:53:24.565336 1950495 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0827 23:53:24.569234 1950495 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0827 23:53:24.580607 1950495 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0827 23:53:24.669719 1950495 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0827 23:53:24.687687 1950495 certs.go:68] Setting up /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/no-preload-710826 for IP: 192.168.85.2
I0827 23:53:24.687706 1950495 certs.go:194] generating shared ca certs ...
I0827 23:53:24.687722 1950495 certs.go:226] acquiring lock for ca certs: {Name:mkd3d47e0a7419f9dbeb7a4e1a68db1090a3adb2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:53:24.687903 1950495 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.key
I0827 23:53:24.687980 1950495 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/proxy-client-ca.key
I0827 23:53:24.687994 1950495 certs.go:256] generating profile certs ...
I0827 23:53:24.688099 1950495 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/no-preload-710826/client.key
I0827 23:53:24.688195 1950495 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/no-preload-710826/apiserver.key.c3f41291
I0827 23:53:24.688255 1950495 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/no-preload-710826/proxy-client.key
I0827 23:53:24.688501 1950495 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/1739715.pem (1338 bytes)
W0827 23:53:24.688564 1950495 certs.go:480] ignoring /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/1739715_empty.pem, impossibly tiny 0 bytes
I0827 23:53:24.688579 1950495 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca-key.pem (1675 bytes)
I0827 23:53:24.688605 1950495 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem (1078 bytes)
I0827 23:53:24.688662 1950495 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/cert.pem (1123 bytes)
I0827 23:53:24.688690 1950495 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/key.pem (1675 bytes)
I0827 23:53:24.688749 1950495 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/files/etc/ssl/certs/17397152.pem (1708 bytes)
I0827 23:53:24.689451 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0827 23:53:24.718773 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0827 23:53:24.747521 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0827 23:53:24.773711 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0827 23:53:24.800557 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/no-preload-710826/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0827 23:53:24.834001 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/no-preload-710826/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0827 23:53:24.885412 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/no-preload-710826/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0827 23:53:24.921989 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/no-preload-710826/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0827 23:53:24.961821 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0827 23:53:24.991943 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/1739715.pem --> /usr/share/ca-certificates/1739715.pem (1338 bytes)
I0827 23:53:25.038575 1950495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/files/etc/ssl/certs/17397152.pem --> /usr/share/ca-certificates/17397152.pem (1708 bytes)
I0827 23:53:25.073371 1950495 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0827 23:53:25.094726 1950495 ssh_runner.go:195] Run: openssl version
I0827 23:53:25.102568 1950495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/17397152.pem && ln -fs /usr/share/ca-certificates/17397152.pem /etc/ssl/certs/17397152.pem"
I0827 23:53:25.113983 1950495 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/17397152.pem
I0827 23:53:25.118330 1950495 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 27 23:12 /usr/share/ca-certificates/17397152.pem
I0827 23:53:25.118407 1950495 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/17397152.pem
I0827 23:53:25.125911 1950495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/17397152.pem /etc/ssl/certs/3ec20f2e.0"
I0827 23:53:25.137223 1950495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0827 23:53:25.149921 1950495 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0827 23:53:25.154561 1950495 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 27 23:02 /usr/share/ca-certificates/minikubeCA.pem
I0827 23:53:25.154641 1950495 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0827 23:53:25.162866 1950495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0827 23:53:25.173176 1950495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1739715.pem && ln -fs /usr/share/ca-certificates/1739715.pem /etc/ssl/certs/1739715.pem"
I0827 23:53:25.184987 1950495 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1739715.pem
I0827 23:53:25.189435 1950495 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 27 23:12 /usr/share/ca-certificates/1739715.pem
I0827 23:53:25.189539 1950495 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1739715.pem
I0827 23:53:25.197705 1950495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1739715.pem /etc/ssl/certs/51391683.0"
I0827 23:53:25.207896 1950495 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0827 23:53:25.212272 1950495 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0827 23:53:25.219565 1950495 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0827 23:53:25.226665 1950495 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0827 23:53:25.234194 1950495 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0827 23:53:25.241856 1950495 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0827 23:53:25.249236 1950495 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0827 23:53:25.257750 1950495 kubeadm.go:392] StartCluster: {Name:no-preload-710826 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:no-preload-710826 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins
:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0827 23:53:25.257871 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0827 23:53:25.257951 1950495 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0827 23:53:25.301249 1950495 cri.go:89] found id: "41e2c7c6f8a29f512bb045de06399f7167dc694f67357f3626de21be8761a02e"
I0827 23:53:25.301274 1950495 cri.go:89] found id: "5a88bb9f5a2bd3906f3509ae2cc90d1a6624ce428bde75441f3e35a60e62e8c8"
I0827 23:53:25.301280 1950495 cri.go:89] found id: "9a811044a4368c2294519477e32cf05e41942851f970c19ca2aaa5bb256f7f03"
I0827 23:53:25.301286 1950495 cri.go:89] found id: "e9b0c909017017b75549291c3809aa4dcbec2431b93ad52fcc7b181d5a9a9c9e"
I0827 23:53:25.301290 1950495 cri.go:89] found id: "7eeb834b960d47d70b3aff513ee78b6fdb3981df22edacc56b7cb7696d92e39d"
I0827 23:53:25.301293 1950495 cri.go:89] found id: "b713cc1b1e1c0f2b792f604b17c7bb3b170955cb846e1ad3628105edd6e93a58"
I0827 23:53:25.301316 1950495 cri.go:89] found id: "1865b4877751d1fa034595f97e7c1192cb707868710e8d39e41ff972a250867b"
I0827 23:53:25.301324 1950495 cri.go:89] found id: "3214b2bf63c83209e48dba86958860f95dc13d661d173621761feb70101be3c0"
I0827 23:53:25.301334 1950495 cri.go:89] found id: ""
I0827 23:53:25.301410 1950495 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0827 23:53:25.314429 1950495 cri.go:116] JSON = null
W0827 23:53:25.314480 1950495 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0827 23:53:25.314563 1950495 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0827 23:53:25.323601 1950495 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0827 23:53:25.323623 1950495 kubeadm.go:593] restartPrimaryControlPlane start ...
I0827 23:53:25.323700 1950495 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0827 23:53:25.346116 1950495 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0827 23:53:25.346791 1950495 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-710826" does not appear in /home/jenkins/minikube-integration/19522-1734325/kubeconfig
I0827 23:53:25.347111 1950495 kubeconfig.go:62] /home/jenkins/minikube-integration/19522-1734325/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-710826" cluster setting kubeconfig missing "no-preload-710826" context setting]
I0827 23:53:25.347697 1950495 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/kubeconfig: {Name:mkbc2349839e7e640d3be8c9c9dabdbaf532417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:53:25.349419 1950495 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0827 23:53:25.363694 1950495 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2
I0827 23:53:25.363730 1950495 kubeadm.go:597] duration metric: took 40.100698ms to restartPrimaryControlPlane
I0827 23:53:25.363739 1950495 kubeadm.go:394] duration metric: took 105.998464ms to StartCluster
I0827 23:53:25.363786 1950495 settings.go:142] acquiring lock: {Name:mk2abdfb376a9e7540e648c96e5aaa1709f13213 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:53:25.363867 1950495 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19522-1734325/kubeconfig
I0827 23:53:25.365369 1950495 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/kubeconfig: {Name:mkbc2349839e7e640d3be8c9c9dabdbaf532417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:53:25.365678 1950495 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0827 23:53:25.365945 1950495 config.go:182] Loaded profile config "no-preload-710826": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0827 23:53:25.366126 1950495 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0827 23:53:25.366393 1950495 addons.go:69] Setting storage-provisioner=true in profile "no-preload-710826"
I0827 23:53:25.366435 1950495 addons.go:234] Setting addon storage-provisioner=true in "no-preload-710826"
W0827 23:53:25.366445 1950495 addons.go:243] addon storage-provisioner should already be in state true
I0827 23:53:25.366476 1950495 host.go:66] Checking if "no-preload-710826" exists ...
I0827 23:53:25.366893 1950495 addons.go:69] Setting default-storageclass=true in profile "no-preload-710826"
I0827 23:53:25.366930 1950495 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-710826"
I0827 23:53:25.367196 1950495 cli_runner.go:164] Run: docker container inspect no-preload-710826 --format={{.State.Status}}
I0827 23:53:25.367559 1950495 cli_runner.go:164] Run: docker container inspect no-preload-710826 --format={{.State.Status}}
I0827 23:53:25.371237 1950495 addons.go:69] Setting dashboard=true in profile "no-preload-710826"
I0827 23:53:25.372847 1950495 addons.go:234] Setting addon dashboard=true in "no-preload-710826"
W0827 23:53:25.372867 1950495 addons.go:243] addon dashboard should already be in state true
I0827 23:53:25.372912 1950495 host.go:66] Checking if "no-preload-710826" exists ...
I0827 23:53:25.372914 1950495 out.go:177] * Verifying Kubernetes components...
I0827 23:53:25.373385 1950495 cli_runner.go:164] Run: docker container inspect no-preload-710826 --format={{.State.Status}}
I0827 23:53:25.372794 1950495 addons.go:69] Setting metrics-server=true in profile "no-preload-710826"
I0827 23:53:25.373550 1950495 addons.go:234] Setting addon metrics-server=true in "no-preload-710826"
W0827 23:53:25.373565 1950495 addons.go:243] addon metrics-server should already be in state true
I0827 23:53:25.373588 1950495 host.go:66] Checking if "no-preload-710826" exists ...
I0827 23:53:25.374050 1950495 cli_runner.go:164] Run: docker container inspect no-preload-710826 --format={{.State.Status}}
I0827 23:53:25.378967 1950495 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0827 23:53:25.429526 1950495 addons.go:234] Setting addon default-storageclass=true in "no-preload-710826"
W0827 23:53:25.429547 1950495 addons.go:243] addon default-storageclass should already be in state true
I0827 23:53:25.429573 1950495 host.go:66] Checking if "no-preload-710826" exists ...
I0827 23:53:25.429985 1950495 cli_runner.go:164] Run: docker container inspect no-preload-710826 --format={{.State.Status}}
I0827 23:53:25.448432 1950495 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0827 23:53:25.452580 1950495 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0827 23:53:25.454490 1950495 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0827 23:53:25.454522 1950495 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0827 23:53:25.454606 1950495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-710826
I0827 23:53:25.466468 1950495 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0827 23:53:25.469017 1950495 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0827 23:53:25.469042 1950495 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0827 23:53:25.469107 1950495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-710826
I0827 23:53:25.475756 1950495 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0827 23:53:25.477462 1950495 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0827 23:53:25.477490 1950495 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0827 23:53:25.477567 1950495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-710826
I0827 23:53:25.508659 1950495 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0827 23:53:25.508680 1950495 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0827 23:53:25.508748 1950495 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-710826
I0827 23:53:25.535271 1950495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33834 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/no-preload-710826/id_rsa Username:docker}
I0827 23:53:25.535958 1950495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33834 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/no-preload-710826/id_rsa Username:docker}
I0827 23:53:25.557617 1950495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33834 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/no-preload-710826/id_rsa Username:docker}
I0827 23:53:25.569728 1950495 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33834 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/no-preload-710826/id_rsa Username:docker}
I0827 23:53:25.583921 1950495 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0827 23:53:25.690923 1950495 node_ready.go:35] waiting up to 6m0s for node "no-preload-710826" to be "Ready" ...
I0827 23:53:25.789200 1950495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0827 23:53:25.821875 1950495 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0827 23:53:25.821942 1950495 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0827 23:53:25.878215 1950495 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0827 23:53:25.878280 1950495 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0827 23:53:25.942319 1950495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0827 23:53:25.962579 1950495 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0827 23:53:25.962656 1950495 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0827 23:53:26.051374 1950495 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0827 23:53:26.051449 1950495 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0827 23:53:26.255611 1950495 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0827 23:53:26.255688 1950495 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0827 23:53:26.310706 1950495 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0827 23:53:26.310775 1950495 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0827 23:53:26.524063 1950495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0827 23:53:26.527483 1950495 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0827 23:53:26.527559 1950495 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0827 23:53:26.649684 1950495 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0827 23:53:26.649757 1950495 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0827 23:53:26.728832 1950495 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0827 23:53:26.728902 1950495 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0827 23:53:26.768802 1950495 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0827 23:53:26.768880 1950495 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0827 23:53:26.823928 1950495 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0827 23:53:26.824004 1950495 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0827 23:53:26.859100 1950495 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0827 23:53:26.859173 1950495 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0827 23:53:26.886373 1950495 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0827 23:53:23.515888 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:25.523375 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:31.675648 1950495 node_ready.go:49] node "no-preload-710826" has status "Ready":"True"
I0827 23:53:31.675679 1950495 node_ready.go:38] duration metric: took 5.9846765s for node "no-preload-710826" to be "Ready" ...
I0827 23:53:31.675689 1950495 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0827 23:53:31.686663 1950495 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-2qvsz" in "kube-system" namespace to be "Ready" ...
I0827 23:53:31.695286 1950495 pod_ready.go:93] pod "coredns-6f6b679f8f-2qvsz" in "kube-system" namespace has status "Ready":"True"
I0827 23:53:31.695315 1950495 pod_ready.go:82] duration metric: took 8.612547ms for pod "coredns-6f6b679f8f-2qvsz" in "kube-system" namespace to be "Ready" ...
I0827 23:53:31.695327 1950495 pod_ready.go:79] waiting up to 6m0s for pod "etcd-no-preload-710826" in "kube-system" namespace to be "Ready" ...
I0827 23:53:31.702424 1950495 pod_ready.go:93] pod "etcd-no-preload-710826" in "kube-system" namespace has status "Ready":"True"
I0827 23:53:31.702451 1950495 pod_ready.go:82] duration metric: took 7.115439ms for pod "etcd-no-preload-710826" in "kube-system" namespace to be "Ready" ...
I0827 23:53:31.702470 1950495 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-no-preload-710826" in "kube-system" namespace to be "Ready" ...
I0827 23:53:31.729321 1950495 pod_ready.go:93] pod "kube-apiserver-no-preload-710826" in "kube-system" namespace has status "Ready":"True"
I0827 23:53:31.729349 1950495 pod_ready.go:82] duration metric: took 26.870677ms for pod "kube-apiserver-no-preload-710826" in "kube-system" namespace to be "Ready" ...
I0827 23:53:31.729363 1950495 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-no-preload-710826" in "kube-system" namespace to be "Ready" ...
I0827 23:53:31.736077 1950495 pod_ready.go:93] pod "kube-controller-manager-no-preload-710826" in "kube-system" namespace has status "Ready":"True"
I0827 23:53:31.736103 1950495 pod_ready.go:82] duration metric: took 6.731201ms for pod "kube-controller-manager-no-preload-710826" in "kube-system" namespace to be "Ready" ...
I0827 23:53:31.736117 1950495 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-n47gz" in "kube-system" namespace to be "Ready" ...
I0827 23:53:31.879407 1950495 pod_ready.go:93] pod "kube-proxy-n47gz" in "kube-system" namespace has status "Ready":"True"
I0827 23:53:31.879433 1950495 pod_ready.go:82] duration metric: took 143.30847ms for pod "kube-proxy-n47gz" in "kube-system" namespace to be "Ready" ...
I0827 23:53:31.879446 1950495 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-no-preload-710826" in "kube-system" namespace to be "Ready" ...
I0827 23:53:28.012706 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:30.147743 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:32.516483 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:33.886497 1950495 pod_ready.go:103] pod "kube-scheduler-no-preload-710826" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:34.823303 1950495 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (9.034026578s)
I0827 23:53:34.823354 1950495 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.88096074s)
I0827 23:53:34.823587 1950495 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.299445011s)
I0827 23:53:34.823609 1950495 addons.go:475] Verifying addon metrics-server=true in "no-preload-710826"
I0827 23:53:35.108559 1950495 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (8.222078211s)
I0827 23:53:35.110391 1950495 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-710826 addons enable metrics-server
I0827 23:53:35.112157 1950495 out.go:177] * Enabled addons: storage-provisioner, metrics-server, default-storageclass, dashboard
I0827 23:53:35.113902 1950495 addons.go:510] duration metric: took 9.747767367s for enable addons: enabled=[storage-provisioner metrics-server default-storageclass dashboard]
I0827 23:53:36.386636 1950495 pod_ready.go:103] pod "kube-scheduler-no-preload-710826" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:35.017465 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:37.511824 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:38.387098 1950495 pod_ready.go:103] pod "kube-scheduler-no-preload-710826" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:40.886839 1950495 pod_ready.go:103] pod "kube-scheduler-no-preload-710826" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:39.514454 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:41.514541 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:43.386009 1950495 pod_ready.go:93] pod "kube-scheduler-no-preload-710826" in "kube-system" namespace has status "Ready":"True"
I0827 23:53:43.386035 1950495 pod_ready.go:82] duration metric: took 11.506580804s for pod "kube-scheduler-no-preload-710826" in "kube-system" namespace to be "Ready" ...
I0827 23:53:43.386047 1950495 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace to be "Ready" ...
I0827 23:53:45.394073 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:43.519764 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:46.021968 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:47.892343 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:49.892783 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:52.393405 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:48.023259 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:50.024458 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:52.511505 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:54.892671 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:57.392396 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:54.513571 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:57.022234 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:59.392601 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:01.392899 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:53:59.512743 1945499 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:00.513778 1945499 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"True"
I0827 23:54:00.513813 1945499 pod_ready.go:82] duration metric: took 1m22.008565732s for pod "kube-controller-manager-old-k8s-version-394049" in "kube-system" namespace to be "Ready" ...
I0827 23:54:00.513827 1945499 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-d84wl" in "kube-system" namespace to be "Ready" ...
I0827 23:54:00.522113 1945499 pod_ready.go:93] pod "kube-proxy-d84wl" in "kube-system" namespace has status "Ready":"True"
I0827 23:54:00.522142 1945499 pod_ready.go:82] duration metric: took 8.306412ms for pod "kube-proxy-d84wl" in "kube-system" namespace to be "Ready" ...
I0827 23:54:00.522155 1945499 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-394049" in "kube-system" namespace to be "Ready" ...
I0827 23:54:00.528947 1945499 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-394049" in "kube-system" namespace has status "Ready":"True"
I0827 23:54:00.528983 1945499 pod_ready.go:82] duration metric: took 6.820274ms for pod "kube-scheduler-old-k8s-version-394049" in "kube-system" namespace to be "Ready" ...
I0827 23:54:00.528997 1945499 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace to be "Ready" ...
I0827 23:54:02.538013 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:03.892725 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:05.898401 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:05.049335 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:07.536856 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:08.392761 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:10.392803 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:09.544754 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:12.036784 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:12.893635 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:15.393304 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:17.395448 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:14.037634 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:16.544787 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:19.892052 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:22.392752 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:19.036321 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:21.041602 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:24.891711 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:26.892650 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:23.535686 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:25.536146 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:27.540761 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:29.392339 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:31.895229 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:30.071722 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:32.538311 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:34.393973 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:36.394292 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:35.039074 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:37.535387 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:38.892647 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:41.392169 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:39.537746 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:41.542557 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:43.394839 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:45.893185 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:44.037226 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:46.535616 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:48.392468 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:50.392903 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:48.537805 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:50.542500 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:52.891933 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:54.892619 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:57.392557 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:53.036589 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:55.068559 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:57.535050 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:59.892106 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:01.892891 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:54:59.536221 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:01.541466 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:03.894003 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:06.392067 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:04.036840 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:06.037668 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:08.392170 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:10.891746 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:08.540614 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:11.040996 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:12.892528 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:14.896991 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:17.392794 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:13.536098 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:16.036958 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:19.392932 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:21.892600 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:18.037758 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:20.059068 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:22.542251 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:24.393620 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:26.893071 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:25.055999 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:27.549747 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:29.391539 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:31.392269 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:30.088038 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:32.535845 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:33.392940 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:35.892653 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:35.042825 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:37.537449 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:38.391836 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:40.391901 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:42.392225 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:39.541413 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:42.036947 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:44.392859 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:46.891491 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:44.541623 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:47.037061 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:48.899586 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:51.391460 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:49.536624 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:51.540666 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:53.392492 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:55.392571 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:54.039877 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:56.041431 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:57.891769 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:59.895284 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:02.392294 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:55:58.535820 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:00.569693 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:04.893757 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:07.393129 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:03.036146 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:05.063202 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:07.535319 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:09.892107 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:12.391720 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:09.542740 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:12.036240 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:14.392747 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:16.892489 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:14.041915 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:16.538564 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:18.893341 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:21.395832 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:18.539387 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:20.542941 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:23.892727 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:26.392776 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:23.035989 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:25.041259 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:27.535751 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:28.891774 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:30.891889 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:30.051150 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:32.541544 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:32.893338 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:35.392006 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:35.052137 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:37.541729 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:37.892150 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:40.392697 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:39.543135 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:42.044288 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:42.892240 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:44.892866 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:47.392565 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:44.536100 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:47.036663 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:49.892970 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:52.392281 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:49.541661 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:52.041046 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:54.893333 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:57.391963 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:54.545514 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:57.037925 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:59.392691 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:01.393790 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:56:59.537151 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:01.541807 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:03.892019 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:05.892143 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:04.036301 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:06.037323 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:08.391443 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:10.392104 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:12.392539 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:08.037761 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:10.061967 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:12.085447 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:14.892273 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:16.892703 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:14.549156 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:17.035779 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:19.393993 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:21.892544 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:19.036443 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:21.039024 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:24.392967 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:26.393588 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:23.536705 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:25.537439 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:28.397047 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:30.892404 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:28.037022 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:30.047408 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:32.535922 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:33.392798 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:35.892896 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:34.538361 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:37.040054 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:38.392874 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:40.393058 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:42.393262 1950495 pod_ready.go:103] pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:39.543065 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:41.543734 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:43.392530 1950495 pod_ready.go:82] duration metric: took 4m0.006469226s for pod "metrics-server-6867b74b74-shq79" in "kube-system" namespace to be "Ready" ...
E0827 23:57:43.392557 1950495 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0827 23:57:43.392567 1950495 pod_ready.go:39] duration metric: took 4m11.716866754s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0827 23:57:43.392583 1950495 api_server.go:52] waiting for apiserver process to appear ...
I0827 23:57:43.392612 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0827 23:57:43.392681 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0827 23:57:43.444514 1950495 cri.go:89] found id: "fe84704b7ec75f3193ef02843fe7925f27be359c6442cfaf08b9f6331b56d51d"
I0827 23:57:43.444535 1950495 cri.go:89] found id: "7eeb834b960d47d70b3aff513ee78b6fdb3981df22edacc56b7cb7696d92e39d"
I0827 23:57:43.444540 1950495 cri.go:89] found id: ""
I0827 23:57:43.444548 1950495 logs.go:276] 2 containers: [fe84704b7ec75f3193ef02843fe7925f27be359c6442cfaf08b9f6331b56d51d 7eeb834b960d47d70b3aff513ee78b6fdb3981df22edacc56b7cb7696d92e39d]
I0827 23:57:43.444608 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.448410 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.451930 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0827 23:57:43.452055 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0827 23:57:43.492010 1950495 cri.go:89] found id: "443f90b5f48af310c2a0b29003f0492d900d5b22c61ca83e0398e565e9627e8b"
I0827 23:57:43.492040 1950495 cri.go:89] found id: "1865b4877751d1fa034595f97e7c1192cb707868710e8d39e41ff972a250867b"
I0827 23:57:43.492046 1950495 cri.go:89] found id: ""
I0827 23:57:43.492053 1950495 logs.go:276] 2 containers: [443f90b5f48af310c2a0b29003f0492d900d5b22c61ca83e0398e565e9627e8b 1865b4877751d1fa034595f97e7c1192cb707868710e8d39e41ff972a250867b]
I0827 23:57:43.492150 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.496054 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.499406 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0827 23:57:43.499482 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0827 23:57:43.552911 1950495 cri.go:89] found id: "9c280433fc76d28f921c042176fd9bb1616fb0c3c3e3b7fb9300c083169f45f5"
I0827 23:57:43.552939 1950495 cri.go:89] found id: "5a88bb9f5a2bd3906f3509ae2cc90d1a6624ce428bde75441f3e35a60e62e8c8"
I0827 23:57:43.552944 1950495 cri.go:89] found id: ""
I0827 23:57:43.552952 1950495 logs.go:276] 2 containers: [9c280433fc76d28f921c042176fd9bb1616fb0c3c3e3b7fb9300c083169f45f5 5a88bb9f5a2bd3906f3509ae2cc90d1a6624ce428bde75441f3e35a60e62e8c8]
I0827 23:57:43.553012 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.557540 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.561265 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0827 23:57:43.561347 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0827 23:57:43.606790 1950495 cri.go:89] found id: "0d1cf85ef119b2b508445f437ec6a72b6e9b5d923a65336c1472928c8afc5e4f"
I0827 23:57:43.606816 1950495 cri.go:89] found id: "b713cc1b1e1c0f2b792f604b17c7bb3b170955cb846e1ad3628105edd6e93a58"
I0827 23:57:43.606821 1950495 cri.go:89] found id: ""
I0827 23:57:43.606828 1950495 logs.go:276] 2 containers: [0d1cf85ef119b2b508445f437ec6a72b6e9b5d923a65336c1472928c8afc5e4f b713cc1b1e1c0f2b792f604b17c7bb3b170955cb846e1ad3628105edd6e93a58]
I0827 23:57:43.606885 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.610382 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.614032 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0827 23:57:43.614116 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0827 23:57:43.660181 1950495 cri.go:89] found id: "253f4b2cc40f2d9b5d44222a444d2a4bc7992f0997e349067086d6afbbb4630a"
I0827 23:57:43.660251 1950495 cri.go:89] found id: "e9b0c909017017b75549291c3809aa4dcbec2431b93ad52fcc7b181d5a9a9c9e"
I0827 23:57:43.660270 1950495 cri.go:89] found id: ""
I0827 23:57:43.660293 1950495 logs.go:276] 2 containers: [253f4b2cc40f2d9b5d44222a444d2a4bc7992f0997e349067086d6afbbb4630a e9b0c909017017b75549291c3809aa4dcbec2431b93ad52fcc7b181d5a9a9c9e]
I0827 23:57:43.660402 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.664144 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.667637 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0827 23:57:43.667711 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0827 23:57:43.710757 1950495 cri.go:89] found id: "cb24367aaaecbaac8d5793d07ed4e77d1fe624807621b2d14b96f71eb8a3e865"
I0827 23:57:43.710783 1950495 cri.go:89] found id: "3214b2bf63c83209e48dba86958860f95dc13d661d173621761feb70101be3c0"
I0827 23:57:43.710788 1950495 cri.go:89] found id: ""
I0827 23:57:43.710796 1950495 logs.go:276] 2 containers: [cb24367aaaecbaac8d5793d07ed4e77d1fe624807621b2d14b96f71eb8a3e865 3214b2bf63c83209e48dba86958860f95dc13d661d173621761feb70101be3c0]
I0827 23:57:43.710883 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.714934 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.718700 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0827 23:57:43.718825 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0827 23:57:43.759892 1950495 cri.go:89] found id: "abde7dff43fa43bf43a929f61cf84f0eb9f24c56d99b9aa35541d66d431bc5fd"
I0827 23:57:43.759918 1950495 cri.go:89] found id: "9a811044a4368c2294519477e32cf05e41942851f970c19ca2aaa5bb256f7f03"
I0827 23:57:43.759923 1950495 cri.go:89] found id: ""
I0827 23:57:43.759930 1950495 logs.go:276] 2 containers: [abde7dff43fa43bf43a929f61cf84f0eb9f24c56d99b9aa35541d66d431bc5fd 9a811044a4368c2294519477e32cf05e41942851f970c19ca2aaa5bb256f7f03]
I0827 23:57:43.760009 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.763755 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.766957 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0827 23:57:43.767030 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0827 23:57:43.809468 1950495 cri.go:89] found id: "37375e3ac2ad29c8f5d1122c62552e0a2c394a7ec2cca31caade50b5c68ec57f"
I0827 23:57:43.809540 1950495 cri.go:89] found id: ""
I0827 23:57:43.809557 1950495 logs.go:276] 1 containers: [37375e3ac2ad29c8f5d1122c62552e0a2c394a7ec2cca31caade50b5c68ec57f]
I0827 23:57:43.809625 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.813586 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0827 23:57:43.813706 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0827 23:57:43.852825 1950495 cri.go:89] found id: "2d3fde405c4f70c241a237307888dbc766233bc3a92b248405db0a2742e2a707"
I0827 23:57:43.852857 1950495 cri.go:89] found id: "e300611d2e10fce610e01a8992253bd8224a55769ac78984311fc121390a2bd9"
I0827 23:57:43.852862 1950495 cri.go:89] found id: ""
I0827 23:57:43.852869 1950495 logs.go:276] 2 containers: [2d3fde405c4f70c241a237307888dbc766233bc3a92b248405db0a2742e2a707 e300611d2e10fce610e01a8992253bd8224a55769ac78984311fc121390a2bd9]
I0827 23:57:43.852945 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.856959 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:43.860440 1950495 logs.go:123] Gathering logs for kube-apiserver [fe84704b7ec75f3193ef02843fe7925f27be359c6442cfaf08b9f6331b56d51d] ...
I0827 23:57:43.860482 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fe84704b7ec75f3193ef02843fe7925f27be359c6442cfaf08b9f6331b56d51d"
I0827 23:57:43.918957 1950495 logs.go:123] Gathering logs for containerd ...
I0827 23:57:43.918993 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0827 23:57:43.990451 1950495 logs.go:123] Gathering logs for kubelet ...
I0827 23:57:43.990488 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0827 23:57:44.072771 1950495 logs.go:123] Gathering logs for kube-apiserver [7eeb834b960d47d70b3aff513ee78b6fdb3981df22edacc56b7cb7696d92e39d] ...
I0827 23:57:44.072806 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7eeb834b960d47d70b3aff513ee78b6fdb3981df22edacc56b7cb7696d92e39d"
I0827 23:57:44.130927 1950495 logs.go:123] Gathering logs for coredns [9c280433fc76d28f921c042176fd9bb1616fb0c3c3e3b7fb9300c083169f45f5] ...
I0827 23:57:44.130960 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9c280433fc76d28f921c042176fd9bb1616fb0c3c3e3b7fb9300c083169f45f5"
I0827 23:57:44.183451 1950495 logs.go:123] Gathering logs for kube-scheduler [0d1cf85ef119b2b508445f437ec6a72b6e9b5d923a65336c1472928c8afc5e4f] ...
I0827 23:57:44.183479 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0d1cf85ef119b2b508445f437ec6a72b6e9b5d923a65336c1472928c8afc5e4f"
I0827 23:57:44.231935 1950495 logs.go:123] Gathering logs for kube-scheduler [b713cc1b1e1c0f2b792f604b17c7bb3b170955cb846e1ad3628105edd6e93a58] ...
I0827 23:57:44.231963 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b713cc1b1e1c0f2b792f604b17c7bb3b170955cb846e1ad3628105edd6e93a58"
I0827 23:57:44.284125 1950495 logs.go:123] Gathering logs for kube-proxy [253f4b2cc40f2d9b5d44222a444d2a4bc7992f0997e349067086d6afbbb4630a] ...
I0827 23:57:44.284168 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 253f4b2cc40f2d9b5d44222a444d2a4bc7992f0997e349067086d6afbbb4630a"
I0827 23:57:44.325749 1950495 logs.go:123] Gathering logs for kube-controller-manager [cb24367aaaecbaac8d5793d07ed4e77d1fe624807621b2d14b96f71eb8a3e865] ...
I0827 23:57:44.325780 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cb24367aaaecbaac8d5793d07ed4e77d1fe624807621b2d14b96f71eb8a3e865"
I0827 23:57:44.425509 1950495 logs.go:123] Gathering logs for kubernetes-dashboard [37375e3ac2ad29c8f5d1122c62552e0a2c394a7ec2cca31caade50b5c68ec57f] ...
I0827 23:57:44.425543 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 37375e3ac2ad29c8f5d1122c62552e0a2c394a7ec2cca31caade50b5c68ec57f"
I0827 23:57:44.469487 1950495 logs.go:123] Gathering logs for dmesg ...
I0827 23:57:44.469513 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0827 23:57:44.487776 1950495 logs.go:123] Gathering logs for storage-provisioner [e300611d2e10fce610e01a8992253bd8224a55769ac78984311fc121390a2bd9] ...
I0827 23:57:44.487810 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e300611d2e10fce610e01a8992253bd8224a55769ac78984311fc121390a2bd9"
I0827 23:57:44.527115 1950495 logs.go:123] Gathering logs for etcd [1865b4877751d1fa034595f97e7c1192cb707868710e8d39e41ff972a250867b] ...
I0827 23:57:44.527142 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1865b4877751d1fa034595f97e7c1192cb707868710e8d39e41ff972a250867b"
I0827 23:57:44.583321 1950495 logs.go:123] Gathering logs for kube-proxy [e9b0c909017017b75549291c3809aa4dcbec2431b93ad52fcc7b181d5a9a9c9e] ...
I0827 23:57:44.583369 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e9b0c909017017b75549291c3809aa4dcbec2431b93ad52fcc7b181d5a9a9c9e"
I0827 23:57:44.636771 1950495 logs.go:123] Gathering logs for kindnet [9a811044a4368c2294519477e32cf05e41942851f970c19ca2aaa5bb256f7f03] ...
I0827 23:57:44.636800 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9a811044a4368c2294519477e32cf05e41942851f970c19ca2aaa5bb256f7f03"
I0827 23:57:44.678482 1950495 logs.go:123] Gathering logs for storage-provisioner [2d3fde405c4f70c241a237307888dbc766233bc3a92b248405db0a2742e2a707] ...
I0827 23:57:44.678514 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2d3fde405c4f70c241a237307888dbc766233bc3a92b248405db0a2742e2a707"
I0827 23:57:44.718429 1950495 logs.go:123] Gathering logs for container status ...
I0827 23:57:44.718459 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0827 23:57:44.772877 1950495 logs.go:123] Gathering logs for describe nodes ...
I0827 23:57:44.772911 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0827 23:57:44.950302 1950495 logs.go:123] Gathering logs for coredns [5a88bb9f5a2bd3906f3509ae2cc90d1a6624ce428bde75441f3e35a60e62e8c8] ...
I0827 23:57:44.950413 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5a88bb9f5a2bd3906f3509ae2cc90d1a6624ce428bde75441f3e35a60e62e8c8"
I0827 23:57:44.998849 1950495 logs.go:123] Gathering logs for kube-controller-manager [3214b2bf63c83209e48dba86958860f95dc13d661d173621761feb70101be3c0] ...
I0827 23:57:44.998885 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3214b2bf63c83209e48dba86958860f95dc13d661d173621761feb70101be3c0"
I0827 23:57:45.203171 1950495 logs.go:123] Gathering logs for kindnet [abde7dff43fa43bf43a929f61cf84f0eb9f24c56d99b9aa35541d66d431bc5fd] ...
I0827 23:57:45.203216 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 abde7dff43fa43bf43a929f61cf84f0eb9f24c56d99b9aa35541d66d431bc5fd"
I0827 23:57:45.270709 1950495 logs.go:123] Gathering logs for etcd [443f90b5f48af310c2a0b29003f0492d900d5b22c61ca83e0398e565e9627e8b] ...
I0827 23:57:45.270750 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 443f90b5f48af310c2a0b29003f0492d900d5b22c61ca83e0398e565e9627e8b"
I0827 23:57:44.037557 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:46.535805 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:47.838045 1950495 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0827 23:57:47.851201 1950495 api_server.go:72] duration metric: took 4m22.485478879s to wait for apiserver process to appear ...
I0827 23:57:47.851234 1950495 api_server.go:88] waiting for apiserver healthz status ...
I0827 23:57:47.851272 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0827 23:57:47.851332 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0827 23:57:47.889350 1950495 cri.go:89] found id: "fe84704b7ec75f3193ef02843fe7925f27be359c6442cfaf08b9f6331b56d51d"
I0827 23:57:47.889373 1950495 cri.go:89] found id: "7eeb834b960d47d70b3aff513ee78b6fdb3981df22edacc56b7cb7696d92e39d"
I0827 23:57:47.889379 1950495 cri.go:89] found id: ""
I0827 23:57:47.889386 1950495 logs.go:276] 2 containers: [fe84704b7ec75f3193ef02843fe7925f27be359c6442cfaf08b9f6331b56d51d 7eeb834b960d47d70b3aff513ee78b6fdb3981df22edacc56b7cb7696d92e39d]
I0827 23:57:47.889450 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:47.893274 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:47.897270 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0827 23:57:47.897385 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0827 23:57:47.944355 1950495 cri.go:89] found id: "443f90b5f48af310c2a0b29003f0492d900d5b22c61ca83e0398e565e9627e8b"
I0827 23:57:47.944467 1950495 cri.go:89] found id: "1865b4877751d1fa034595f97e7c1192cb707868710e8d39e41ff972a250867b"
I0827 23:57:47.944473 1950495 cri.go:89] found id: ""
I0827 23:57:47.944481 1950495 logs.go:276] 2 containers: [443f90b5f48af310c2a0b29003f0492d900d5b22c61ca83e0398e565e9627e8b 1865b4877751d1fa034595f97e7c1192cb707868710e8d39e41ff972a250867b]
I0827 23:57:47.944572 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:47.948750 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:47.952681 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0827 23:57:47.952785 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0827 23:57:47.995078 1950495 cri.go:89] found id: "9c280433fc76d28f921c042176fd9bb1616fb0c3c3e3b7fb9300c083169f45f5"
I0827 23:57:47.995153 1950495 cri.go:89] found id: "5a88bb9f5a2bd3906f3509ae2cc90d1a6624ce428bde75441f3e35a60e62e8c8"
I0827 23:57:47.995173 1950495 cri.go:89] found id: ""
I0827 23:57:47.995185 1950495 logs.go:276] 2 containers: [9c280433fc76d28f921c042176fd9bb1616fb0c3c3e3b7fb9300c083169f45f5 5a88bb9f5a2bd3906f3509ae2cc90d1a6624ce428bde75441f3e35a60e62e8c8]
I0827 23:57:47.995243 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:47.999912 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:48.005506 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0827 23:57:48.005664 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0827 23:57:48.063158 1950495 cri.go:89] found id: "0d1cf85ef119b2b508445f437ec6a72b6e9b5d923a65336c1472928c8afc5e4f"
I0827 23:57:48.063232 1950495 cri.go:89] found id: "b713cc1b1e1c0f2b792f604b17c7bb3b170955cb846e1ad3628105edd6e93a58"
I0827 23:57:48.063251 1950495 cri.go:89] found id: ""
I0827 23:57:48.063274 1950495 logs.go:276] 2 containers: [0d1cf85ef119b2b508445f437ec6a72b6e9b5d923a65336c1472928c8afc5e4f b713cc1b1e1c0f2b792f604b17c7bb3b170955cb846e1ad3628105edd6e93a58]
I0827 23:57:48.063355 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:48.067136 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:48.071390 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0827 23:57:48.071569 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0827 23:57:48.111554 1950495 cri.go:89] found id: "253f4b2cc40f2d9b5d44222a444d2a4bc7992f0997e349067086d6afbbb4630a"
I0827 23:57:48.111584 1950495 cri.go:89] found id: "e9b0c909017017b75549291c3809aa4dcbec2431b93ad52fcc7b181d5a9a9c9e"
I0827 23:57:48.111589 1950495 cri.go:89] found id: ""
I0827 23:57:48.111597 1950495 logs.go:276] 2 containers: [253f4b2cc40f2d9b5d44222a444d2a4bc7992f0997e349067086d6afbbb4630a e9b0c909017017b75549291c3809aa4dcbec2431b93ad52fcc7b181d5a9a9c9e]
I0827 23:57:48.111660 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:48.115907 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:48.119524 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0827 23:57:48.119624 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0827 23:57:48.169736 1950495 cri.go:89] found id: "cb24367aaaecbaac8d5793d07ed4e77d1fe624807621b2d14b96f71eb8a3e865"
I0827 23:57:48.169758 1950495 cri.go:89] found id: "3214b2bf63c83209e48dba86958860f95dc13d661d173621761feb70101be3c0"
I0827 23:57:48.169764 1950495 cri.go:89] found id: ""
I0827 23:57:48.169772 1950495 logs.go:276] 2 containers: [cb24367aaaecbaac8d5793d07ed4e77d1fe624807621b2d14b96f71eb8a3e865 3214b2bf63c83209e48dba86958860f95dc13d661d173621761feb70101be3c0]
I0827 23:57:48.169837 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:48.173883 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:48.177742 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0827 23:57:48.177842 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0827 23:57:48.216575 1950495 cri.go:89] found id: "abde7dff43fa43bf43a929f61cf84f0eb9f24c56d99b9aa35541d66d431bc5fd"
I0827 23:57:48.216642 1950495 cri.go:89] found id: "9a811044a4368c2294519477e32cf05e41942851f970c19ca2aaa5bb256f7f03"
I0827 23:57:48.216661 1950495 cri.go:89] found id: ""
I0827 23:57:48.216682 1950495 logs.go:276] 2 containers: [abde7dff43fa43bf43a929f61cf84f0eb9f24c56d99b9aa35541d66d431bc5fd 9a811044a4368c2294519477e32cf05e41942851f970c19ca2aaa5bb256f7f03]
I0827 23:57:48.216766 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:48.220665 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:48.225494 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0827 23:57:48.225588 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0827 23:57:48.271566 1950495 cri.go:89] found id: "37375e3ac2ad29c8f5d1122c62552e0a2c394a7ec2cca31caade50b5c68ec57f"
I0827 23:57:48.271593 1950495 cri.go:89] found id: ""
I0827 23:57:48.271601 1950495 logs.go:276] 1 containers: [37375e3ac2ad29c8f5d1122c62552e0a2c394a7ec2cca31caade50b5c68ec57f]
I0827 23:57:48.271658 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:48.275269 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0827 23:57:48.275346 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0827 23:57:48.318568 1950495 cri.go:89] found id: "2d3fde405c4f70c241a237307888dbc766233bc3a92b248405db0a2742e2a707"
I0827 23:57:48.318593 1950495 cri.go:89] found id: "e300611d2e10fce610e01a8992253bd8224a55769ac78984311fc121390a2bd9"
I0827 23:57:48.318598 1950495 cri.go:89] found id: ""
I0827 23:57:48.318606 1950495 logs.go:276] 2 containers: [2d3fde405c4f70c241a237307888dbc766233bc3a92b248405db0a2742e2a707 e300611d2e10fce610e01a8992253bd8224a55769ac78984311fc121390a2bd9]
I0827 23:57:48.318663 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:48.322304 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:48.325762 1950495 logs.go:123] Gathering logs for dmesg ...
I0827 23:57:48.325790 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0827 23:57:48.342320 1950495 logs.go:123] Gathering logs for etcd [1865b4877751d1fa034595f97e7c1192cb707868710e8d39e41ff972a250867b] ...
I0827 23:57:48.342362 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1865b4877751d1fa034595f97e7c1192cb707868710e8d39e41ff972a250867b"
I0827 23:57:48.395893 1950495 logs.go:123] Gathering logs for kubernetes-dashboard [37375e3ac2ad29c8f5d1122c62552e0a2c394a7ec2cca31caade50b5c68ec57f] ...
I0827 23:57:48.395924 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 37375e3ac2ad29c8f5d1122c62552e0a2c394a7ec2cca31caade50b5c68ec57f"
I0827 23:57:48.438042 1950495 logs.go:123] Gathering logs for container status ...
I0827 23:57:48.438071 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0827 23:57:48.484157 1950495 logs.go:123] Gathering logs for kubelet ...
I0827 23:57:48.484187 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0827 23:57:48.558011 1950495 logs.go:123] Gathering logs for coredns [5a88bb9f5a2bd3906f3509ae2cc90d1a6624ce428bde75441f3e35a60e62e8c8] ...
I0827 23:57:48.558046 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5a88bb9f5a2bd3906f3509ae2cc90d1a6624ce428bde75441f3e35a60e62e8c8"
I0827 23:57:48.596729 1950495 logs.go:123] Gathering logs for etcd [443f90b5f48af310c2a0b29003f0492d900d5b22c61ca83e0398e565e9627e8b] ...
I0827 23:57:48.596758 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 443f90b5f48af310c2a0b29003f0492d900d5b22c61ca83e0398e565e9627e8b"
I0827 23:57:48.641281 1950495 logs.go:123] Gathering logs for kube-scheduler [b713cc1b1e1c0f2b792f604b17c7bb3b170955cb846e1ad3628105edd6e93a58] ...
I0827 23:57:48.641313 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b713cc1b1e1c0f2b792f604b17c7bb3b170955cb846e1ad3628105edd6e93a58"
I0827 23:57:48.687212 1950495 logs.go:123] Gathering logs for kube-proxy [253f4b2cc40f2d9b5d44222a444d2a4bc7992f0997e349067086d6afbbb4630a] ...
I0827 23:57:48.687246 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 253f4b2cc40f2d9b5d44222a444d2a4bc7992f0997e349067086d6afbbb4630a"
I0827 23:57:48.726062 1950495 logs.go:123] Gathering logs for kube-proxy [e9b0c909017017b75549291c3809aa4dcbec2431b93ad52fcc7b181d5a9a9c9e] ...
I0827 23:57:48.726090 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e9b0c909017017b75549291c3809aa4dcbec2431b93ad52fcc7b181d5a9a9c9e"
I0827 23:57:48.774283 1950495 logs.go:123] Gathering logs for kindnet [9a811044a4368c2294519477e32cf05e41942851f970c19ca2aaa5bb256f7f03] ...
I0827 23:57:48.774313 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9a811044a4368c2294519477e32cf05e41942851f970c19ca2aaa5bb256f7f03"
I0827 23:57:48.818358 1950495 logs.go:123] Gathering logs for storage-provisioner [e300611d2e10fce610e01a8992253bd8224a55769ac78984311fc121390a2bd9] ...
I0827 23:57:48.818391 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e300611d2e10fce610e01a8992253bd8224a55769ac78984311fc121390a2bd9"
I0827 23:57:48.858739 1950495 logs.go:123] Gathering logs for containerd ...
I0827 23:57:48.858770 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0827 23:57:48.926683 1950495 logs.go:123] Gathering logs for kube-apiserver [7eeb834b960d47d70b3aff513ee78b6fdb3981df22edacc56b7cb7696d92e39d] ...
I0827 23:57:48.926722 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7eeb834b960d47d70b3aff513ee78b6fdb3981df22edacc56b7cb7696d92e39d"
I0827 23:57:48.977218 1950495 logs.go:123] Gathering logs for kube-apiserver [fe84704b7ec75f3193ef02843fe7925f27be359c6442cfaf08b9f6331b56d51d] ...
I0827 23:57:48.977258 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fe84704b7ec75f3193ef02843fe7925f27be359c6442cfaf08b9f6331b56d51d"
I0827 23:57:49.048545 1950495 logs.go:123] Gathering logs for coredns [9c280433fc76d28f921c042176fd9bb1616fb0c3c3e3b7fb9300c083169f45f5] ...
I0827 23:57:49.048626 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9c280433fc76d28f921c042176fd9bb1616fb0c3c3e3b7fb9300c083169f45f5"
I0827 23:57:49.088620 1950495 logs.go:123] Gathering logs for kube-scheduler [0d1cf85ef119b2b508445f437ec6a72b6e9b5d923a65336c1472928c8afc5e4f] ...
I0827 23:57:49.088650 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0d1cf85ef119b2b508445f437ec6a72b6e9b5d923a65336c1472928c8afc5e4f"
I0827 23:57:49.131893 1950495 logs.go:123] Gathering logs for kube-controller-manager [cb24367aaaecbaac8d5793d07ed4e77d1fe624807621b2d14b96f71eb8a3e865] ...
I0827 23:57:49.131924 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cb24367aaaecbaac8d5793d07ed4e77d1fe624807621b2d14b96f71eb8a3e865"
I0827 23:57:49.204810 1950495 logs.go:123] Gathering logs for kube-controller-manager [3214b2bf63c83209e48dba86958860f95dc13d661d173621761feb70101be3c0] ...
I0827 23:57:49.204847 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3214b2bf63c83209e48dba86958860f95dc13d661d173621761feb70101be3c0"
I0827 23:57:49.260954 1950495 logs.go:123] Gathering logs for kindnet [abde7dff43fa43bf43a929f61cf84f0eb9f24c56d99b9aa35541d66d431bc5fd] ...
I0827 23:57:49.260991 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 abde7dff43fa43bf43a929f61cf84f0eb9f24c56d99b9aa35541d66d431bc5fd"
I0827 23:57:49.304453 1950495 logs.go:123] Gathering logs for storage-provisioner [2d3fde405c4f70c241a237307888dbc766233bc3a92b248405db0a2742e2a707] ...
I0827 23:57:49.304484 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2d3fde405c4f70c241a237307888dbc766233bc3a92b248405db0a2742e2a707"
I0827 23:57:49.344361 1950495 logs.go:123] Gathering logs for describe nodes ...
I0827 23:57:49.344481 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0827 23:57:51.982014 1950495 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0827 23:57:51.989673 1950495 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0827 23:57:51.990817 1950495 api_server.go:141] control plane version: v1.31.0
I0827 23:57:51.990843 1950495 api_server.go:131] duration metric: took 4.139600514s to wait for apiserver health ...
I0827 23:57:51.990852 1950495 system_pods.go:43] waiting for kube-system pods to appear ...
I0827 23:57:51.990875 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0827 23:57:51.990938 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0827 23:57:52.049131 1950495 cri.go:89] found id: "fe84704b7ec75f3193ef02843fe7925f27be359c6442cfaf08b9f6331b56d51d"
I0827 23:57:52.049156 1950495 cri.go:89] found id: "7eeb834b960d47d70b3aff513ee78b6fdb3981df22edacc56b7cb7696d92e39d"
I0827 23:57:52.049161 1950495 cri.go:89] found id: ""
I0827 23:57:52.049169 1950495 logs.go:276] 2 containers: [fe84704b7ec75f3193ef02843fe7925f27be359c6442cfaf08b9f6331b56d51d 7eeb834b960d47d70b3aff513ee78b6fdb3981df22edacc56b7cb7696d92e39d]
I0827 23:57:52.049229 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.053399 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.057400 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0827 23:57:52.057472 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0827 23:57:52.105022 1950495 cri.go:89] found id: "443f90b5f48af310c2a0b29003f0492d900d5b22c61ca83e0398e565e9627e8b"
I0827 23:57:52.105046 1950495 cri.go:89] found id: "1865b4877751d1fa034595f97e7c1192cb707868710e8d39e41ff972a250867b"
I0827 23:57:52.105051 1950495 cri.go:89] found id: ""
I0827 23:57:52.105059 1950495 logs.go:276] 2 containers: [443f90b5f48af310c2a0b29003f0492d900d5b22c61ca83e0398e565e9627e8b 1865b4877751d1fa034595f97e7c1192cb707868710e8d39e41ff972a250867b]
I0827 23:57:52.105120 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.109280 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.113225 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0827 23:57:52.113325 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0827 23:57:52.160333 1950495 cri.go:89] found id: "9c280433fc76d28f921c042176fd9bb1616fb0c3c3e3b7fb9300c083169f45f5"
I0827 23:57:52.160354 1950495 cri.go:89] found id: "5a88bb9f5a2bd3906f3509ae2cc90d1a6624ce428bde75441f3e35a60e62e8c8"
I0827 23:57:52.160360 1950495 cri.go:89] found id: ""
I0827 23:57:52.160394 1950495 logs.go:276] 2 containers: [9c280433fc76d28f921c042176fd9bb1616fb0c3c3e3b7fb9300c083169f45f5 5a88bb9f5a2bd3906f3509ae2cc90d1a6624ce428bde75441f3e35a60e62e8c8]
I0827 23:57:52.160458 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.164527 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.169968 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0827 23:57:52.170050 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0827 23:57:52.214281 1950495 cri.go:89] found id: "0d1cf85ef119b2b508445f437ec6a72b6e9b5d923a65336c1472928c8afc5e4f"
I0827 23:57:52.214303 1950495 cri.go:89] found id: "b713cc1b1e1c0f2b792f604b17c7bb3b170955cb846e1ad3628105edd6e93a58"
I0827 23:57:52.214308 1950495 cri.go:89] found id: ""
I0827 23:57:52.214315 1950495 logs.go:276] 2 containers: [0d1cf85ef119b2b508445f437ec6a72b6e9b5d923a65336c1472928c8afc5e4f b713cc1b1e1c0f2b792f604b17c7bb3b170955cb846e1ad3628105edd6e93a58]
I0827 23:57:52.214393 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.218134 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.221618 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0827 23:57:52.221698 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0827 23:57:52.261454 1950495 cri.go:89] found id: "253f4b2cc40f2d9b5d44222a444d2a4bc7992f0997e349067086d6afbbb4630a"
I0827 23:57:52.261476 1950495 cri.go:89] found id: "e9b0c909017017b75549291c3809aa4dcbec2431b93ad52fcc7b181d5a9a9c9e"
I0827 23:57:52.261481 1950495 cri.go:89] found id: ""
I0827 23:57:52.261488 1950495 logs.go:276] 2 containers: [253f4b2cc40f2d9b5d44222a444d2a4bc7992f0997e349067086d6afbbb4630a e9b0c909017017b75549291c3809aa4dcbec2431b93ad52fcc7b181d5a9a9c9e]
I0827 23:57:52.261545 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.265540 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.269256 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0827 23:57:52.269344 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0827 23:57:52.317050 1950495 cri.go:89] found id: "cb24367aaaecbaac8d5793d07ed4e77d1fe624807621b2d14b96f71eb8a3e865"
I0827 23:57:52.317071 1950495 cri.go:89] found id: "3214b2bf63c83209e48dba86958860f95dc13d661d173621761feb70101be3c0"
I0827 23:57:52.317076 1950495 cri.go:89] found id: ""
I0827 23:57:52.317084 1950495 logs.go:276] 2 containers: [cb24367aaaecbaac8d5793d07ed4e77d1fe624807621b2d14b96f71eb8a3e865 3214b2bf63c83209e48dba86958860f95dc13d661d173621761feb70101be3c0]
I0827 23:57:52.317160 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.321071 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.324864 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0827 23:57:52.324937 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0827 23:57:52.384987 1950495 cri.go:89] found id: "abde7dff43fa43bf43a929f61cf84f0eb9f24c56d99b9aa35541d66d431bc5fd"
I0827 23:57:52.385013 1950495 cri.go:89] found id: "9a811044a4368c2294519477e32cf05e41942851f970c19ca2aaa5bb256f7f03"
I0827 23:57:52.385029 1950495 cri.go:89] found id: ""
I0827 23:57:52.385037 1950495 logs.go:276] 2 containers: [abde7dff43fa43bf43a929f61cf84f0eb9f24c56d99b9aa35541d66d431bc5fd 9a811044a4368c2294519477e32cf05e41942851f970c19ca2aaa5bb256f7f03]
I0827 23:57:52.385111 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.391141 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.401145 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0827 23:57:52.401345 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0827 23:57:52.469099 1950495 cri.go:89] found id: "2d3fde405c4f70c241a237307888dbc766233bc3a92b248405db0a2742e2a707"
I0827 23:57:52.469119 1950495 cri.go:89] found id: "e300611d2e10fce610e01a8992253bd8224a55769ac78984311fc121390a2bd9"
I0827 23:57:52.469125 1950495 cri.go:89] found id: ""
I0827 23:57:52.469131 1950495 logs.go:276] 2 containers: [2d3fde405c4f70c241a237307888dbc766233bc3a92b248405db0a2742e2a707 e300611d2e10fce610e01a8992253bd8224a55769ac78984311fc121390a2bd9]
I0827 23:57:52.469206 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.473146 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.477507 1950495 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0827 23:57:52.477605 1950495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0827 23:57:52.519043 1950495 cri.go:89] found id: "37375e3ac2ad29c8f5d1122c62552e0a2c394a7ec2cca31caade50b5c68ec57f"
I0827 23:57:52.519106 1950495 cri.go:89] found id: ""
I0827 23:57:52.519127 1950495 logs.go:276] 1 containers: [37375e3ac2ad29c8f5d1122c62552e0a2c394a7ec2cca31caade50b5c68ec57f]
I0827 23:57:52.519220 1950495 ssh_runner.go:195] Run: which crictl
I0827 23:57:52.522986 1950495 logs.go:123] Gathering logs for dmesg ...
I0827 23:57:52.523013 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0827 23:57:52.554957 1950495 logs.go:123] Gathering logs for describe nodes ...
I0827 23:57:52.555044 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0827 23:57:52.683702 1950495 logs.go:123] Gathering logs for kube-apiserver [7eeb834b960d47d70b3aff513ee78b6fdb3981df22edacc56b7cb7696d92e39d] ...
I0827 23:57:52.683730 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7eeb834b960d47d70b3aff513ee78b6fdb3981df22edacc56b7cb7696d92e39d"
I0827 23:57:48.538154 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:51.036087 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:52.753178 1950495 logs.go:123] Gathering logs for kube-controller-manager [cb24367aaaecbaac8d5793d07ed4e77d1fe624807621b2d14b96f71eb8a3e865] ...
I0827 23:57:52.753213 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cb24367aaaecbaac8d5793d07ed4e77d1fe624807621b2d14b96f71eb8a3e865"
I0827 23:57:52.826643 1950495 logs.go:123] Gathering logs for kube-controller-manager [3214b2bf63c83209e48dba86958860f95dc13d661d173621761feb70101be3c0] ...
I0827 23:57:52.826692 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3214b2bf63c83209e48dba86958860f95dc13d661d173621761feb70101be3c0"
I0827 23:57:52.909463 1950495 logs.go:123] Gathering logs for kubernetes-dashboard [37375e3ac2ad29c8f5d1122c62552e0a2c394a7ec2cca31caade50b5c68ec57f] ...
I0827 23:57:52.909502 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 37375e3ac2ad29c8f5d1122c62552e0a2c394a7ec2cca31caade50b5c68ec57f"
I0827 23:57:52.961438 1950495 logs.go:123] Gathering logs for containerd ...
I0827 23:57:52.961468 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0827 23:57:53.033265 1950495 logs.go:123] Gathering logs for kube-apiserver [fe84704b7ec75f3193ef02843fe7925f27be359c6442cfaf08b9f6331b56d51d] ...
I0827 23:57:53.033305 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fe84704b7ec75f3193ef02843fe7925f27be359c6442cfaf08b9f6331b56d51d"
I0827 23:57:53.093820 1950495 logs.go:123] Gathering logs for storage-provisioner [2d3fde405c4f70c241a237307888dbc766233bc3a92b248405db0a2742e2a707] ...
I0827 23:57:53.093856 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2d3fde405c4f70c241a237307888dbc766233bc3a92b248405db0a2742e2a707"
I0827 23:57:53.149853 1950495 logs.go:123] Gathering logs for kubelet ...
I0827 23:57:53.149882 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0827 23:57:53.228542 1950495 logs.go:123] Gathering logs for coredns [9c280433fc76d28f921c042176fd9bb1616fb0c3c3e3b7fb9300c083169f45f5] ...
I0827 23:57:53.228586 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9c280433fc76d28f921c042176fd9bb1616fb0c3c3e3b7fb9300c083169f45f5"
I0827 23:57:53.277415 1950495 logs.go:123] Gathering logs for kube-scheduler [0d1cf85ef119b2b508445f437ec6a72b6e9b5d923a65336c1472928c8afc5e4f] ...
I0827 23:57:53.277445 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0d1cf85ef119b2b508445f437ec6a72b6e9b5d923a65336c1472928c8afc5e4f"
I0827 23:57:53.326821 1950495 logs.go:123] Gathering logs for kube-scheduler [b713cc1b1e1c0f2b792f604b17c7bb3b170955cb846e1ad3628105edd6e93a58] ...
I0827 23:57:53.326856 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b713cc1b1e1c0f2b792f604b17c7bb3b170955cb846e1ad3628105edd6e93a58"
I0827 23:57:53.385208 1950495 logs.go:123] Gathering logs for kindnet [abde7dff43fa43bf43a929f61cf84f0eb9f24c56d99b9aa35541d66d431bc5fd] ...
I0827 23:57:53.385240 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 abde7dff43fa43bf43a929f61cf84f0eb9f24c56d99b9aa35541d66d431bc5fd"
I0827 23:57:53.430516 1950495 logs.go:123] Gathering logs for storage-provisioner [e300611d2e10fce610e01a8992253bd8224a55769ac78984311fc121390a2bd9] ...
I0827 23:57:53.430544 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e300611d2e10fce610e01a8992253bd8224a55769ac78984311fc121390a2bd9"
I0827 23:57:53.472875 1950495 logs.go:123] Gathering logs for container status ...
I0827 23:57:53.472905 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0827 23:57:53.546843 1950495 logs.go:123] Gathering logs for etcd [443f90b5f48af310c2a0b29003f0492d900d5b22c61ca83e0398e565e9627e8b] ...
I0827 23:57:53.546892 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 443f90b5f48af310c2a0b29003f0492d900d5b22c61ca83e0398e565e9627e8b"
I0827 23:57:53.604511 1950495 logs.go:123] Gathering logs for etcd [1865b4877751d1fa034595f97e7c1192cb707868710e8d39e41ff972a250867b] ...
I0827 23:57:53.604543 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1865b4877751d1fa034595f97e7c1192cb707868710e8d39e41ff972a250867b"
I0827 23:57:53.653756 1950495 logs.go:123] Gathering logs for coredns [5a88bb9f5a2bd3906f3509ae2cc90d1a6624ce428bde75441f3e35a60e62e8c8] ...
I0827 23:57:53.653791 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5a88bb9f5a2bd3906f3509ae2cc90d1a6624ce428bde75441f3e35a60e62e8c8"
I0827 23:57:53.709950 1950495 logs.go:123] Gathering logs for kube-proxy [253f4b2cc40f2d9b5d44222a444d2a4bc7992f0997e349067086d6afbbb4630a] ...
I0827 23:57:53.709989 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 253f4b2cc40f2d9b5d44222a444d2a4bc7992f0997e349067086d6afbbb4630a"
I0827 23:57:53.748979 1950495 logs.go:123] Gathering logs for kube-proxy [e9b0c909017017b75549291c3809aa4dcbec2431b93ad52fcc7b181d5a9a9c9e] ...
I0827 23:57:53.749048 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e9b0c909017017b75549291c3809aa4dcbec2431b93ad52fcc7b181d5a9a9c9e"
I0827 23:57:53.788655 1950495 logs.go:123] Gathering logs for kindnet [9a811044a4368c2294519477e32cf05e41942851f970c19ca2aaa5bb256f7f03] ...
I0827 23:57:53.788685 1950495 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9a811044a4368c2294519477e32cf05e41942851f970c19ca2aaa5bb256f7f03"
I0827 23:57:56.337085 1950495 system_pods.go:59] 9 kube-system pods found
I0827 23:57:56.337123 1950495 system_pods.go:61] "coredns-6f6b679f8f-2qvsz" [dd70338e-f861-42f2-a0fe-55ad9ea31d23] Running
I0827 23:57:56.337130 1950495 system_pods.go:61] "etcd-no-preload-710826" [b4f98313-2367-4bf1-b9be-c6c0ae5f20a3] Running
I0827 23:57:56.337135 1950495 system_pods.go:61] "kindnet-vkvrh" [db81af53-fe46-46b2-985c-f059436a0204] Running
I0827 23:57:56.337140 1950495 system_pods.go:61] "kube-apiserver-no-preload-710826" [514b71b8-b0ca-4339-bf3e-477529bce61d] Running
I0827 23:57:56.337163 1950495 system_pods.go:61] "kube-controller-manager-no-preload-710826" [3bca269c-e9de-4acb-a83b-5598f0ecd1c5] Running
I0827 23:57:56.337172 1950495 system_pods.go:61] "kube-proxy-n47gz" [3da250b4-9476-4c7d-b1c9-131e542c411a] Running
I0827 23:57:56.337176 1950495 system_pods.go:61] "kube-scheduler-no-preload-710826" [a7203ec3-15c3-4af5-b5b0-7f20eab134a8] Running
I0827 23:57:56.337183 1950495 system_pods.go:61] "metrics-server-6867b74b74-shq79" [f0d7e553-7cd8-4b83-bbe5-41bd578df9d9] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0827 23:57:56.337188 1950495 system_pods.go:61] "storage-provisioner" [0138b06b-b76e-4f1f-8c6b-cf6913e91522] Running
I0827 23:57:56.337201 1950495 system_pods.go:74] duration metric: took 4.346341908s to wait for pod list to return data ...
I0827 23:57:56.337217 1950495 default_sa.go:34] waiting for default service account to be created ...
I0827 23:57:56.339617 1950495 default_sa.go:45] found service account: "default"
I0827 23:57:56.339646 1950495 default_sa.go:55] duration metric: took 2.42037ms for default service account to be created ...
I0827 23:57:56.339657 1950495 system_pods.go:116] waiting for k8s-apps to be running ...
I0827 23:57:56.347180 1950495 system_pods.go:86] 9 kube-system pods found
I0827 23:57:56.347214 1950495 system_pods.go:89] "coredns-6f6b679f8f-2qvsz" [dd70338e-f861-42f2-a0fe-55ad9ea31d23] Running
I0827 23:57:56.347221 1950495 system_pods.go:89] "etcd-no-preload-710826" [b4f98313-2367-4bf1-b9be-c6c0ae5f20a3] Running
I0827 23:57:56.347227 1950495 system_pods.go:89] "kindnet-vkvrh" [db81af53-fe46-46b2-985c-f059436a0204] Running
I0827 23:57:56.347231 1950495 system_pods.go:89] "kube-apiserver-no-preload-710826" [514b71b8-b0ca-4339-bf3e-477529bce61d] Running
I0827 23:57:56.347236 1950495 system_pods.go:89] "kube-controller-manager-no-preload-710826" [3bca269c-e9de-4acb-a83b-5598f0ecd1c5] Running
I0827 23:57:56.347240 1950495 system_pods.go:89] "kube-proxy-n47gz" [3da250b4-9476-4c7d-b1c9-131e542c411a] Running
I0827 23:57:56.347244 1950495 system_pods.go:89] "kube-scheduler-no-preload-710826" [a7203ec3-15c3-4af5-b5b0-7f20eab134a8] Running
I0827 23:57:56.347251 1950495 system_pods.go:89] "metrics-server-6867b74b74-shq79" [f0d7e553-7cd8-4b83-bbe5-41bd578df9d9] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0827 23:57:56.347258 1950495 system_pods.go:89] "storage-provisioner" [0138b06b-b76e-4f1f-8c6b-cf6913e91522] Running
I0827 23:57:56.347275 1950495 system_pods.go:126] duration metric: took 7.610714ms to wait for k8s-apps to be running ...
I0827 23:57:56.347289 1950495 system_svc.go:44] waiting for kubelet service to be running ....
I0827 23:57:56.347351 1950495 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0827 23:57:56.359913 1950495 system_svc.go:56] duration metric: took 12.615184ms WaitForService to wait for kubelet
I0827 23:57:56.359943 1950495 kubeadm.go:582] duration metric: took 4m30.994225227s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0827 23:57:56.359969 1950495 node_conditions.go:102] verifying NodePressure condition ...
I0827 23:57:56.363551 1950495 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0827 23:57:56.363590 1950495 node_conditions.go:123] node cpu capacity is 2
I0827 23:57:56.363631 1950495 node_conditions.go:105] duration metric: took 3.630945ms to run NodePressure ...
I0827 23:57:56.363660 1950495 start.go:241] waiting for startup goroutines ...
I0827 23:57:56.363675 1950495 start.go:246] waiting for cluster config update ...
I0827 23:57:56.363690 1950495 start.go:255] writing updated cluster config ...
I0827 23:57:56.364094 1950495 ssh_runner.go:195] Run: rm -f paused
I0827 23:57:56.431415 1950495 start.go:600] kubectl: 1.31.0, cluster: 1.31.0 (minor skew: 0)
I0827 23:57:56.433832 1950495 out.go:177] * Done! kubectl is now configured to use "no-preload-710826" cluster and "default" namespace by default
I0827 23:57:53.039962 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:55.050692 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:57:57.541257 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:58:00.089363 1945499 pod_ready.go:103] pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace has status "Ready":"False"
I0827 23:58:00.543555 1945499 pod_ready.go:82] duration metric: took 4m0.014542084s for pod "metrics-server-9975d5f86-hrfcg" in "kube-system" namespace to be "Ready" ...
E0827 23:58:00.543589 1945499 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0827 23:58:00.543600 1945499 pod_ready.go:39] duration metric: took 5m30.35086527s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0827 23:58:00.543615 1945499 api_server.go:52] waiting for apiserver process to appear ...
I0827 23:58:00.543647 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0827 23:58:00.543719 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0827 23:58:00.597945 1945499 cri.go:89] found id: "236ee37eeeb99bd1460f867c4e7fe387aa435f0c3062f69ba966a2912dcefd98"
I0827 23:58:00.597976 1945499 cri.go:89] found id: "8ad8c60d925d8c127982d6c494b2944705246a4e1f900b216029c075b40579c3"
I0827 23:58:00.597982 1945499 cri.go:89] found id: ""
I0827 23:58:00.597990 1945499 logs.go:276] 2 containers: [236ee37eeeb99bd1460f867c4e7fe387aa435f0c3062f69ba966a2912dcefd98 8ad8c60d925d8c127982d6c494b2944705246a4e1f900b216029c075b40579c3]
I0827 23:58:00.598054 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.602301 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.606401 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0827 23:58:00.606492 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0827 23:58:00.652901 1945499 cri.go:89] found id: "b840f973e99b93adc44783c2e2d337691055b2010c919612e3dadc0ed1482689"
I0827 23:58:00.652924 1945499 cri.go:89] found id: "ec54c116a9331e1e0344c99a787d2410df9e7415035a80a4727091fdd518c6d9"
I0827 23:58:00.652929 1945499 cri.go:89] found id: ""
I0827 23:58:00.652937 1945499 logs.go:276] 2 containers: [b840f973e99b93adc44783c2e2d337691055b2010c919612e3dadc0ed1482689 ec54c116a9331e1e0344c99a787d2410df9e7415035a80a4727091fdd518c6d9]
I0827 23:58:00.653001 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.657090 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.660704 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0827 23:58:00.660777 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0827 23:58:00.699407 1945499 cri.go:89] found id: "ead4d00fa7425edec7434788632e2318593bc3569ef3831b4dc8a50390cfcef7"
I0827 23:58:00.699433 1945499 cri.go:89] found id: "3c0492b681bf18809e9a23ab9a173d2d830618a5a4009118054601e45bfe2d62"
I0827 23:58:00.699438 1945499 cri.go:89] found id: ""
I0827 23:58:00.699446 1945499 logs.go:276] 2 containers: [ead4d00fa7425edec7434788632e2318593bc3569ef3831b4dc8a50390cfcef7 3c0492b681bf18809e9a23ab9a173d2d830618a5a4009118054601e45bfe2d62]
I0827 23:58:00.699516 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.703499 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.707751 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0827 23:58:00.707839 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0827 23:58:00.749347 1945499 cri.go:89] found id: "1a994ea8ba82f081ccc9e2ac0e483d50f83e2ed42aa614b79c8caa2103abf267"
I0827 23:58:00.749421 1945499 cri.go:89] found id: "cb5a0544025d9eeba2b0613deeb98000ece1fd8d335ccd8307d6631b0c79b808"
I0827 23:58:00.749433 1945499 cri.go:89] found id: ""
I0827 23:58:00.749442 1945499 logs.go:276] 2 containers: [1a994ea8ba82f081ccc9e2ac0e483d50f83e2ed42aa614b79c8caa2103abf267 cb5a0544025d9eeba2b0613deeb98000ece1fd8d335ccd8307d6631b0c79b808]
I0827 23:58:00.749515 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.753278 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.756794 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0827 23:58:00.756926 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0827 23:58:00.798299 1945499 cri.go:89] found id: "b794569e1af8dd0a1e24a3b37ce65bee8173206424ae64ce50ae15299bc2ce1e"
I0827 23:58:00.798331 1945499 cri.go:89] found id: "afa3d5bad6b52464ebc366db825a3bae7e5c7708a260053326c71f3b698cb205"
I0827 23:58:00.798337 1945499 cri.go:89] found id: ""
I0827 23:58:00.798344 1945499 logs.go:276] 2 containers: [b794569e1af8dd0a1e24a3b37ce65bee8173206424ae64ce50ae15299bc2ce1e afa3d5bad6b52464ebc366db825a3bae7e5c7708a260053326c71f3b698cb205]
I0827 23:58:00.798412 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.802454 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.806186 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0827 23:58:00.806284 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0827 23:58:00.849117 1945499 cri.go:89] found id: "b80f35939db8aaeb12827ab1e612ae18e95c0c024e797cd5b1ea4629fe4a70ea"
I0827 23:58:00.849140 1945499 cri.go:89] found id: "30ef2c8817f233bf500df3120c006454ceca974e44a9d5b1ccb0d2f184c7a618"
I0827 23:58:00.849145 1945499 cri.go:89] found id: ""
I0827 23:58:00.849153 1945499 logs.go:276] 2 containers: [b80f35939db8aaeb12827ab1e612ae18e95c0c024e797cd5b1ea4629fe4a70ea 30ef2c8817f233bf500df3120c006454ceca974e44a9d5b1ccb0d2f184c7a618]
I0827 23:58:00.849226 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.852721 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.856151 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0827 23:58:00.856227 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0827 23:58:00.899038 1945499 cri.go:89] found id: "1cbb985b30629df7e58845adea1be58296d1c4b309b10502e97ae37f80e864fd"
I0827 23:58:00.899063 1945499 cri.go:89] found id: "575a6ee419e7fe10299e33d8b97f8c2598ad91a8fea4bdd2f0dd5e2db16ada9c"
I0827 23:58:00.899068 1945499 cri.go:89] found id: ""
I0827 23:58:00.899075 1945499 logs.go:276] 2 containers: [1cbb985b30629df7e58845adea1be58296d1c4b309b10502e97ae37f80e864fd 575a6ee419e7fe10299e33d8b97f8c2598ad91a8fea4bdd2f0dd5e2db16ada9c]
I0827 23:58:00.899130 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.903019 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.907211 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0827 23:58:00.907319 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0827 23:58:00.953896 1945499 cri.go:89] found id: "d6670465175a28a741e1eadfb9ec891d36c454066af259c2ba1292e1c2d606d9"
I0827 23:58:00.953964 1945499 cri.go:89] found id: ""
I0827 23:58:00.953978 1945499 logs.go:276] 1 containers: [d6670465175a28a741e1eadfb9ec891d36c454066af259c2ba1292e1c2d606d9]
I0827 23:58:00.954053 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:00.958271 1945499 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0827 23:58:00.958391 1945499 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0827 23:58:01.010042 1945499 cri.go:89] found id: "42597d6ccc6c90213fb2f50464c1373d136df2cc9496367789b03fba8d5f25bf"
I0827 23:58:01.010071 1945499 cri.go:89] found id: "592dbdd737e878b0fe0ea4cea6b72f6e640f9c434b17d5af3d98a6c70210e42c"
I0827 23:58:01.010077 1945499 cri.go:89] found id: ""
I0827 23:58:01.010085 1945499 logs.go:276] 2 containers: [42597d6ccc6c90213fb2f50464c1373d136df2cc9496367789b03fba8d5f25bf 592dbdd737e878b0fe0ea4cea6b72f6e640f9c434b17d5af3d98a6c70210e42c]
I0827 23:58:01.010157 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:01.015859 1945499 ssh_runner.go:195] Run: which crictl
I0827 23:58:01.027889 1945499 logs.go:123] Gathering logs for kubelet ...
I0827 23:58:01.027965 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0827 23:58:01.085733 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:29 old-k8s-version-394049 kubelet[661]: E0827 23:52:29.904499 661 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.085965 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:29 old-k8s-version-394049 kubelet[661]: E0827 23:52:29.905231 661 reflector.go:138] object-"kube-system"/"coredns-token-h2fzw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-h2fzw" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.086179 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:29 old-k8s-version-394049 kubelet[661]: E0827 23:52:29.905317 661 reflector.go:138] object-"kube-system"/"kindnet-token-nhzrn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-nhzrn" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.089944 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:30 old-k8s-version-394049 kubelet[661]: E0827 23:52:30.162229 661 reflector.go:138] object-"kube-system"/"kube-proxy-token-4fdqz": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-4fdqz" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.090154 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:30 old-k8s-version-394049 kubelet[661]: E0827 23:52:30.162511 661 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.090397 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:30 old-k8s-version-394049 kubelet[661]: E0827 23:52:30.162590 661 reflector.go:138] object-"kube-system"/"storage-provisioner-token-dhs5r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-dhs5r" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.090605 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:30 old-k8s-version-394049 kubelet[661]: E0827 23:52:30.162658 661 reflector.go:138] object-"default"/"default-token-bdzp7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-bdzp7" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.090825 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:30 old-k8s-version-394049 kubelet[661]: E0827 23:52:30.162723 661 reflector.go:138] object-"kube-system"/"metrics-server-token-nrslw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-nrslw" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.099068 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:34 old-k8s-version-394049 kubelet[661]: E0827 23:52:34.053654 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0827 23:58:01.099263 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:34 old-k8s-version-394049 kubelet[661]: E0827 23:52:34.649560 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.102070 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:46 old-k8s-version-394049 kubelet[661]: E0827 23:52:46.414539 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0827 23:58:01.102400 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:48 old-k8s-version-394049 kubelet[661]: E0827 23:52:48.165741 661 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-sw62f": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-sw62f" is forbidden: User "system:node:old-k8s-version-394049" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-394049' and this object
W0827 23:58:01.105519 1945499 logs.go:138] Found kubelet problem: Aug 27 23:52:59 old-k8s-version-394049 kubelet[661]: E0827 23:52:59.405677 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.106456 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:00 old-k8s-version-394049 kubelet[661]: E0827 23:53:00.763341 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.106810 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:01 old-k8s-version-394049 kubelet[661]: E0827 23:53:01.767516 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.107142 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:02 old-k8s-version-394049 kubelet[661]: E0827 23:53:02.770141 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.109947 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:10 old-k8s-version-394049 kubelet[661]: E0827 23:53:10.412938 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0827 23:58:01.110536 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:15 old-k8s-version-394049 kubelet[661]: E0827 23:53:15.810709 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.110863 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:21 old-k8s-version-394049 kubelet[661]: E0827 23:53:21.214756 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.111048 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:23 old-k8s-version-394049 kubelet[661]: E0827 23:53:23.403844 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.111379 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:32 old-k8s-version-394049 kubelet[661]: E0827 23:53:32.403201 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.111565 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:35 old-k8s-version-394049 kubelet[661]: E0827 23:53:35.404624 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.111882 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:47 old-k8s-version-394049 kubelet[661]: E0827 23:53:47.404977 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.112337 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:47 old-k8s-version-394049 kubelet[661]: E0827 23:53:47.913818 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.112668 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:51 old-k8s-version-394049 kubelet[661]: E0827 23:53:51.214411 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.115132 1945499 logs.go:138] Found kubelet problem: Aug 27 23:53:59 old-k8s-version-394049 kubelet[661]: E0827 23:53:59.420594 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0827 23:58:01.115465 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:03 old-k8s-version-394049 kubelet[661]: E0827 23:54:03.408451 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.115649 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:13 old-k8s-version-394049 kubelet[661]: E0827 23:54:13.404006 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.115974 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:16 old-k8s-version-394049 kubelet[661]: E0827 23:54:16.404599 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.116158 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:26 old-k8s-version-394049 kubelet[661]: E0827 23:54:26.403617 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.116755 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:32 old-k8s-version-394049 kubelet[661]: E0827 23:54:32.101869 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.116939 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:40 old-k8s-version-394049 kubelet[661]: E0827 23:54:40.403413 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.117265 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:41 old-k8s-version-394049 kubelet[661]: E0827 23:54:41.214563 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.117581 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:54 old-k8s-version-394049 kubelet[661]: E0827 23:54:54.403985 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.117777 1945499 logs.go:138] Found kubelet problem: Aug 27 23:54:54 old-k8s-version-394049 kubelet[661]: E0827 23:54:54.404224 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.117960 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:05 old-k8s-version-394049 kubelet[661]: E0827 23:55:05.403501 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.118284 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:08 old-k8s-version-394049 kubelet[661]: E0827 23:55:08.403160 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.118468 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:17 old-k8s-version-394049 kubelet[661]: E0827 23:55:17.404616 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.118793 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:21 old-k8s-version-394049 kubelet[661]: E0827 23:55:21.403616 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.121238 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:29 old-k8s-version-394049 kubelet[661]: E0827 23:55:29.412117 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0827 23:58:01.121567 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:34 old-k8s-version-394049 kubelet[661]: E0827 23:55:34.403137 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.121750 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:43 old-k8s-version-394049 kubelet[661]: E0827 23:55:43.403788 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.122077 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:49 old-k8s-version-394049 kubelet[661]: E0827 23:55:49.404105 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.122261 1945499 logs.go:138] Found kubelet problem: Aug 27 23:55:58 old-k8s-version-394049 kubelet[661]: E0827 23:55:58.403447 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.122851 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:01 old-k8s-version-394049 kubelet[661]: E0827 23:56:01.416088 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.123034 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:09 old-k8s-version-394049 kubelet[661]: E0827 23:56:09.404354 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.123360 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:11 old-k8s-version-394049 kubelet[661]: E0827 23:56:11.216894 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.123547 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:23 old-k8s-version-394049 kubelet[661]: E0827 23:56:23.403678 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.123877 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:24 old-k8s-version-394049 kubelet[661]: E0827 23:56:24.403435 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.124062 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:38 old-k8s-version-394049 kubelet[661]: E0827 23:56:38.403581 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.124534 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:39 old-k8s-version-394049 kubelet[661]: E0827 23:56:39.403644 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.124726 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:50 old-k8s-version-394049 kubelet[661]: E0827 23:56:50.403803 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.125058 1945499 logs.go:138] Found kubelet problem: Aug 27 23:56:54 old-k8s-version-394049 kubelet[661]: E0827 23:56:54.403100 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.125243 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:03 old-k8s-version-394049 kubelet[661]: E0827 23:57:03.403600 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.125572 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:09 old-k8s-version-394049 kubelet[661]: E0827 23:57:09.403474 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.125757 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:17 old-k8s-version-394049 kubelet[661]: E0827 23:57:17.403665 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.126082 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:22 old-k8s-version-394049 kubelet[661]: E0827 23:57:22.403246 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.126268 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:30 old-k8s-version-394049 kubelet[661]: E0827 23:57:30.403646 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.126596 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:36 old-k8s-version-394049 kubelet[661]: E0827 23:57:36.403163 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.126782 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:43 old-k8s-version-394049 kubelet[661]: E0827 23:57:43.403668 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:01.127136 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:51 old-k8s-version-394049 kubelet[661]: E0827 23:57:51.403157 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:01.127321 1945499 logs.go:138] Found kubelet problem: Aug 27 23:57:57 old-k8s-version-394049 kubelet[661]: E0827 23:57:57.404181 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0827 23:58:01.127331 1945499 logs.go:123] Gathering logs for etcd [ec54c116a9331e1e0344c99a787d2410df9e7415035a80a4727091fdd518c6d9] ...
I0827 23:58:01.127346 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ec54c116a9331e1e0344c99a787d2410df9e7415035a80a4727091fdd518c6d9"
I0827 23:58:01.173990 1945499 logs.go:123] Gathering logs for kube-controller-manager [30ef2c8817f233bf500df3120c006454ceca974e44a9d5b1ccb0d2f184c7a618] ...
I0827 23:58:01.174026 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 30ef2c8817f233bf500df3120c006454ceca974e44a9d5b1ccb0d2f184c7a618"
I0827 23:58:01.230616 1945499 logs.go:123] Gathering logs for kindnet [1cbb985b30629df7e58845adea1be58296d1c4b309b10502e97ae37f80e864fd] ...
I0827 23:58:01.230650 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1cbb985b30629df7e58845adea1be58296d1c4b309b10502e97ae37f80e864fd"
I0827 23:58:01.275585 1945499 logs.go:123] Gathering logs for storage-provisioner [592dbdd737e878b0fe0ea4cea6b72f6e640f9c434b17d5af3d98a6c70210e42c] ...
I0827 23:58:01.275621 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 592dbdd737e878b0fe0ea4cea6b72f6e640f9c434b17d5af3d98a6c70210e42c"
I0827 23:58:01.321719 1945499 logs.go:123] Gathering logs for kubernetes-dashboard [d6670465175a28a741e1eadfb9ec891d36c454066af259c2ba1292e1c2d606d9] ...
I0827 23:58:01.321752 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d6670465175a28a741e1eadfb9ec891d36c454066af259c2ba1292e1c2d606d9"
I0827 23:58:01.367943 1945499 logs.go:123] Gathering logs for dmesg ...
I0827 23:58:01.367974 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0827 23:58:01.385565 1945499 logs.go:123] Gathering logs for describe nodes ...
I0827 23:58:01.385595 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0827 23:58:01.542426 1945499 logs.go:123] Gathering logs for etcd [b840f973e99b93adc44783c2e2d337691055b2010c919612e3dadc0ed1482689] ...
I0827 23:58:01.542461 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b840f973e99b93adc44783c2e2d337691055b2010c919612e3dadc0ed1482689"
I0827 23:58:01.586413 1945499 logs.go:123] Gathering logs for kube-scheduler [cb5a0544025d9eeba2b0613deeb98000ece1fd8d335ccd8307d6631b0c79b808] ...
I0827 23:58:01.586445 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cb5a0544025d9eeba2b0613deeb98000ece1fd8d335ccd8307d6631b0c79b808"
I0827 23:58:01.634391 1945499 logs.go:123] Gathering logs for kube-proxy [b794569e1af8dd0a1e24a3b37ce65bee8173206424ae64ce50ae15299bc2ce1e] ...
I0827 23:58:01.634426 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b794569e1af8dd0a1e24a3b37ce65bee8173206424ae64ce50ae15299bc2ce1e"
I0827 23:58:01.674602 1945499 logs.go:123] Gathering logs for kube-controller-manager [b80f35939db8aaeb12827ab1e612ae18e95c0c024e797cd5b1ea4629fe4a70ea] ...
I0827 23:58:01.674642 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b80f35939db8aaeb12827ab1e612ae18e95c0c024e797cd5b1ea4629fe4a70ea"
I0827 23:58:01.756052 1945499 logs.go:123] Gathering logs for kindnet [575a6ee419e7fe10299e33d8b97f8c2598ad91a8fea4bdd2f0dd5e2db16ada9c] ...
I0827 23:58:01.756149 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 575a6ee419e7fe10299e33d8b97f8c2598ad91a8fea4bdd2f0dd5e2db16ada9c"
I0827 23:58:01.829677 1945499 logs.go:123] Gathering logs for containerd ...
I0827 23:58:01.829716 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0827 23:58:01.893566 1945499 logs.go:123] Gathering logs for kube-apiserver [236ee37eeeb99bd1460f867c4e7fe387aa435f0c3062f69ba966a2912dcefd98] ...
I0827 23:58:01.893606 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 236ee37eeeb99bd1460f867c4e7fe387aa435f0c3062f69ba966a2912dcefd98"
I0827 23:58:01.975220 1945499 logs.go:123] Gathering logs for coredns [ead4d00fa7425edec7434788632e2318593bc3569ef3831b4dc8a50390cfcef7] ...
I0827 23:58:01.975254 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ead4d00fa7425edec7434788632e2318593bc3569ef3831b4dc8a50390cfcef7"
I0827 23:58:02.039338 1945499 logs.go:123] Gathering logs for coredns [3c0492b681bf18809e9a23ab9a173d2d830618a5a4009118054601e45bfe2d62] ...
I0827 23:58:02.039366 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3c0492b681bf18809e9a23ab9a173d2d830618a5a4009118054601e45bfe2d62"
I0827 23:58:02.085786 1945499 logs.go:123] Gathering logs for kube-scheduler [1a994ea8ba82f081ccc9e2ac0e483d50f83e2ed42aa614b79c8caa2103abf267] ...
I0827 23:58:02.085819 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1a994ea8ba82f081ccc9e2ac0e483d50f83e2ed42aa614b79c8caa2103abf267"
I0827 23:58:02.132044 1945499 logs.go:123] Gathering logs for kube-proxy [afa3d5bad6b52464ebc366db825a3bae7e5c7708a260053326c71f3b698cb205] ...
I0827 23:58:02.132073 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 afa3d5bad6b52464ebc366db825a3bae7e5c7708a260053326c71f3b698cb205"
I0827 23:58:02.179174 1945499 logs.go:123] Gathering logs for storage-provisioner [42597d6ccc6c90213fb2f50464c1373d136df2cc9496367789b03fba8d5f25bf] ...
I0827 23:58:02.179207 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 42597d6ccc6c90213fb2f50464c1373d136df2cc9496367789b03fba8d5f25bf"
I0827 23:58:02.220200 1945499 logs.go:123] Gathering logs for container status ...
I0827 23:58:02.220234 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0827 23:58:02.269966 1945499 logs.go:123] Gathering logs for kube-apiserver [8ad8c60d925d8c127982d6c494b2944705246a4e1f900b216029c075b40579c3] ...
I0827 23:58:02.269997 1945499 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8ad8c60d925d8c127982d6c494b2944705246a4e1f900b216029c075b40579c3"
I0827 23:58:02.326500 1945499 out.go:358] Setting ErrFile to fd 2...
I0827 23:58:02.326532 1945499 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0827 23:58:02.326594 1945499 out.go:270] X Problems detected in kubelet:
W0827 23:58:02.326608 1945499 out.go:270] Aug 27 23:57:30 old-k8s-version-394049 kubelet[661]: E0827 23:57:30.403646 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:02.326640 1945499 out.go:270] Aug 27 23:57:36 old-k8s-version-394049 kubelet[661]: E0827 23:57:36.403163 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:02.326647 1945499 out.go:270] Aug 27 23:57:43 old-k8s-version-394049 kubelet[661]: E0827 23:57:43.403668 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0827 23:58:02.326656 1945499 out.go:270] Aug 27 23:57:51 old-k8s-version-394049 kubelet[661]: E0827 23:57:51.403157 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
W0827 23:58:02.326661 1945499 out.go:270] Aug 27 23:57:57 old-k8s-version-394049 kubelet[661]: E0827 23:57:57.404181 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0827 23:58:02.326666 1945499 out.go:358] Setting ErrFile to fd 2...
I0827 23:58:02.326675 1945499 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0827 23:58:12.327421 1945499 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0827 23:58:12.341561 1945499 api_server.go:72] duration metric: took 6m0.665672398s to wait for apiserver process to appear ...
I0827 23:58:12.341586 1945499 api_server.go:88] waiting for apiserver healthz status ...
I0827 23:58:12.344259 1945499 out.go:201]
W0827 23:58:12.346377 1945499 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W0827 23:58:12.346407 1945499 out.go:270] *
W0827 23:58:12.347367 1945499 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0827 23:58:12.348889 1945499 out.go:201]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
8db6aabd38edb 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 a61bce0b122c1 dashboard-metrics-scraper-8d5bb5db8-72r62
d6670465175a2 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 bf5ab9c602753 kubernetes-dashboard-cd95d586-27b8v
fa7c8d0de2463 1611cd07b61d5 5 minutes ago Running busybox 1 4e63e9657f88e busybox
1cbb985b30629 6a23fa8fd2b78 5 minutes ago Running kindnet-cni 1 e4e313ae645da kindnet-bv2q4
42597d6ccc6c9 ba04bb24b9575 5 minutes ago Running storage-provisioner 1 0625227132cff storage-provisioner
b794569e1af8d 25a5233254979 5 minutes ago Running kube-proxy 1 ac499c672a9ee kube-proxy-d84wl
ead4d00fa7425 db91994f4ee8f 5 minutes ago Running coredns 1 8294078efaf22 coredns-74ff55c5b-fbhfc
236ee37eeeb99 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 fb9b459348351 kube-apiserver-old-k8s-version-394049
b840f973e99b9 05b738aa1bc63 5 minutes ago Running etcd 1 e2609e0873d20 etcd-old-k8s-version-394049
b80f35939db8a 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 bd5c3d955e689 kube-controller-manager-old-k8s-version-394049
1a994ea8ba82f e7605f88f17d6 5 minutes ago Running kube-scheduler 1 0a61a3ff77d27 kube-scheduler-old-k8s-version-394049
a9c1a0de96f77 1611cd07b61d5 6 minutes ago Exited busybox 0 4729c39131a4e busybox
3c0492b681bf1 db91994f4ee8f 8 minutes ago Exited coredns 0 6f133dd257237 coredns-74ff55c5b-fbhfc
575a6ee419e7f 6a23fa8fd2b78 8 minutes ago Exited kindnet-cni 0 7a21e03aeffba kindnet-bv2q4
592dbdd737e87 ba04bb24b9575 8 minutes ago Exited storage-provisioner 0 eceeb9973fc54 storage-provisioner
afa3d5bad6b52 25a5233254979 8 minutes ago Exited kube-proxy 0 eefaafaaca1a1 kube-proxy-d84wl
ec54c116a9331 05b738aa1bc63 8 minutes ago Exited etcd 0 538cb8621555a etcd-old-k8s-version-394049
cb5a0544025d9 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 5d92486874e6f kube-scheduler-old-k8s-version-394049
8ad8c60d925d8 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 4d13c7269a18e kube-apiserver-old-k8s-version-394049
30ef2c8817f23 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 23a956e04f534 kube-controller-manager-old-k8s-version-394049
==> containerd <==
Aug 27 23:54:31 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:54:31.426377804Z" level=info msg="CreateContainer within sandbox \"a61bce0b122c1fc2f10125f6d39974289bda8c2a617ba6a1186aef0df26a9eb8\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"54a945e4158d9e87046508da0d6414a56d789ee13f6761696bb16c16c1551cdd\""
Aug 27 23:54:31 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:54:31.427049404Z" level=info msg="StartContainer for \"54a945e4158d9e87046508da0d6414a56d789ee13f6761696bb16c16c1551cdd\""
Aug 27 23:54:31 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:54:31.497311849Z" level=info msg="StartContainer for \"54a945e4158d9e87046508da0d6414a56d789ee13f6761696bb16c16c1551cdd\" returns successfully"
Aug 27 23:54:31 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:54:31.526387926Z" level=info msg="shim disconnected" id=54a945e4158d9e87046508da0d6414a56d789ee13f6761696bb16c16c1551cdd namespace=k8s.io
Aug 27 23:54:31 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:54:31.526447756Z" level=warning msg="cleaning up after shim disconnected" id=54a945e4158d9e87046508da0d6414a56d789ee13f6761696bb16c16c1551cdd namespace=k8s.io
Aug 27 23:54:31 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:54:31.526459621Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 27 23:54:32 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:54:32.104431191Z" level=info msg="RemoveContainer for \"0859ea30c0d1fa3bfed03034cf60698088d09096a28c5e7a0ac8bce9e25a8a31\""
Aug 27 23:54:32 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:54:32.122377048Z" level=info msg="RemoveContainer for \"0859ea30c0d1fa3bfed03034cf60698088d09096a28c5e7a0ac8bce9e25a8a31\" returns successfully"
Aug 27 23:55:29 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:55:29.404709678Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 27 23:55:29 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:55:29.410144964Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Aug 27 23:55:29 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:55:29.411643041Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Aug 27 23:55:29 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:55:29.411749270Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Aug 27 23:56:00 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:56:00.435966521Z" level=info msg="CreateContainer within sandbox \"a61bce0b122c1fc2f10125f6d39974289bda8c2a617ba6a1186aef0df26a9eb8\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Aug 27 23:56:00 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:56:00.476038042Z" level=info msg="CreateContainer within sandbox \"a61bce0b122c1fc2f10125f6d39974289bda8c2a617ba6a1186aef0df26a9eb8\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"8db6aabd38edbe1e2f1270112a398c6712fa7e260a2d74fdad6fda93f49d5f89\""
Aug 27 23:56:00 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:56:00.480412092Z" level=info msg="StartContainer for \"8db6aabd38edbe1e2f1270112a398c6712fa7e260a2d74fdad6fda93f49d5f89\""
Aug 27 23:56:00 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:56:00.681272528Z" level=info msg="StartContainer for \"8db6aabd38edbe1e2f1270112a398c6712fa7e260a2d74fdad6fda93f49d5f89\" returns successfully"
Aug 27 23:56:00 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:56:00.711676108Z" level=info msg="shim disconnected" id=8db6aabd38edbe1e2f1270112a398c6712fa7e260a2d74fdad6fda93f49d5f89 namespace=k8s.io
Aug 27 23:56:00 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:56:00.711741616Z" level=warning msg="cleaning up after shim disconnected" id=8db6aabd38edbe1e2f1270112a398c6712fa7e260a2d74fdad6fda93f49d5f89 namespace=k8s.io
Aug 27 23:56:00 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:56:00.711752398Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 27 23:56:01 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:56:01.418178516Z" level=info msg="RemoveContainer for \"54a945e4158d9e87046508da0d6414a56d789ee13f6761696bb16c16c1551cdd\""
Aug 27 23:56:01 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:56:01.424010922Z" level=info msg="RemoveContainer for \"54a945e4158d9e87046508da0d6414a56d789ee13f6761696bb16c16c1551cdd\" returns successfully"
Aug 27 23:58:12 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:58:12.404533149Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 27 23:58:12 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:58:12.425657800Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Aug 27 23:58:12 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:58:12.428613945Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Aug 27 23:58:12 old-k8s-version-394049 containerd[570]: time="2024-08-27T23:58:12.428697209Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
==> coredns [3c0492b681bf18809e9a23ab9a173d2d830618a5a4009118054601e45bfe2d62] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:58310 - 32642 "HINFO IN 5855940867599028503.6996764539415629706. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.013232459s
==> coredns [ead4d00fa7425edec7434788632e2318593bc3569ef3831b4dc8a50390cfcef7] <==
I0827 23:53:01.962826 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-27 23:52:31.962455326 +0000 UTC m=+0.020703468) (total time: 30.000264591s):
Trace[2019727887]: [30.000264591s] [30.000264591s] END
E0827 23:53:01.963104 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0827 23:53:01.962945 1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-27 23:52:31.96236723 +0000 UTC m=+0.020615364) (total time: 30.00037096s):
Trace[1427131847]: [30.00037096s] [30.00037096s] END
E0827 23:53:01.963131 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0827 23:53:01.963039 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-27 23:52:31.962367714 +0000 UTC m=+0.020615848) (total time: 30.000659479s):
Trace[939984059]: [30.000659479s] [30.000659479s] END
E0827 23:53:01.963146 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[INFO] plugin/ready: Still waiting on: "kubernetes"
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:50554 - 62528 "HINFO IN 5545612607365499106.1380415884376903068. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.021393767s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
==> describe nodes <==
Name: old-k8s-version-394049
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-394049
kubernetes.io/os=linux
minikube.k8s.io/commit=d0790207a2867fe8d040a9642b972c86ef680cdf
minikube.k8s.io/name=old-k8s-version-394049
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_08_27T23_49_29_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 27 Aug 2024 23:49:25 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-394049
AcquireTime: <unset>
RenewTime: Tue, 27 Aug 2024 23:58:12 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 27 Aug 2024 23:53:20 +0000 Tue, 27 Aug 2024 23:49:19 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 27 Aug 2024 23:53:20 +0000 Tue, 27 Aug 2024 23:49:19 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 27 Aug 2024 23:53:20 +0000 Tue, 27 Aug 2024 23:49:19 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Tue, 27 Aug 2024 23:53:20 +0000 Tue, 27 Aug 2024 23:49:44 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-394049
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022308Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022308Ki
pods: 110
System Info:
Machine ID: 57fb3ac7a1e24512ab0f081c7106269b
System UUID: 20597d69-b1ba-4523-bfd1-4ceaa4a3aed5
Boot ID: e72ce5f2-4965-4285-9cc6-e362a4469d8a
Kernel Version: 5.15.0-1068-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.20
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m35s
kube-system coredns-74ff55c5b-fbhfc 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 8m30s
kube-system etcd-old-k8s-version-394049 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 8m37s
kube-system kindnet-bv2q4 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 8m30s
kube-system kube-apiserver-old-k8s-version-394049 250m (12%) 0 (0%) 0 (0%) 0 (0%) 8m37s
kube-system kube-controller-manager-old-k8s-version-394049 200m (10%) 0 (0%) 0 (0%) 0 (0%) 8m37s
kube-system kube-proxy-d84wl 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m30s
kube-system kube-scheduler-old-k8s-version-394049 100m (5%) 0 (0%) 0 (0%) 0 (0%) 8m37s
kube-system metrics-server-9975d5f86-hrfcg 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 6m24s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m28s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-72r62 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m26s
kubernetes-dashboard kubernetes-dashboard-cd95d586-27b8v 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m26s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 100m (5%)
memory 420Mi (5%) 220Mi (2%)
ephemeral-storage 100Mi (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m56s (x5 over 8m56s) kubelet Node old-k8s-version-394049 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m56s (x4 over 8m56s) kubelet Node old-k8s-version-394049 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m56s (x4 over 8m56s) kubelet Node old-k8s-version-394049 status is now: NodeHasSufficientPID
Normal Starting 8m37s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m37s kubelet Node old-k8s-version-394049 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m37s kubelet Node old-k8s-version-394049 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m37s kubelet Node old-k8s-version-394049 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m37s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m30s kubelet Node old-k8s-version-394049 status is now: NodeReady
Normal Starting 8m29s kube-proxy Starting kube-proxy.
Normal Starting 5m55s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m55s (x8 over 5m55s) kubelet Node old-k8s-version-394049 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m55s (x8 over 5m55s) kubelet Node old-k8s-version-394049 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m55s (x7 over 5m55s) kubelet Node old-k8s-version-394049 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m55s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m42s kube-proxy Starting kube-proxy.
==> dmesg <==
==> etcd [b840f973e99b93adc44783c2e2d337691055b2010c919612e3dadc0ed1482689] <==
2024-08-27 23:54:10.946515 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:54:20.946343 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:54:30.946602 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:54:40.946472 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:54:50.946300 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:55:00.946398 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:55:10.946490 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:55:20.946486 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:55:30.946491 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:55:40.946522 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:55:50.946271 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:56:00.946737 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:56:10.946647 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:56:20.946447 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:56:30.946343 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:56:40.946440 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:56:50.946400 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:57:00.946516 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:57:10.946475 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:57:20.946279 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:57:30.946350 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:57:40.946406 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:57:50.946476 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:58:00.946727 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:58:10.946903 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [ec54c116a9331e1e0344c99a787d2410df9e7415035a80a4727091fdd518c6d9] <==
raft2024/08/27 23:49:20 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/08/27 23:49:20 INFO: ea7e25599daad906 became leader at term 2
raft2024/08/27 23:49:20 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-08-27 23:49:20.221303 I | etcdserver: published {Name:old-k8s-version-394049 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-08-27 23:49:20.221630 I | embed: ready to serve client requests
2024-08-27 23:49:20.228447 I | embed: serving client requests on 192.168.76.2:2379
2024-08-27 23:49:20.229161 I | etcdserver: setting up the initial cluster version to 3.4
2024-08-27 23:49:20.238788 I | embed: ready to serve client requests
2024-08-27 23:49:20.240276 N | etcdserver/membership: set the initial cluster version to 3.4
2024-08-27 23:49:20.240699 I | embed: serving client requests on 127.0.0.1:2379
2024-08-27 23:49:20.269520 I | etcdserver/api: enabled capabilities for version 3.4
2024-08-27 23:49:44.260649 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:49:46.939539 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:49:56.939475 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:50:06.939364 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:50:16.939572 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:50:26.939536 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:50:36.939385 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:50:46.939461 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:50:56.939378 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:51:06.939515 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:51:16.939554 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:51:26.939445 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:51:36.942138 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-27 23:51:46.939784 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
23:58:14 up 7:40, 0 users, load average: 1.12, 1.76, 2.32
Linux old-k8s-version-394049 5.15.0-1068-aws #74~20.04.1-Ubuntu SMP Tue Aug 6 19:45:17 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [1cbb985b30629df7e58845adea1be58296d1c4b309b10502e97ae37f80e864fd] <==
I0827 23:56:13.413924 1 main.go:299] handling current node
I0827 23:56:23.422550 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:56:23.422587 1 main.go:299] handling current node
I0827 23:56:33.414264 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:56:33.414302 1 main.go:299] handling current node
I0827 23:56:43.413822 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:56:43.413861 1 main.go:299] handling current node
I0827 23:56:53.422388 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:56:53.422426 1 main.go:299] handling current node
I0827 23:57:03.422296 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:57:03.422334 1 main.go:299] handling current node
I0827 23:57:13.421316 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:57:13.421354 1 main.go:299] handling current node
I0827 23:57:23.421702 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:57:23.421741 1 main.go:299] handling current node
I0827 23:57:33.413559 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:57:33.413593 1 main.go:299] handling current node
I0827 23:57:43.422053 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:57:43.422268 1 main.go:299] handling current node
I0827 23:57:53.420477 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:57:53.420518 1 main.go:299] handling current node
I0827 23:58:03.421617 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:58:03.421696 1 main.go:299] handling current node
I0827 23:58:13.420522 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:58:13.420556 1 main.go:299] handling current node
==> kindnet [575a6ee419e7fe10299e33d8b97f8c2598ad91a8fea4bdd2f0dd5e2db16ada9c] <==
I0827 23:49:48.616042 1 controller.go:374] Syncing nftables rules
I0827 23:49:58.420931 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:49:58.420997 1 main.go:299] handling current node
I0827 23:50:08.413762 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:50:08.413794 1 main.go:299] handling current node
I0827 23:50:18.421243 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:50:18.421279 1 main.go:299] handling current node
I0827 23:50:28.420557 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:50:28.420593 1 main.go:299] handling current node
I0827 23:50:38.413777 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:50:38.413815 1 main.go:299] handling current node
I0827 23:50:48.413560 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:50:48.413626 1 main.go:299] handling current node
I0827 23:50:58.421307 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:50:58.421346 1 main.go:299] handling current node
I0827 23:51:08.412728 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:51:08.412816 1 main.go:299] handling current node
I0827 23:51:18.421429 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:51:18.421463 1 main.go:299] handling current node
I0827 23:51:28.420902 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:51:28.420935 1 main.go:299] handling current node
I0827 23:51:38.413184 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:51:38.413227 1 main.go:299] handling current node
I0827 23:51:48.413310 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0827 23:51:48.413345 1 main.go:299] handling current node
==> kube-apiserver [236ee37eeeb99bd1460f867c4e7fe387aa435f0c3062f69ba966a2912dcefd98] <==
I0827 23:54:54.541332 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0827 23:54:54.541340 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0827 23:55:32.642740 1 handler_proxy.go:102] no RequestInfo found in the context
E0827 23:55:32.642825 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0827 23:55:32.642841 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0827 23:55:33.324134 1 client.go:360] parsed scheme: "passthrough"
I0827 23:55:33.324189 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0827 23:55:33.324199 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0827 23:56:07.143691 1 client.go:360] parsed scheme: "passthrough"
I0827 23:56:07.143912 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0827 23:56:07.144101 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0827 23:56:44.563586 1 client.go:360] parsed scheme: "passthrough"
I0827 23:56:44.563787 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0827 23:56:44.563807 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0827 23:57:28.912981 1 client.go:360] parsed scheme: "passthrough"
I0827 23:57:28.913025 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0827 23:57:28.913034 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0827 23:57:31.165910 1 handler_proxy.go:102] no RequestInfo found in the context
E0827 23:57:31.166143 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0827 23:57:31.166159 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0827 23:58:12.047007 1 client.go:360] parsed scheme: "passthrough"
I0827 23:58:12.047056 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0827 23:58:12.047065 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [8ad8c60d925d8c127982d6c494b2944705246a4e1f900b216029c075b40579c3] <==
I0827 23:49:26.708556 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0827 23:49:26.708650 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0827 23:49:27.234048 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0827 23:49:27.287121 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0827 23:49:27.409556 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I0827 23:49:27.410673 1 controller.go:606] quota admission added evaluator for: endpoints
I0827 23:49:27.415419 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0827 23:49:27.743338 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0827 23:49:28.365909 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0827 23:49:28.874379 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0827 23:49:28.938161 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0827 23:49:44.461224 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0827 23:49:44.482699 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0827 23:50:00.535243 1 client.go:360] parsed scheme: "passthrough"
I0827 23:50:00.535306 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0827 23:50:00.535316 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0827 23:50:33.661932 1 client.go:360] parsed scheme: "passthrough"
I0827 23:50:33.661981 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0827 23:50:33.661990 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0827 23:51:05.141825 1 client.go:360] parsed scheme: "passthrough"
I0827 23:51:05.141902 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0827 23:51:05.143276 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0827 23:51:45.881953 1 client.go:360] parsed scheme: "passthrough"
I0827 23:51:45.882167 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0827 23:51:45.882260 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [30ef2c8817f233bf500df3120c006454ceca974e44a9d5b1ccb0d2f184c7a618] <==
I0827 23:49:44.493906 1 shared_informer.go:247] Caches are synced for stateful set
I0827 23:49:44.507461 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
I0827 23:49:44.509031 1 shared_informer.go:247] Caches are synced for service account
I0827 23:49:44.519339 1 shared_informer.go:247] Caches are synced for ReplicaSet
I0827 23:49:44.519837 1 shared_informer.go:247] Caches are synced for resource quota
I0827 23:49:44.526166 1 shared_informer.go:247] Caches are synced for namespace
E0827 23:49:44.528012 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
I0827 23:49:44.549627 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-d84wl"
I0827 23:49:44.550656 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-fbhfc"
I0827 23:49:44.561561 1 shared_informer.go:247] Caches are synced for resource quota
I0827 23:49:44.570205 1 shared_informer.go:247] Caches are synced for HPA
I0827 23:49:44.598080 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-jbl8g"
I0827 23:49:44.628771 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-bv2q4"
I0827 23:49:44.713341 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0827 23:49:44.918467 1 shared_informer.go:247] Caches are synced for garbage collector
I0827 23:49:44.985638 1 shared_informer.go:247] Caches are synced for garbage collector
I0827 23:49:44.985673 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0827 23:49:46.620704 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0827 23:49:46.660901 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-jbl8g"
I0827 23:49:49.470636 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0827 23:51:49.404839 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
I0827 23:51:49.436761 1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"metrics-server-9975d5f86-\" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount \"metrics-server\" not found"
E0827 23:51:49.459024 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with pods "metrics-server-9975d5f86-" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount "metrics-server" not found
E0827 23:51:49.539072 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
E0827 23:51:49.608618 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
==> kube-controller-manager [b80f35939db8aaeb12827ab1e612ae18e95c0c024e797cd5b1ea4629fe4a70ea] <==
W0827 23:53:53.722526 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0827 23:54:19.758029 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0827 23:54:25.373117 1 request.go:655] Throttling request took 1.048206911s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0827 23:54:26.224755 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0827 23:54:50.259984 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0827 23:54:57.875101 1 request.go:655] Throttling request took 1.048320397s, request: GET:https://192.168.76.2:8443/apis/admissionregistration.k8s.io/v1beta1?timeout=32s
W0827 23:54:58.726692 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0827 23:55:20.762003 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0827 23:55:30.377150 1 request.go:655] Throttling request took 1.047874412s, request: GET:https://192.168.76.2:8443/apis/admissionregistration.k8s.io/v1?timeout=32s
W0827 23:55:31.228541 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0827 23:55:51.263818 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0827 23:56:02.878956 1 request.go:655] Throttling request took 1.048466592s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0827 23:56:03.730498 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0827 23:56:21.765861 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0827 23:56:35.380954 1 request.go:655] Throttling request took 1.048324438s, request: GET:https://192.168.76.2:8443/apis/admissionregistration.k8s.io/v1beta1?timeout=32s
W0827 23:56:36.235037 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0827 23:56:52.267934 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0827 23:57:07.885587 1 request.go:655] Throttling request took 1.048295617s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0827 23:57:08.737114 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0827 23:57:22.770104 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0827 23:57:40.387783 1 request.go:655] Throttling request took 1.04851645s, request: GET:https://192.168.76.2:8443/apis/admissionregistration.k8s.io/v1?timeout=32s
W0827 23:57:41.241391 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0827 23:57:53.272690 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0827 23:58:12.892712 1 request.go:655] Throttling request took 1.042734796s, request: GET:https://192.168.76.2:8443/apis/batch/v1?timeout=32s
W0827 23:58:13.744482 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [afa3d5bad6b52464ebc366db825a3bae7e5c7708a260053326c71f3b698cb205] <==
I0827 23:49:45.609147 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0827 23:49:45.609313 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0827 23:49:45.633739 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0827 23:49:45.633851 1 server_others.go:185] Using iptables Proxier.
I0827 23:49:45.634320 1 server.go:650] Version: v1.20.0
I0827 23:49:45.634940 1 config.go:315] Starting service config controller
I0827 23:49:45.634949 1 shared_informer.go:240] Waiting for caches to sync for service config
I0827 23:49:45.634965 1 config.go:224] Starting endpoint slice config controller
I0827 23:49:45.634968 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0827 23:49:45.735090 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0827 23:49:45.735093 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [b794569e1af8dd0a1e24a3b37ce65bee8173206424ae64ce50ae15299bc2ce1e] <==
I0827 23:52:32.232553 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0827 23:52:32.232693 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0827 23:52:32.249652 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0827 23:52:32.249934 1 server_others.go:185] Using iptables Proxier.
I0827 23:52:32.250261 1 server.go:650] Version: v1.20.0
I0827 23:52:32.250705 1 config.go:315] Starting service config controller
I0827 23:52:32.250837 1 shared_informer.go:240] Waiting for caches to sync for service config
I0827 23:52:32.250711 1 config.go:224] Starting endpoint slice config controller
I0827 23:52:32.251300 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0827 23:52:32.351045 1 shared_informer.go:247] Caches are synced for service config
I0827 23:52:32.352239 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [1a994ea8ba82f081ccc9e2ac0e483d50f83e2ed42aa614b79c8caa2103abf267] <==
I0827 23:52:24.411143 1 serving.go:331] Generated self-signed cert in-memory
W0827 23:52:29.750237 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0827 23:52:29.750272 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0827 23:52:29.750283 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0827 23:52:29.750300 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0827 23:52:30.229458 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0827 23:52:30.230335 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0827 23:52:30.230357 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0827 23:52:30.230453 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0827 23:52:30.332685 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [cb5a0544025d9eeba2b0613deeb98000ece1fd8d335ccd8307d6631b0c79b808] <==
W0827 23:49:25.873747 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0827 23:49:25.873829 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0827 23:49:25.873908 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0827 23:49:25.952735 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0827 23:49:25.961401 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0827 23:49:25.961420 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0827 23:49:25.961454 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0827 23:49:25.972839 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0827 23:49:25.973313 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0827 23:49:25.973379 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0827 23:49:25.973438 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0827 23:49:25.973496 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0827 23:49:25.973564 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0827 23:49:25.987859 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0827 23:49:25.987960 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0827 23:49:26.007252 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0827 23:49:26.007386 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0827 23:49:26.007488 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0827 23:49:26.007879 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0827 23:49:26.809445 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0827 23:49:26.809644 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0827 23:49:26.901755 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0827 23:49:26.980216 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0827 23:49:27.010358 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
I0827 23:49:29.461505 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Aug 27 23:56:38 old-k8s-version-394049 kubelet[661]: E0827 23:56:38.403581 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 27 23:56:39 old-k8s-version-394049 kubelet[661]: I0827 23:56:39.403254 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8db6aabd38edbe1e2f1270112a398c6712fa7e260a2d74fdad6fda93f49d5f89
Aug 27 23:56:39 old-k8s-version-394049 kubelet[661]: E0827 23:56:39.403644 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
Aug 27 23:56:50 old-k8s-version-394049 kubelet[661]: E0827 23:56:50.403803 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 27 23:56:54 old-k8s-version-394049 kubelet[661]: I0827 23:56:54.402756 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8db6aabd38edbe1e2f1270112a398c6712fa7e260a2d74fdad6fda93f49d5f89
Aug 27 23:56:54 old-k8s-version-394049 kubelet[661]: E0827 23:56:54.403100 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
Aug 27 23:57:03 old-k8s-version-394049 kubelet[661]: E0827 23:57:03.403600 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 27 23:57:09 old-k8s-version-394049 kubelet[661]: I0827 23:57:09.403136 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8db6aabd38edbe1e2f1270112a398c6712fa7e260a2d74fdad6fda93f49d5f89
Aug 27 23:57:09 old-k8s-version-394049 kubelet[661]: E0827 23:57:09.403474 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
Aug 27 23:57:17 old-k8s-version-394049 kubelet[661]: E0827 23:57:17.403665 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 27 23:57:22 old-k8s-version-394049 kubelet[661]: I0827 23:57:22.402831 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8db6aabd38edbe1e2f1270112a398c6712fa7e260a2d74fdad6fda93f49d5f89
Aug 27 23:57:22 old-k8s-version-394049 kubelet[661]: E0827 23:57:22.403246 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
Aug 27 23:57:30 old-k8s-version-394049 kubelet[661]: E0827 23:57:30.403646 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 27 23:57:36 old-k8s-version-394049 kubelet[661]: I0827 23:57:36.402817 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8db6aabd38edbe1e2f1270112a398c6712fa7e260a2d74fdad6fda93f49d5f89
Aug 27 23:57:36 old-k8s-version-394049 kubelet[661]: E0827 23:57:36.403163 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
Aug 27 23:57:43 old-k8s-version-394049 kubelet[661]: E0827 23:57:43.403668 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 27 23:57:51 old-k8s-version-394049 kubelet[661]: I0827 23:57:51.402823 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8db6aabd38edbe1e2f1270112a398c6712fa7e260a2d74fdad6fda93f49d5f89
Aug 27 23:57:51 old-k8s-version-394049 kubelet[661]: E0827 23:57:51.403157 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
Aug 27 23:57:57 old-k8s-version-394049 kubelet[661]: E0827 23:57:57.404181 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 27 23:58:05 old-k8s-version-394049 kubelet[661]: I0827 23:58:05.402798 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8db6aabd38edbe1e2f1270112a398c6712fa7e260a2d74fdad6fda93f49d5f89
Aug 27 23:58:05 old-k8s-version-394049 kubelet[661]: E0827 23:58:05.403164 661 pod_workers.go:191] Error syncing pod 833506d0-947f-42a5-b544-093d7ddb1870 ("dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-72r62_kubernetes-dashboard(833506d0-947f-42a5-b544-093d7ddb1870)"
Aug 27 23:58:12 old-k8s-version-394049 kubelet[661]: E0827 23:58:12.429038 661 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 27 23:58:12 old-k8s-version-394049 kubelet[661]: E0827 23:58:12.429100 661 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 27 23:58:12 old-k8s-version-394049 kubelet[661]: E0827 23:58:12.429302 661 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-nrslw,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6
c-c425-42a2-9ece-0b66a9f7a842): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 27 23:58:12 old-k8s-version-394049 kubelet[661]: E0827 23:58:12.429378 661 pod_workers.go:191] Error syncing pod d9d77d6c-c425-42a2-9ece-0b66a9f7a842 ("metrics-server-9975d5f86-hrfcg_kube-system(d9d77d6c-c425-42a2-9ece-0b66a9f7a842)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
==> kubernetes-dashboard [d6670465175a28a741e1eadfb9ec891d36c454066af259c2ba1292e1c2d606d9] <==
2024/08/27 23:52:54 Starting overwatch
2024/08/27 23:52:54 Using namespace: kubernetes-dashboard
2024/08/27 23:52:54 Using in-cluster config to connect to apiserver
2024/08/27 23:52:54 Using secret token for csrf signing
2024/08/27 23:52:54 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/08/27 23:52:54 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/08/27 23:52:54 Successful initial request to the apiserver, version: v1.20.0
2024/08/27 23:52:54 Generating JWE encryption key
2024/08/27 23:52:54 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/08/27 23:52:54 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/08/27 23:52:54 Initializing JWE encryption key from synchronized object
2024/08/27 23:52:54 Creating in-cluster Sidecar client
2024/08/27 23:52:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/27 23:52:54 Serving insecurely on HTTP port: 9090
2024/08/27 23:53:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/27 23:53:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/27 23:54:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/27 23:54:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/27 23:55:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/27 23:55:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/27 23:56:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/27 23:56:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/27 23:57:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/27 23:57:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
==> storage-provisioner [42597d6ccc6c90213fb2f50464c1373d136df2cc9496367789b03fba8d5f25bf] <==
I0827 23:52:32.511409 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0827 23:52:32.524032 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0827 23:52:32.524833 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0827 23:52:49.962793 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0827 23:52:49.963412 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f6b2a3b3-516a-4856-9d3f-d4c8c78b942c", APIVersion:"v1", ResourceVersion:"796", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-394049_8ce7e426-fe00-4a35-9664-c97b3fd81e90 became leader
I0827 23:52:49.967723 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-394049_8ce7e426-fe00-4a35-9664-c97b3fd81e90!
I0827 23:52:50.069084 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-394049_8ce7e426-fe00-4a35-9664-c97b3fd81e90!
==> storage-provisioner [592dbdd737e878b0fe0ea4cea6b72f6e640f9c434b17d5af3d98a6c70210e42c] <==
I0827 23:49:47.447539 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0827 23:49:47.473188 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0827 23:49:47.473259 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0827 23:49:47.487311 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0827 23:49:47.487835 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-394049_ab469b8b-8320-4159-9e92-4cbfd295dcf4!
I0827 23:49:47.492450 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f6b2a3b3-516a-4856-9d3f-d4c8c78b942c", APIVersion:"v1", ResourceVersion:"468", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-394049_ab469b8b-8320-4159-9e92-4cbfd295dcf4 became leader
I0827 23:49:47.588440 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-394049_ab469b8b-8320-4159-9e92-4cbfd295dcf4!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-394049 -n old-k8s-version-394049
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-394049 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-hrfcg
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-394049 describe pod metrics-server-9975d5f86-hrfcg
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-394049 describe pod metrics-server-9975d5f86-hrfcg: exit status 1 (109.045433ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-hrfcg" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-394049 describe pod metrics-server-9975d5f86-hrfcg: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (374.10s)