=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-628218 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E0805 12:29:07.648971 2953168 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/functional-255327/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-628218 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 80 (6m10.762939144s)
-- stdout --
* [old-k8s-version-628218] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19378
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19378-2947781/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19378-2947781/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
* Using the docker driver based on existing profile
* Starting "old-k8s-version-628218" primary control-plane node in "old-k8s-version-628218" cluster
* Pulling base image v0.0.44-1721902582-19326 ...
* Restarting existing docker container for "old-k8s-version-628218" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
* Verifying Kubernetes components...
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-628218 addons enable metrics-server
* Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
-- /stdout --
** stderr **
I0805 12:29:04.505897 3157290 out.go:291] Setting OutFile to fd 1 ...
I0805 12:29:04.506070 3157290 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 12:29:04.506100 3157290 out.go:304] Setting ErrFile to fd 2...
I0805 12:29:04.506118 3157290 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 12:29:04.506419 3157290 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19378-2947781/.minikube/bin
I0805 12:29:04.506798 3157290 out.go:298] Setting JSON to false
I0805 12:29:04.507833 3157290 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":72694,"bootTime":1722788250,"procs":214,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0805 12:29:04.507929 3157290 start.go:139] virtualization:
I0805 12:29:04.511405 3157290 out.go:177] * [old-k8s-version-628218] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0805 12:29:04.514379 3157290 out.go:177] - MINIKUBE_LOCATION=19378
I0805 12:29:04.514555 3157290 notify.go:220] Checking for updates...
I0805 12:29:04.519079 3157290 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0805 12:29:04.521230 3157290 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19378-2947781/kubeconfig
I0805 12:29:04.523059 3157290 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19378-2947781/.minikube
I0805 12:29:04.525083 3157290 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0805 12:29:04.527163 3157290 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0805 12:29:04.529254 3157290 config.go:182] Loaded profile config "old-k8s-version-628218": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0805 12:29:04.531881 3157290 out.go:177] * Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
I0805 12:29:04.533791 3157290 driver.go:392] Setting default libvirt URI to qemu:///system
I0805 12:29:04.569780 3157290 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0805 12:29:04.569901 3157290 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0805 12:29:04.635071 3157290 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:51 SystemTime:2024-08-05 12:29:04.624298965 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0805 12:29:04.635189 3157290 docker.go:307] overlay module found
I0805 12:29:04.637353 3157290 out.go:177] * Using the docker driver based on existing profile
I0805 12:29:04.639212 3157290 start.go:297] selected driver: docker
I0805 12:29:04.639234 3157290 start.go:901] validating driver "docker" against &{Name:old-k8s-version-628218 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-628218 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0805 12:29:04.639350 3157290 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0805 12:29:04.640016 3157290 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0805 12:29:04.697712 3157290 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:51 SystemTime:2024-08-05 12:29:04.68806886 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0805 12:29:04.698070 3157290 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0805 12:29:04.698100 3157290 cni.go:84] Creating CNI manager for ""
I0805 12:29:04.698109 3157290 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0805 12:29:04.698159 3157290 start.go:340] cluster config:
{Name:old-k8s-version-628218 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-628218 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0805 12:29:04.701769 3157290 out.go:177] * Starting "old-k8s-version-628218" primary control-plane node in "old-k8s-version-628218" cluster
I0805 12:29:04.703788 3157290 cache.go:121] Beginning downloading kic base image for docker with containerd
I0805 12:29:04.705741 3157290 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0805 12:29:04.707798 3157290 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0805 12:29:04.707852 3157290 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0805 12:29:04.707865 3157290 cache.go:56] Caching tarball of preloaded images
I0805 12:29:04.707890 3157290 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
I0805 12:29:04.707964 3157290 preload.go:172] Found /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0805 12:29:04.707975 3157290 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0805 12:29:04.708086 3157290 profile.go:143] Saving config to /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/old-k8s-version-628218/config.json ...
W0805 12:29:04.728844 3157290 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
I0805 12:29:04.728868 3157290 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0805 12:29:04.728971 3157290 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0805 12:29:04.728999 3157290 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0805 12:29:04.729004 3157290 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0805 12:29:04.729013 3157290 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0805 12:29:04.729018 3157290 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0805 12:29:04.938397 3157290 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0805 12:29:04.938446 3157290 cache.go:194] Successfully downloaded all kic artifacts
I0805 12:29:04.938492 3157290 start.go:360] acquireMachinesLock for old-k8s-version-628218: {Name:mk0d55ebb89898cf916cb1692795bb8134106ddb Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0805 12:29:04.938573 3157290 start.go:364] duration metric: took 54.203µs to acquireMachinesLock for "old-k8s-version-628218"
I0805 12:29:04.938601 3157290 start.go:96] Skipping create...Using existing machine configuration
I0805 12:29:04.938622 3157290 fix.go:54] fixHost starting:
I0805 12:29:04.938937 3157290 cli_runner.go:164] Run: docker container inspect old-k8s-version-628218 --format={{.State.Status}}
I0805 12:29:04.957672 3157290 fix.go:112] recreateIfNeeded on old-k8s-version-628218: state=Stopped err=<nil>
W0805 12:29:04.957714 3157290 fix.go:138] unexpected machine state, will restart: <nil>
I0805 12:29:04.960425 3157290 out.go:177] * Restarting existing docker container for "old-k8s-version-628218" ...
I0805 12:29:04.962582 3157290 cli_runner.go:164] Run: docker start old-k8s-version-628218
I0805 12:29:05.264841 3157290 cli_runner.go:164] Run: docker container inspect old-k8s-version-628218 --format={{.State.Status}}
I0805 12:29:05.288393 3157290 kic.go:430] container "old-k8s-version-628218" state is running.
I0805 12:29:05.288876 3157290 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-628218
I0805 12:29:05.315283 3157290 profile.go:143] Saving config to /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/old-k8s-version-628218/config.json ...
I0805 12:29:05.315501 3157290 machine.go:94] provisionDockerMachine start ...
I0805 12:29:05.315565 3157290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-628218
I0805 12:29:05.338179 3157290 main.go:141] libmachine: Using SSH client type: native
I0805 12:29:05.338449 3157290 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 36771 <nil> <nil>}
I0805 12:29:05.338467 3157290 main.go:141] libmachine: About to run SSH command:
hostname
I0805 12:29:05.339069 3157290 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:54244->127.0.0.1:36771: read: connection reset by peer
I0805 12:29:08.473169 3157290 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-628218
I0805 12:29:08.473196 3157290 ubuntu.go:169] provisioning hostname "old-k8s-version-628218"
I0805 12:29:08.473270 3157290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-628218
I0805 12:29:08.491163 3157290 main.go:141] libmachine: Using SSH client type: native
I0805 12:29:08.491410 3157290 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 36771 <nil> <nil>}
I0805 12:29:08.491429 3157290 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-628218 && echo "old-k8s-version-628218" | sudo tee /etc/hostname
I0805 12:29:08.642423 3157290 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-628218
I0805 12:29:08.642527 3157290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-628218
I0805 12:29:08.661273 3157290 main.go:141] libmachine: Using SSH client type: native
I0805 12:29:08.661581 3157290 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 36771 <nil> <nil>}
I0805 12:29:08.661607 3157290 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-628218' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-628218/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-628218' | sudo tee -a /etc/hosts;
fi
fi
I0805 12:29:08.797488 3157290 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0805 12:29:08.797516 3157290 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19378-2947781/.minikube CaCertPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19378-2947781/.minikube}
I0805 12:29:08.797545 3157290 ubuntu.go:177] setting up certificates
I0805 12:29:08.797556 3157290 provision.go:84] configureAuth start
I0805 12:29:08.797616 3157290 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-628218
I0805 12:29:08.813694 3157290 provision.go:143] copyHostCerts
I0805 12:29:08.813778 3157290 exec_runner.go:144] found /home/jenkins/minikube-integration/19378-2947781/.minikube/cert.pem, removing ...
I0805 12:29:08.813801 3157290 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19378-2947781/.minikube/cert.pem
I0805 12:29:08.813887 3157290 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19378-2947781/.minikube/cert.pem (1123 bytes)
I0805 12:29:08.813994 3157290 exec_runner.go:144] found /home/jenkins/minikube-integration/19378-2947781/.minikube/key.pem, removing ...
I0805 12:29:08.814006 3157290 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19378-2947781/.minikube/key.pem
I0805 12:29:08.814036 3157290 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19378-2947781/.minikube/key.pem (1675 bytes)
I0805 12:29:08.814113 3157290 exec_runner.go:144] found /home/jenkins/minikube-integration/19378-2947781/.minikube/ca.pem, removing ...
I0805 12:29:08.814123 3157290 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19378-2947781/.minikube/ca.pem
I0805 12:29:08.814150 3157290 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19378-2947781/.minikube/ca.pem (1078 bytes)
I0805 12:29:08.814218 3157290 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-628218 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-628218]
I0805 12:29:09.745211 3157290 provision.go:177] copyRemoteCerts
I0805 12:29:09.745287 3157290 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0805 12:29:09.745337 3157290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-628218
I0805 12:29:09.763045 3157290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36771 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/old-k8s-version-628218/id_rsa Username:docker}
I0805 12:29:09.864598 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0805 12:29:09.908580 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0805 12:29:09.947857 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0805 12:29:09.983951 3157290 provision.go:87] duration metric: took 1.186375425s to configureAuth
I0805 12:29:09.983987 3157290 ubuntu.go:193] setting minikube options for container-runtime
I0805 12:29:09.984217 3157290 config.go:182] Loaded profile config "old-k8s-version-628218": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0805 12:29:09.984226 3157290 machine.go:97] duration metric: took 4.668717539s to provisionDockerMachine
I0805 12:29:09.984239 3157290 start.go:293] postStartSetup for "old-k8s-version-628218" (driver="docker")
I0805 12:29:09.984253 3157290 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0805 12:29:09.984326 3157290 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0805 12:29:09.984385 3157290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-628218
I0805 12:29:10.015421 3157290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36771 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/old-k8s-version-628218/id_rsa Username:docker}
I0805 12:29:10.117955 3157290 ssh_runner.go:195] Run: cat /etc/os-release
I0805 12:29:10.122971 3157290 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0805 12:29:10.123011 3157290 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0805 12:29:10.123022 3157290 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0805 12:29:10.123029 3157290 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0805 12:29:10.123040 3157290 filesync.go:126] Scanning /home/jenkins/minikube-integration/19378-2947781/.minikube/addons for local assets ...
I0805 12:29:10.123108 3157290 filesync.go:126] Scanning /home/jenkins/minikube-integration/19378-2947781/.minikube/files for local assets ...
I0805 12:29:10.123201 3157290 filesync.go:149] local asset: /home/jenkins/minikube-integration/19378-2947781/.minikube/files/etc/ssl/certs/29531682.pem -> 29531682.pem in /etc/ssl/certs
I0805 12:29:10.123322 3157290 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0805 12:29:10.134342 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/files/etc/ssl/certs/29531682.pem --> /etc/ssl/certs/29531682.pem (1708 bytes)
I0805 12:29:10.165121 3157290 start.go:296] duration metric: took 180.861442ms for postStartSetup
I0805 12:29:10.165231 3157290 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0805 12:29:10.165292 3157290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-628218
I0805 12:29:10.185127 3157290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36771 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/old-k8s-version-628218/id_rsa Username:docker}
I0805 12:29:10.283840 3157290 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0805 12:29:10.289410 3157290 fix.go:56] duration metric: took 5.350785727s for fixHost
I0805 12:29:10.289433 3157290 start.go:83] releasing machines lock for "old-k8s-version-628218", held for 5.350845516s
I0805 12:29:10.289563 3157290 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-628218
I0805 12:29:10.317361 3157290 ssh_runner.go:195] Run: cat /version.json
I0805 12:29:10.317430 3157290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-628218
I0805 12:29:10.317721 3157290 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0805 12:29:10.317786 3157290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-628218
I0805 12:29:10.344630 3157290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36771 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/old-k8s-version-628218/id_rsa Username:docker}
I0805 12:29:10.359033 3157290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36771 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/old-k8s-version-628218/id_rsa Username:docker}
I0805 12:29:10.457357 3157290 ssh_runner.go:195] Run: systemctl --version
I0805 12:29:10.622317 3157290 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0805 12:29:10.627220 3157290 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0805 12:29:10.648768 3157290 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0805 12:29:10.648843 3157290 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0805 12:29:10.657772 3157290 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0805 12:29:10.657796 3157290 start.go:495] detecting cgroup driver to use...
I0805 12:29:10.657829 3157290 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0805 12:29:10.657882 3157290 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0805 12:29:10.672949 3157290 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0805 12:29:10.690365 3157290 docker.go:217] disabling cri-docker service (if available) ...
I0805 12:29:10.690429 3157290 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0805 12:29:10.708638 3157290 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0805 12:29:10.728401 3157290 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0805 12:29:10.849761 3157290 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0805 12:29:10.994997 3157290 docker.go:233] disabling docker service ...
I0805 12:29:10.995069 3157290 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0805 12:29:11.015042 3157290 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0805 12:29:11.030112 3157290 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0805 12:29:11.144061 3157290 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0805 12:29:11.266190 3157290 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0805 12:29:11.280000 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0805 12:29:11.298732 3157290 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0805 12:29:11.309169 3157290 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0805 12:29:11.320412 3157290 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0805 12:29:11.320500 3157290 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0805 12:29:11.333316 3157290 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0805 12:29:11.343932 3157290 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0805 12:29:11.354056 3157290 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0805 12:29:11.364467 3157290 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0805 12:29:11.373692 3157290 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0805 12:29:11.383991 3157290 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0805 12:29:11.393754 3157290 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0805 12:29:11.403278 3157290 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0805 12:29:11.508126 3157290 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0805 12:29:11.746827 3157290 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0805 12:29:11.746908 3157290 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0805 12:29:11.750856 3157290 start.go:563] Will wait 60s for crictl version
I0805 12:29:11.750920 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:29:11.755358 3157290 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0805 12:29:11.810726 3157290 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.19
RuntimeApiVersion: v1
I0805 12:29:11.810809 3157290 ssh_runner.go:195] Run: containerd --version
I0805 12:29:11.841726 3157290 ssh_runner.go:195] Run: containerd --version
I0805 12:29:11.876683 3157290 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
I0805 12:29:11.878537 3157290 cli_runner.go:164] Run: docker network inspect old-k8s-version-628218 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0805 12:29:11.896235 3157290 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0805 12:29:11.900742 3157290 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0805 12:29:11.913040 3157290 kubeadm.go:883] updating cluster {Name:old-k8s-version-628218 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-628218 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0805 12:29:11.913177 3157290 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0805 12:29:11.913243 3157290 ssh_runner.go:195] Run: sudo crictl images --output json
I0805 12:29:11.960204 3157290 containerd.go:627] all images are preloaded for containerd runtime.
I0805 12:29:11.960226 3157290 containerd.go:534] Images already preloaded, skipping extraction
I0805 12:29:11.960289 3157290 ssh_runner.go:195] Run: sudo crictl images --output json
I0805 12:29:12.037147 3157290 containerd.go:627] all images are preloaded for containerd runtime.
I0805 12:29:12.037170 3157290 cache_images.go:84] Images are preloaded, skipping loading
I0805 12:29:12.037180 3157290 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.20.0 containerd true true} ...
I0805 12:29:12.037296 3157290 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-628218 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-628218 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0805 12:29:12.037368 3157290 ssh_runner.go:195] Run: sudo crictl info
I0805 12:29:12.085845 3157290 cni.go:84] Creating CNI manager for ""
I0805 12:29:12.085927 3157290 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0805 12:29:12.085950 3157290 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0805 12:29:12.086001 3157290 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-628218 NodeName:old-k8s-version-628218 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0805 12:29:12.086182 3157290 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-628218"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0805 12:29:12.086277 3157290 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0805 12:29:12.096525 3157290 binaries.go:44] Found k8s binaries, skipping transfer
I0805 12:29:12.096602 3157290 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0805 12:29:12.110052 3157290 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0805 12:29:12.155070 3157290 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0805 12:29:12.179668 3157290 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0805 12:29:12.203962 3157290 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0805 12:29:12.207540 3157290 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0805 12:29:12.220720 3157290 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0805 12:29:12.344959 3157290 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0805 12:29:12.368476 3157290 certs.go:68] Setting up /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/old-k8s-version-628218 for IP: 192.168.85.2
I0805 12:29:12.368524 3157290 certs.go:194] generating shared ca certs ...
I0805 12:29:12.368548 3157290 certs.go:226] acquiring lock for ca certs: {Name:mk267f690d6a0351f64afa94f26929de1b9470e1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:29:12.368718 3157290 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/ca.key
I0805 12:29:12.368776 3157290 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/proxy-client-ca.key
I0805 12:29:12.368789 3157290 certs.go:256] generating profile certs ...
I0805 12:29:12.368897 3157290 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/old-k8s-version-628218/client.key
I0805 12:29:12.368979 3157290 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/old-k8s-version-628218/apiserver.key.a723193e
I0805 12:29:12.369023 3157290 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/old-k8s-version-628218/proxy-client.key
I0805 12:29:12.369152 3157290 certs.go:484] found cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/2953168.pem (1338 bytes)
W0805 12:29:12.369188 3157290 certs.go:480] ignoring /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/2953168_empty.pem, impossibly tiny 0 bytes
I0805 12:29:12.369209 3157290 certs.go:484] found cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca-key.pem (1679 bytes)
I0805 12:29:12.369240 3157290 certs.go:484] found cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca.pem (1078 bytes)
I0805 12:29:12.369267 3157290 certs.go:484] found cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/cert.pem (1123 bytes)
I0805 12:29:12.369301 3157290 certs.go:484] found cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/key.pem (1675 bytes)
I0805 12:29:12.369359 3157290 certs.go:484] found cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/files/etc/ssl/certs/29531682.pem (1708 bytes)
I0805 12:29:12.370184 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0805 12:29:12.397910 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0805 12:29:12.428986 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0805 12:29:12.476072 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0805 12:29:12.539815 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/old-k8s-version-628218/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0805 12:29:12.592773 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/old-k8s-version-628218/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0805 12:29:12.630253 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/old-k8s-version-628218/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0805 12:29:12.661282 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/old-k8s-version-628218/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0805 12:29:12.685820 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/2953168.pem --> /usr/share/ca-certificates/2953168.pem (1338 bytes)
I0805 12:29:12.713122 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/files/etc/ssl/certs/29531682.pem --> /usr/share/ca-certificates/29531682.pem (1708 bytes)
I0805 12:29:12.740709 3157290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0805 12:29:12.768019 3157290 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0805 12:29:12.789525 3157290 ssh_runner.go:195] Run: openssl version
I0805 12:29:12.795513 3157290 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/29531682.pem && ln -fs /usr/share/ca-certificates/29531682.pem /etc/ssl/certs/29531682.pem"
I0805 12:29:12.811902 3157290 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/29531682.pem
I0805 12:29:12.815756 3157290 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 5 11:48 /usr/share/ca-certificates/29531682.pem
I0805 12:29:12.815830 3157290 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/29531682.pem
I0805 12:29:12.824365 3157290 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/29531682.pem /etc/ssl/certs/3ec20f2e.0"
I0805 12:29:12.838945 3157290 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0805 12:29:12.853175 3157290 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0805 12:29:12.857800 3157290 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 5 11:38 /usr/share/ca-certificates/minikubeCA.pem
I0805 12:29:12.857907 3157290 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0805 12:29:12.867019 3157290 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0805 12:29:12.880085 3157290 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2953168.pem && ln -fs /usr/share/ca-certificates/2953168.pem /etc/ssl/certs/2953168.pem"
I0805 12:29:12.897882 3157290 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2953168.pem
I0805 12:29:12.903402 3157290 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 5 11:48 /usr/share/ca-certificates/2953168.pem
I0805 12:29:12.903566 3157290 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2953168.pem
I0805 12:29:12.915019 3157290 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2953168.pem /etc/ssl/certs/51391683.0"
I0805 12:29:12.933049 3157290 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0805 12:29:12.936994 3157290 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0805 12:29:12.947007 3157290 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0805 12:29:12.955225 3157290 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0805 12:29:12.966435 3157290 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0805 12:29:12.980043 3157290 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0805 12:29:12.990826 3157290 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0805 12:29:12.999381 3157290 kubeadm.go:392] StartCluster: {Name:old-k8s-version-628218 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-628218 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0805 12:29:12.999502 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0805 12:29:12.999584 3157290 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0805 12:29:13.079547 3157290 cri.go:89] found id: "d6fba388564c793c5389933336d0672c6073a88eaef246caace2ea874e623866"
I0805 12:29:13.079581 3157290 cri.go:89] found id: "3a48910e06110ae02c128be9c2e75b0359c0f6d5b1d8a5a3e228123d153ce298"
I0805 12:29:13.079587 3157290 cri.go:89] found id: "7d24d6305c643680ee9f0efa463186f9ffb9596f06b77f6bdca0ffd1e9f808a1"
I0805 12:29:13.079592 3157290 cri.go:89] found id: "7d92baabf40f37efdaf5f9a0ea099e97d5b9d67ab0c5057b0c2da9047637454b"
I0805 12:29:13.079595 3157290 cri.go:89] found id: "ebe0210d2958f3fd3a26d3ca59083ac59c13e1ec92612ca8962604e2fde9e6f9"
I0805 12:29:13.079599 3157290 cri.go:89] found id: "b0f295274cc0dc24801c47922225033790a049a64a2da070072638a1a5783324"
I0805 12:29:13.079603 3157290 cri.go:89] found id: "cb79833ef66834cddc4c8aa73ebb5d899ac9bf1ca03e023bb8cc835970bd7a80"
I0805 12:29:13.079606 3157290 cri.go:89] found id: "c57b337ca22f3da57a9a16c10bab53bd21ba60b658216f543ec77c7c261d76d0"
I0805 12:29:13.079609 3157290 cri.go:89] found id: ""
I0805 12:29:13.079682 3157290 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0805 12:29:13.097181 3157290 cri.go:116] JSON = null
W0805 12:29:13.097246 3157290 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0805 12:29:13.097323 3157290 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0805 12:29:13.108255 3157290 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0805 12:29:13.108279 3157290 kubeadm.go:593] restartPrimaryControlPlane start ...
I0805 12:29:13.108343 3157290 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0805 12:29:13.118444 3157290 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0805 12:29:13.119142 3157290 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-628218" does not appear in /home/jenkins/minikube-integration/19378-2947781/kubeconfig
I0805 12:29:13.119461 3157290 kubeconfig.go:62] /home/jenkins/minikube-integration/19378-2947781/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-628218" cluster setting kubeconfig missing "old-k8s-version-628218" context setting]
I0805 12:29:13.119980 3157290 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19378-2947781/kubeconfig: {Name:mk8b7c80437a27220d1b5f905b285c444f00a590 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:29:13.121792 3157290 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0805 12:29:13.137194 3157290 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2
I0805 12:29:13.137245 3157290 kubeadm.go:597] duration metric: took 28.959856ms to restartPrimaryControlPlane
I0805 12:29:13.137256 3157290 kubeadm.go:394] duration metric: took 137.885914ms to StartCluster
I0805 12:29:13.137277 3157290 settings.go:142] acquiring lock: {Name:mk4dc0908f4613d53d438c1494e61599b368d805 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:29:13.137387 3157290 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19378-2947781/kubeconfig
I0805 12:29:13.138508 3157290 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19378-2947781/kubeconfig: {Name:mk8b7c80437a27220d1b5f905b285c444f00a590 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:29:13.138759 3157290 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0805 12:29:13.139147 3157290 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0805 12:29:13.139268 3157290 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-628218"
I0805 12:29:13.139303 3157290 addons.go:69] Setting dashboard=true in profile "old-k8s-version-628218"
I0805 12:29:13.139320 3157290 addons.go:234] Setting addon dashboard=true in "old-k8s-version-628218"
W0805 12:29:13.139332 3157290 addons.go:243] addon dashboard should already be in state true
I0805 12:29:13.139361 3157290 host.go:66] Checking if "old-k8s-version-628218" exists ...
I0805 12:29:13.139840 3157290 cli_runner.go:164] Run: docker container inspect old-k8s-version-628218 --format={{.State.Status}}
I0805 12:29:13.140001 3157290 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-628218"
W0805 12:29:13.140014 3157290 addons.go:243] addon storage-provisioner should already be in state true
I0805 12:29:13.140034 3157290 host.go:66] Checking if "old-k8s-version-628218" exists ...
I0805 12:29:13.140449 3157290 cli_runner.go:164] Run: docker container inspect old-k8s-version-628218 --format={{.State.Status}}
I0805 12:29:13.139218 3157290 config.go:182] Loaded profile config "old-k8s-version-628218": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0805 12:29:13.140981 3157290 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-628218"
I0805 12:29:13.141001 3157290 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-628218"
W0805 12:29:13.141007 3157290 addons.go:243] addon metrics-server should already be in state true
I0805 12:29:13.141029 3157290 host.go:66] Checking if "old-k8s-version-628218" exists ...
I0805 12:29:13.141441 3157290 cli_runner.go:164] Run: docker container inspect old-k8s-version-628218 --format={{.State.Status}}
I0805 12:29:13.146418 3157290 out.go:177] * Verifying Kubernetes components...
I0805 12:29:13.146678 3157290 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-628218"
I0805 12:29:13.146707 3157290 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-628218"
I0805 12:29:13.147007 3157290 cli_runner.go:164] Run: docker container inspect old-k8s-version-628218 --format={{.State.Status}}
I0805 12:29:13.154401 3157290 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0805 12:29:13.208300 3157290 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0805 12:29:13.213585 3157290 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0805 12:29:13.216027 3157290 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0805 12:29:13.216154 3157290 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0805 12:29:13.216167 3157290 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0805 12:29:13.216246 3157290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-628218
I0805 12:29:13.224879 3157290 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0805 12:29:13.224903 3157290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0805 12:29:13.224973 3157290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-628218
I0805 12:29:13.237816 3157290 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-628218"
W0805 12:29:13.237838 3157290 addons.go:243] addon default-storageclass should already be in state true
I0805 12:29:13.237865 3157290 host.go:66] Checking if "old-k8s-version-628218" exists ...
I0805 12:29:13.238270 3157290 cli_runner.go:164] Run: docker container inspect old-k8s-version-628218 --format={{.State.Status}}
I0805 12:29:13.270510 3157290 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0805 12:29:13.272774 3157290 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0805 12:29:13.272807 3157290 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0805 12:29:13.272884 3157290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-628218
I0805 12:29:13.278871 3157290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36771 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/old-k8s-version-628218/id_rsa Username:docker}
I0805 12:29:13.307819 3157290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36771 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/old-k8s-version-628218/id_rsa Username:docker}
I0805 12:29:13.313742 3157290 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0805 12:29:13.313761 3157290 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0805 12:29:13.313820 3157290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-628218
I0805 12:29:13.339823 3157290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36771 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/old-k8s-version-628218/id_rsa Username:docker}
I0805 12:29:13.345587 3157290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36771 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/old-k8s-version-628218/id_rsa Username:docker}
I0805 12:29:13.391218 3157290 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0805 12:29:13.444668 3157290 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-628218" to be "Ready" ...
I0805 12:29:13.497954 3157290 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0805 12:29:13.498065 3157290 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0805 12:29:13.534409 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0805 12:29:13.543802 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0805 12:29:13.545924 3157290 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0805 12:29:13.545945 3157290 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0805 12:29:13.581048 3157290 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0805 12:29:13.581073 3157290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0805 12:29:13.607531 3157290 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0805 12:29:13.607561 3157290 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0805 12:29:13.658683 3157290 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0805 12:29:13.658756 3157290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0805 12:29:13.687544 3157290 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0805 12:29:13.687639 3157290 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0805 12:29:13.750582 3157290 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0805 12:29:13.750656 3157290 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0805 12:29:13.764066 3157290 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0805 12:29:13.764144 3157290 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0805 12:29:13.812766 3157290 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0805 12:29:13.812792 3157290 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W0805 12:29:13.854368 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:13.854400 3157290 retry.go:31] will retry after 306.673289ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 12:29:13.859416 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:13.859451 3157290 retry.go:31] will retry after 208.069187ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:13.873071 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0805 12:29:13.877647 3157290 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0805 12:29:13.877676 3157290 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0805 12:29:13.917699 3157290 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0805 12:29:13.917778 3157290 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0805 12:29:13.976253 3157290 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0805 12:29:13.976325 3157290 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
W0805 12:29:14.012187 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:14.012277 3157290 retry.go:31] will retry after 223.912195ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:14.012724 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0805 12:29:14.068607 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0805 12:29:14.161582 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0805 12:29:14.184392 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:14.184476 3157290 retry.go:31] will retry after 350.994245ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 12:29:14.210868 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:14.210940 3157290 retry.go:31] will retry after 438.606713ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:14.237252 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0805 12:29:14.349817 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:14.349848 3157290 retry.go:31] will retry after 453.478312ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 12:29:14.404503 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:14.404535 3157290 retry.go:31] will retry after 443.803407ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:14.535726 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0805 12:29:14.646166 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:14.646204 3157290 retry.go:31] will retry after 562.258252ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:14.650494 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0805 12:29:14.755245 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:14.755281 3157290 retry.go:31] will retry after 474.681923ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:14.803503 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0805 12:29:14.848796 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0805 12:29:14.919458 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:14.919491 3157290 retry.go:31] will retry after 376.056633ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 12:29:15.037309 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:15.037353 3157290 retry.go:31] will retry after 300.667039ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:15.208655 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0805 12:29:15.230538 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0805 12:29:15.296355 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0805 12:29:15.337194 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:15.337223 3157290 retry.go:31] will retry after 669.767047ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:15.338410 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0805 12:29:15.445867 3157290 node_ready.go:53] error getting node "old-k8s-version-628218": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-628218": dial tcp 192.168.85.2:8443: connect: connection refused
W0805 12:29:15.519273 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:15.519377 3157290 retry.go:31] will retry after 967.211859ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 12:29:15.591646 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:15.591676 3157290 retry.go:31] will retry after 789.279989ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 12:29:15.641918 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:15.641948 3157290 retry.go:31] will retry after 1.06272379s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:16.008229 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0805 12:29:16.098739 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:16.098775 3157290 retry.go:31] will retry after 618.017979ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:16.382083 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0805 12:29:16.487144 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0805 12:29:16.515267 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:16.515298 3157290 retry.go:31] will retry after 1.397685092s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 12:29:16.596853 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:16.596884 3157290 retry.go:31] will retry after 790.686902ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:16.705205 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0805 12:29:16.717589 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0805 12:29:16.911027 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:16.911058 3157290 retry.go:31] will retry after 777.818372ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 12:29:16.911098 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:16.911112 3157290 retry.go:31] will retry after 1.213242948s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:17.388304 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0805 12:29:17.445935 3157290 node_ready.go:53] error getting node "old-k8s-version-628218": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-628218": dial tcp 192.168.85.2:8443: connect: connection refused
W0805 12:29:17.507444 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:17.507474 3157290 retry.go:31] will retry after 1.548652927s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:17.689947 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0805 12:29:17.814656 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:17.814687 3157290 retry.go:31] will retry after 1.920704827s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:17.914088 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0805 12:29:18.014656 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:18.014689 3157290 retry.go:31] will retry after 1.626398465s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:18.124936 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0805 12:29:18.248233 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:18.248267 3157290 retry.go:31] will retry after 1.229539782s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:19.057292 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0805 12:29:19.136282 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:19.136316 3157290 retry.go:31] will retry after 2.393474757s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:19.446251 3157290 node_ready.go:53] error getting node "old-k8s-version-628218": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-628218": dial tcp 192.168.85.2:8443: connect: connection refused
I0805 12:29:19.478582 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0805 12:29:19.552861 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:19.552896 3157290 retry.go:31] will retry after 1.630066918s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:19.642132 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0805 12:29:19.715812 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:19.715846 3157290 retry.go:31] will retry after 3.213868808s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:19.736020 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0805 12:29:19.853137 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:19.853172 3157290 retry.go:31] will retry after 4.219995725s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:21.183695 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0805 12:29:21.306060 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:21.306110 3157290 retry.go:31] will retry after 2.531621974s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:21.530117 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0805 12:29:21.914312 3157290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:21.914343 3157290 retry.go:31] will retry after 5.983158268s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 12:29:21.945860 3157290 node_ready.go:53] error getting node "old-k8s-version-628218": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-628218": dial tcp 192.168.85.2:8443: connect: connection refused
I0805 12:29:22.930742 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0805 12:29:23.837893 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0805 12:29:24.073777 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0805 12:29:27.898179 3157290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0805 12:29:33.305965 3157290 node_ready.go:49] node "old-k8s-version-628218" has status "Ready":"True"
I0805 12:29:33.305989 3157290 node_ready.go:38] duration metric: took 19.861277377s for node "old-k8s-version-628218" to be "Ready" ...
I0805 12:29:33.306000 3157290 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0805 12:29:33.655864 3157290 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-879s2" in "kube-system" namespace to be "Ready" ...
I0805 12:29:33.914047 3157290 pod_ready.go:92] pod "coredns-74ff55c5b-879s2" in "kube-system" namespace has status "Ready":"True"
I0805 12:29:33.914068 3157290 pod_ready.go:81] duration metric: took 258.124526ms for pod "coredns-74ff55c5b-879s2" in "kube-system" namespace to be "Ready" ...
I0805 12:29:33.914079 3157290 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-628218" in "kube-system" namespace to be "Ready" ...
I0805 12:29:35.412014 3157290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (12.481228841s)
I0805 12:29:35.926410 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:29:36.365171 3157290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (12.52722342s)
I0805 12:29:36.365477 3157290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (12.291668969s)
I0805 12:29:36.365541 3157290 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-628218"
I0805 12:29:36.365549 3157290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (8.467334373s)
I0805 12:29:36.368038 3157290 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-628218 addons enable metrics-server
I0805 12:29:36.381225 3157290 out.go:177] * Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
I0805 12:29:36.383489 3157290 addons.go:510] duration metric: took 23.244336602s for enable addons: enabled=[storage-provisioner metrics-server dashboard default-storageclass]
I0805 12:29:38.420786 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:29:40.420939 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:29:42.429198 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:29:44.921846 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:29:47.420861 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:29:49.422970 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:29:51.425312 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:29:53.932424 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:29:56.420746 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:29:58.446180 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:00.920219 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:02.920601 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:04.931114 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:07.420403 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:09.421059 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:11.920552 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:13.921337 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:16.423203 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:18.920578 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:20.922281 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:23.420498 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:25.420981 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:27.921391 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:30.419880 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:32.420358 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:34.420694 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:36.422338 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:38.921378 3157290 pod_ready.go:102] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:40.419446 3157290 pod_ready.go:92] pod "etcd-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"True"
I0805 12:30:40.419478 3157290 pod_ready.go:81] duration metric: took 1m6.505388282s for pod "etcd-old-k8s-version-628218" in "kube-system" namespace to be "Ready" ...
I0805 12:30:40.419493 3157290 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-628218" in "kube-system" namespace to be "Ready" ...
I0805 12:30:40.424672 3157290 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"True"
I0805 12:30:40.424700 3157290 pod_ready.go:81] duration metric: took 5.198707ms for pod "kube-apiserver-old-k8s-version-628218" in "kube-system" namespace to be "Ready" ...
I0805 12:30:40.424712 3157290 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-628218" in "kube-system" namespace to be "Ready" ...
I0805 12:30:40.429525 3157290 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"True"
I0805 12:30:40.429592 3157290 pod_ready.go:81] duration metric: took 4.871192ms for pod "kube-controller-manager-old-k8s-version-628218" in "kube-system" namespace to be "Ready" ...
I0805 12:30:40.429609 3157290 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-6lls2" in "kube-system" namespace to be "Ready" ...
I0805 12:30:40.434513 3157290 pod_ready.go:92] pod "kube-proxy-6lls2" in "kube-system" namespace has status "Ready":"True"
I0805 12:30:40.434586 3157290 pod_ready.go:81] duration metric: took 4.967807ms for pod "kube-proxy-6lls2" in "kube-system" namespace to be "Ready" ...
I0805 12:30:40.434613 3157290 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace to be "Ready" ...
I0805 12:30:42.440682 3157290 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:44.942088 3157290 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:47.441226 3157290 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:49.442284 3157290 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:51.942208 3157290 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:54.440795 3157290 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:56.939866 3157290 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:30:58.949067 3157290 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:01.440953 3157290 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:03.450109 3157290 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"True"
I0805 12:31:03.450268 3157290 pod_ready.go:81] duration metric: took 23.015625666s for pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace to be "Ready" ...
I0805 12:31:03.450329 3157290 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace to be "Ready" ...
I0805 12:31:05.462479 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:07.972586 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:10.456991 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:12.457164 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:14.957035 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:17.456576 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:19.957559 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:21.958442 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:23.959618 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:26.458360 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:28.956879 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:30.956955 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:33.456197 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:35.456667 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:37.957847 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:40.456677 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:42.956342 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:44.957625 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:47.456574 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:49.456666 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:51.457007 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:54.062223 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:56.456607 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:58.956629 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:00.956692 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:03.456404 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:05.456584 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:07.957020 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:10.456213 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:12.957281 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:15.458618 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:17.957802 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:20.456777 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:22.956845 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:25.456830 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:27.458300 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:29.956824 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:32.455982 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:34.456505 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:36.956676 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:38.957313 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:41.455925 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:43.456081 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:45.457078 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:47.458691 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:49.957307 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:52.456066 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:54.456318 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:56.457407 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:58.963249 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:01.457810 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:03.957548 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:06.456195 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:08.956131 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:10.957663 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:13.456942 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:15.457634 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:17.957308 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:20.456679 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:22.957640 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:24.961733 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:27.456439 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:29.957065 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:32.456279 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:34.459566 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:36.465900 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:38.958536 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:41.456045 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:43.456696 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:45.955957 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:47.956771 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:49.962794 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:52.456445 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:54.957245 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:57.456619 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:59.956986 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:01.957154 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:03.957362 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:05.957432 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:08.456204 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:10.457666 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:12.956662 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:15.456333 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:17.956702 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:19.956818 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:22.455911 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:24.457145 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:26.956409 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:28.959568 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:31.456770 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:33.957357 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:36.455811 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:38.456320 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:40.956977 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:43.456551 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:45.456830 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:47.956773 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:49.957129 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:51.957356 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:54.456748 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:56.956905 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:59.456161 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:35:01.456714 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:35:03.457092 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:35:03.457122 3157290 pod_ready.go:81] duration metric: took 4m0.00677131s for pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace to be "Ready" ...
E0805 12:35:03.457133 3157290 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0805 12:35:03.457142 3157290 pod_ready.go:38] duration metric: took 5m30.151131289s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0805 12:35:03.457158 3157290 api_server.go:52] waiting for apiserver process to appear ...
I0805 12:35:03.457196 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0805 12:35:03.457279 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0805 12:35:03.495609 3157290 cri.go:89] found id: "9d027ed91112d33dc082a5ea6f24f63f8af0a2ece264023d5a9c65c9045fb314"
I0805 12:35:03.495630 3157290 cri.go:89] found id: "c57b337ca22f3da57a9a16c10bab53bd21ba60b658216f543ec77c7c261d76d0"
I0805 12:35:03.495636 3157290 cri.go:89] found id: ""
I0805 12:35:03.495644 3157290 logs.go:276] 2 containers: [9d027ed91112d33dc082a5ea6f24f63f8af0a2ece264023d5a9c65c9045fb314 c57b337ca22f3da57a9a16c10bab53bd21ba60b658216f543ec77c7c261d76d0]
I0805 12:35:03.495725 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.500029 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.503821 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0805 12:35:03.503898 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0805 12:35:03.541801 3157290 cri.go:89] found id: "fc5593e0a311c4edb26ac47b996d6217f34a1b0217ceb94d9e21dd25e21e53a4"
I0805 12:35:03.541824 3157290 cri.go:89] found id: "cb79833ef66834cddc4c8aa73ebb5d899ac9bf1ca03e023bb8cc835970bd7a80"
I0805 12:35:03.541830 3157290 cri.go:89] found id: ""
I0805 12:35:03.541838 3157290 logs.go:276] 2 containers: [fc5593e0a311c4edb26ac47b996d6217f34a1b0217ceb94d9e21dd25e21e53a4 cb79833ef66834cddc4c8aa73ebb5d899ac9bf1ca03e023bb8cc835970bd7a80]
I0805 12:35:03.541895 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.545430 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.548868 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0805 12:35:03.548993 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0805 12:35:03.591653 3157290 cri.go:89] found id: "53ed5e9b18f6113ff814a6524c9d92af757e6842423a180676c1c82e954378a6"
I0805 12:35:03.591719 3157290 cri.go:89] found id: "d6fba388564c793c5389933336d0672c6073a88eaef246caace2ea874e623866"
I0805 12:35:03.591748 3157290 cri.go:89] found id: ""
I0805 12:35:03.591771 3157290 logs.go:276] 2 containers: [53ed5e9b18f6113ff814a6524c9d92af757e6842423a180676c1c82e954378a6 d6fba388564c793c5389933336d0672c6073a88eaef246caace2ea874e623866]
I0805 12:35:03.591853 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.595399 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.598948 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0805 12:35:03.599043 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0805 12:35:03.646743 3157290 cri.go:89] found id: "4e9e6aad998c20b415ab501ad4ebf77382e0735f38873fbccc09b8238df675e4"
I0805 12:35:03.646825 3157290 cri.go:89] found id: "b0f295274cc0dc24801c47922225033790a049a64a2da070072638a1a5783324"
I0805 12:35:03.646845 3157290 cri.go:89] found id: ""
I0805 12:35:03.646867 3157290 logs.go:276] 2 containers: [4e9e6aad998c20b415ab501ad4ebf77382e0735f38873fbccc09b8238df675e4 b0f295274cc0dc24801c47922225033790a049a64a2da070072638a1a5783324]
I0805 12:35:03.646961 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.650611 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.654254 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0805 12:35:03.654325 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0805 12:35:03.694026 3157290 cri.go:89] found id: "db3f6af771289732d5839bbcfb2bfaf22499949eeebfa4d8704c5ad09201ad7f"
I0805 12:35:03.694050 3157290 cri.go:89] found id: "7d92baabf40f37efdaf5f9a0ea099e97d5b9d67ab0c5057b0c2da9047637454b"
I0805 12:35:03.694056 3157290 cri.go:89] found id: ""
I0805 12:35:03.694063 3157290 logs.go:276] 2 containers: [db3f6af771289732d5839bbcfb2bfaf22499949eeebfa4d8704c5ad09201ad7f 7d92baabf40f37efdaf5f9a0ea099e97d5b9d67ab0c5057b0c2da9047637454b]
I0805 12:35:03.694118 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.697550 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.700830 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0805 12:35:03.700955 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0805 12:35:03.745197 3157290 cri.go:89] found id: "1520cc7f0130657302bb29ef6e58b4d1572d9cefc349039b32f44bc842874834"
I0805 12:35:03.745221 3157290 cri.go:89] found id: "ebe0210d2958f3fd3a26d3ca59083ac59c13e1ec92612ca8962604e2fde9e6f9"
I0805 12:35:03.745226 3157290 cri.go:89] found id: ""
I0805 12:35:03.745233 3157290 logs.go:276] 2 containers: [1520cc7f0130657302bb29ef6e58b4d1572d9cefc349039b32f44bc842874834 ebe0210d2958f3fd3a26d3ca59083ac59c13e1ec92612ca8962604e2fde9e6f9]
I0805 12:35:03.745308 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.748933 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.752442 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0805 12:35:03.752548 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0805 12:35:03.805088 3157290 cri.go:89] found id: "6abdebaafdd0f48350b41babf057972779046beacd70845b0894694eba1254f2"
I0805 12:35:03.805112 3157290 cri.go:89] found id: "3a48910e06110ae02c128be9c2e75b0359c0f6d5b1d8a5a3e228123d153ce298"
I0805 12:35:03.805118 3157290 cri.go:89] found id: ""
I0805 12:35:03.805126 3157290 logs.go:276] 2 containers: [6abdebaafdd0f48350b41babf057972779046beacd70845b0894694eba1254f2 3a48910e06110ae02c128be9c2e75b0359c0f6d5b1d8a5a3e228123d153ce298]
I0805 12:35:03.805215 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.809813 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.813319 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0805 12:35:03.813414 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0805 12:35:03.854479 3157290 cri.go:89] found id: "9256f116f633efac70a5c047632a53fe479bb5daa0f8c1c913b2d146080322b7"
I0805 12:35:03.854504 3157290 cri.go:89] found id: "a8b821ffe6b918edfd2170a30e9fcd75c26fa0825e5cb49a3ad44b5c0374ae0e"
I0805 12:35:03.854510 3157290 cri.go:89] found id: ""
I0805 12:35:03.854517 3157290 logs.go:276] 2 containers: [9256f116f633efac70a5c047632a53fe479bb5daa0f8c1c913b2d146080322b7 a8b821ffe6b918edfd2170a30e9fcd75c26fa0825e5cb49a3ad44b5c0374ae0e]
I0805 12:35:03.854610 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.858391 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.862021 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0805 12:35:03.862164 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0805 12:35:03.912533 3157290 cri.go:89] found id: "505644f5a96f3c69382ed44085987497e61cce3698d7ed213d9fef18b1de9a03"
I0805 12:35:03.912561 3157290 cri.go:89] found id: ""
I0805 12:35:03.912570 3157290 logs.go:276] 1 containers: [505644f5a96f3c69382ed44085987497e61cce3698d7ed213d9fef18b1de9a03]
I0805 12:35:03.912632 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.916151 3157290 logs.go:123] Gathering logs for kubelet ...
I0805 12:35:03.916176 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0805 12:35:03.975316 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:33 old-k8s-version-628218 kubelet[662]: E0805 12:29:33.210108 662 reflector.go:138] object-"kube-system"/"storage-provisioner-token-lrgb7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-lrgb7" is forbidden: User "system:node:old-k8s-version-628218" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-628218' and this object
W0805 12:35:03.975561 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:33 old-k8s-version-628218 kubelet[662]: E0805 12:29:33.210228 662 reflector.go:138] object-"kube-system"/"kube-proxy-token-qnks5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-qnks5" is forbidden: User "system:node:old-k8s-version-628218" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-628218' and this object
W0805 12:35:03.975779 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:33 old-k8s-version-628218 kubelet[662]: E0805 12:29:33.210293 662 reflector.go:138] object-"kube-system"/"kindnet-token-bt9x6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-bt9x6" is forbidden: User "system:node:old-k8s-version-628218" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-628218' and this object
W0805 12:35:03.975997 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:33 old-k8s-version-628218 kubelet[662]: E0805 12:29:33.210372 662 reflector.go:138] object-"kube-system"/"coredns-token-dnl82": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-dnl82" is forbidden: User "system:node:old-k8s-version-628218" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-628218' and this object
W0805 12:35:03.976205 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:33 old-k8s-version-628218 kubelet[662]: E0805 12:29:33.210437 662 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-628218" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-628218' and this object
W0805 12:35:03.976430 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:33 old-k8s-version-628218 kubelet[662]: E0805 12:29:33.210936 662 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-628218" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-628218' and this object
W0805 12:35:03.982780 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:34 old-k8s-version-628218 kubelet[662]: E0805 12:29:34.991530 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 12:35:03.982973 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:35 old-k8s-version-628218 kubelet[662]: E0805 12:29:35.595846 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:03.985818 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:47 old-k8s-version-628218 kubelet[662]: E0805 12:29:47.077645 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 12:35:03.987512 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:59 old-k8s-version-628218 kubelet[662]: E0805 12:29:59.054405 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:03.987985 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:00 old-k8s-version-628218 kubelet[662]: E0805 12:30:00.796689 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.988799 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:01 old-k8s-version-628218 kubelet[662]: E0805 12:30:01.807154 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.989133 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:04 old-k8s-version-628218 kubelet[662]: E0805 12:30:04.078679 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.989587 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:07 old-k8s-version-628218 kubelet[662]: E0805 12:30:07.837421 662 pod_workers.go:191] Error syncing pod 07b493c6-e53f-470c-87a3-7cb8aede6c6e ("storage-provisioner_kube-system(07b493c6-e53f-470c-87a3-7cb8aede6c6e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(07b493c6-e53f-470c-87a3-7cb8aede6c6e)"
W0805 12:35:03.992418 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:14 old-k8s-version-628218 kubelet[662]: E0805 12:30:14.060397 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 12:35:03.993046 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:16 old-k8s-version-628218 kubelet[662]: E0805 12:30:16.871687 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.993518 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:24 old-k8s-version-628218 kubelet[662]: E0805 12:30:24.078612 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.993706 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:25 old-k8s-version-628218 kubelet[662]: E0805 12:30:25.054058 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:03.994038 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:35 old-k8s-version-628218 kubelet[662]: E0805 12:30:35.058487 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.994225 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:36 old-k8s-version-628218 kubelet[662]: E0805 12:30:36.054476 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:03.994828 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:46 old-k8s-version-628218 kubelet[662]: E0805 12:30:46.947337 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.995020 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:50 old-k8s-version-628218 kubelet[662]: E0805 12:30:50.049700 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:03.995356 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:54 old-k8s-version-628218 kubelet[662]: E0805 12:30:54.079016 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.997874 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:01 old-k8s-version-628218 kubelet[662]: E0805 12:31:01.060228 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 12:35:03.998209 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:07 old-k8s-version-628218 kubelet[662]: E0805 12:31:07.049999 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.998397 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:13 old-k8s-version-628218 kubelet[662]: E0805 12:31:13.061032 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:03.998729 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:19 old-k8s-version-628218 kubelet[662]: E0805 12:31:19.049423 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.998917 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:24 old-k8s-version-628218 kubelet[662]: E0805 12:31:24.049838 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:03.999514 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:34 old-k8s-version-628218 kubelet[662]: E0805 12:31:34.137243 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.999700 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:39 old-k8s-version-628218 kubelet[662]: E0805 12:31:39.054072 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.000031 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:44 old-k8s-version-628218 kubelet[662]: E0805 12:31:44.078484 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.000218 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:51 old-k8s-version-628218 kubelet[662]: E0805 12:31:51.050363 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.000552 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:57 old-k8s-version-628218 kubelet[662]: E0805 12:31:57.053538 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.000740 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:02 old-k8s-version-628218 kubelet[662]: E0805 12:32:02.049734 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.001073 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:08 old-k8s-version-628218 kubelet[662]: E0805 12:32:08.049902 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.001259 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:15 old-k8s-version-628218 kubelet[662]: E0805 12:32:15.050679 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.001656 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:19 old-k8s-version-628218 kubelet[662]: E0805 12:32:19.050105 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.004132 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:26 old-k8s-version-628218 kubelet[662]: E0805 12:32:26.057893 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 12:35:04.004468 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:32 old-k8s-version-628218 kubelet[662]: E0805 12:32:32.049403 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.004651 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:41 old-k8s-version-628218 kubelet[662]: E0805 12:32:41.050575 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.004981 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:44 old-k8s-version-628218 kubelet[662]: E0805 12:32:44.049984 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.005163 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:53 old-k8s-version-628218 kubelet[662]: E0805 12:32:53.050229 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.005773 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:57 old-k8s-version-628218 kubelet[662]: E0805 12:32:57.356327 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.005963 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:04 old-k8s-version-628218 kubelet[662]: E0805 12:33:04.050147 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.006303 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:04 old-k8s-version-628218 kubelet[662]: E0805 12:33:04.078938 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.006641 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:16 old-k8s-version-628218 kubelet[662]: E0805 12:33:16.049972 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.006830 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:17 old-k8s-version-628218 kubelet[662]: E0805 12:33:17.050046 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.007163 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:27 old-k8s-version-628218 kubelet[662]: E0805 12:33:27.051058 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.007346 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:32 old-k8s-version-628218 kubelet[662]: E0805 12:33:32.049949 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.007683 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:39 old-k8s-version-628218 kubelet[662]: E0805 12:33:39.051084 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.007866 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:45 old-k8s-version-628218 kubelet[662]: E0805 12:33:45.053788 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.008199 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:54 old-k8s-version-628218 kubelet[662]: E0805 12:33:54.049443 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.008386 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:58 old-k8s-version-628218 kubelet[662]: E0805 12:33:58.049767 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.008715 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:09 old-k8s-version-628218 kubelet[662]: E0805 12:34:09.050774 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.008900 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:12 old-k8s-version-628218 kubelet[662]: E0805 12:34:12.050180 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.009229 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:20 old-k8s-version-628218 kubelet[662]: E0805 12:34:20.049373 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.009411 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:27 old-k8s-version-628218 kubelet[662]: E0805 12:34:27.049948 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.009808 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:33 old-k8s-version-628218 kubelet[662]: E0805 12:34:33.050830 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.010005 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:39 old-k8s-version-628218 kubelet[662]: E0805 12:34:39.050798 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.010346 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:47 old-k8s-version-628218 kubelet[662]: E0805 12:34:47.050116 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.010534 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:52 old-k8s-version-628218 kubelet[662]: E0805 12:34:52.049768 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.010869 3157290 logs.go:138] Found kubelet problem: Aug 05 12:35:02 old-k8s-version-628218 kubelet[662]: E0805 12:35:02.049419 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
I0805 12:35:04.010884 3157290 logs.go:123] Gathering logs for describe nodes ...
I0805 12:35:04.010900 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0805 12:35:04.195597 3157290 logs.go:123] Gathering logs for coredns [53ed5e9b18f6113ff814a6524c9d92af757e6842423a180676c1c82e954378a6] ...
I0805 12:35:04.195629 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 53ed5e9b18f6113ff814a6524c9d92af757e6842423a180676c1c82e954378a6"
I0805 12:35:04.238577 3157290 logs.go:123] Gathering logs for kindnet [6abdebaafdd0f48350b41babf057972779046beacd70845b0894694eba1254f2] ...
I0805 12:35:04.238606 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6abdebaafdd0f48350b41babf057972779046beacd70845b0894694eba1254f2"
I0805 12:35:04.306491 3157290 logs.go:123] Gathering logs for container status ...
I0805 12:35:04.306526 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0805 12:35:04.356627 3157290 logs.go:123] Gathering logs for etcd [fc5593e0a311c4edb26ac47b996d6217f34a1b0217ceb94d9e21dd25e21e53a4] ...
I0805 12:35:04.356658 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fc5593e0a311c4edb26ac47b996d6217f34a1b0217ceb94d9e21dd25e21e53a4"
I0805 12:35:04.401044 3157290 logs.go:123] Gathering logs for coredns [d6fba388564c793c5389933336d0672c6073a88eaef246caace2ea874e623866] ...
I0805 12:35:04.401074 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d6fba388564c793c5389933336d0672c6073a88eaef246caace2ea874e623866"
I0805 12:35:04.440190 3157290 logs.go:123] Gathering logs for kube-scheduler [4e9e6aad998c20b415ab501ad4ebf77382e0735f38873fbccc09b8238df675e4] ...
I0805 12:35:04.440218 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4e9e6aad998c20b415ab501ad4ebf77382e0735f38873fbccc09b8238df675e4"
I0805 12:35:04.484017 3157290 logs.go:123] Gathering logs for containerd ...
I0805 12:35:04.484047 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0805 12:35:04.544561 3157290 logs.go:123] Gathering logs for dmesg ...
I0805 12:35:04.544603 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0805 12:35:04.566729 3157290 logs.go:123] Gathering logs for kube-apiserver [c57b337ca22f3da57a9a16c10bab53bd21ba60b658216f543ec77c7c261d76d0] ...
I0805 12:35:04.566830 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c57b337ca22f3da57a9a16c10bab53bd21ba60b658216f543ec77c7c261d76d0"
I0805 12:35:04.630910 3157290 logs.go:123] Gathering logs for kube-scheduler [b0f295274cc0dc24801c47922225033790a049a64a2da070072638a1a5783324] ...
I0805 12:35:04.630946 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b0f295274cc0dc24801c47922225033790a049a64a2da070072638a1a5783324"
I0805 12:35:04.692936 3157290 logs.go:123] Gathering logs for kube-proxy [db3f6af771289732d5839bbcfb2bfaf22499949eeebfa4d8704c5ad09201ad7f] ...
I0805 12:35:04.693005 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db3f6af771289732d5839bbcfb2bfaf22499949eeebfa4d8704c5ad09201ad7f"
I0805 12:35:04.736820 3157290 logs.go:123] Gathering logs for kube-controller-manager [ebe0210d2958f3fd3a26d3ca59083ac59c13e1ec92612ca8962604e2fde9e6f9] ...
I0805 12:35:04.736855 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ebe0210d2958f3fd3a26d3ca59083ac59c13e1ec92612ca8962604e2fde9e6f9"
I0805 12:35:04.797140 3157290 logs.go:123] Gathering logs for kindnet [3a48910e06110ae02c128be9c2e75b0359c0f6d5b1d8a5a3e228123d153ce298] ...
I0805 12:35:04.797187 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3a48910e06110ae02c128be9c2e75b0359c0f6d5b1d8a5a3e228123d153ce298"
I0805 12:35:04.851364 3157290 logs.go:123] Gathering logs for storage-provisioner [9256f116f633efac70a5c047632a53fe479bb5daa0f8c1c913b2d146080322b7] ...
I0805 12:35:04.851398 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9256f116f633efac70a5c047632a53fe479bb5daa0f8c1c913b2d146080322b7"
I0805 12:35:04.890074 3157290 logs.go:123] Gathering logs for storage-provisioner [a8b821ffe6b918edfd2170a30e9fcd75c26fa0825e5cb49a3ad44b5c0374ae0e] ...
I0805 12:35:04.890103 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a8b821ffe6b918edfd2170a30e9fcd75c26fa0825e5cb49a3ad44b5c0374ae0e"
I0805 12:35:04.927061 3157290 logs.go:123] Gathering logs for kube-apiserver [9d027ed91112d33dc082a5ea6f24f63f8af0a2ece264023d5a9c65c9045fb314] ...
I0805 12:35:04.927093 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9d027ed91112d33dc082a5ea6f24f63f8af0a2ece264023d5a9c65c9045fb314"
I0805 12:35:04.986598 3157290 logs.go:123] Gathering logs for etcd [cb79833ef66834cddc4c8aa73ebb5d899ac9bf1ca03e023bb8cc835970bd7a80] ...
I0805 12:35:04.986635 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cb79833ef66834cddc4c8aa73ebb5d899ac9bf1ca03e023bb8cc835970bd7a80"
I0805 12:35:05.029759 3157290 logs.go:123] Gathering logs for kube-proxy [7d92baabf40f37efdaf5f9a0ea099e97d5b9d67ab0c5057b0c2da9047637454b] ...
I0805 12:35:05.029835 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7d92baabf40f37efdaf5f9a0ea099e97d5b9d67ab0c5057b0c2da9047637454b"
I0805 12:35:05.080513 3157290 logs.go:123] Gathering logs for kube-controller-manager [1520cc7f0130657302bb29ef6e58b4d1572d9cefc349039b32f44bc842874834] ...
I0805 12:35:05.080544 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1520cc7f0130657302bb29ef6e58b4d1572d9cefc349039b32f44bc842874834"
I0805 12:35:05.149737 3157290 logs.go:123] Gathering logs for kubernetes-dashboard [505644f5a96f3c69382ed44085987497e61cce3698d7ed213d9fef18b1de9a03] ...
I0805 12:35:05.149777 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 505644f5a96f3c69382ed44085987497e61cce3698d7ed213d9fef18b1de9a03"
I0805 12:35:05.193953 3157290 out.go:304] Setting ErrFile to fd 2...
I0805 12:35:05.193980 3157290 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0805 12:35:05.194073 3157290 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0805 12:35:05.194099 3157290 out.go:239] Aug 05 12:34:33 old-k8s-version-628218 kubelet[662]: E0805 12:34:33.050830 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
Aug 05 12:34:33 old-k8s-version-628218 kubelet[662]: E0805 12:34:33.050830 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:05.194112 3157290 out.go:239] Aug 05 12:34:39 old-k8s-version-628218 kubelet[662]: E0805 12:34:39.050798 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 12:34:39 old-k8s-version-628218 kubelet[662]: E0805 12:34:39.050798 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:05.194120 3157290 out.go:239] Aug 05 12:34:47 old-k8s-version-628218 kubelet[662]: E0805 12:34:47.050116 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
Aug 05 12:34:47 old-k8s-version-628218 kubelet[662]: E0805 12:34:47.050116 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:05.194126 3157290 out.go:239] Aug 05 12:34:52 old-k8s-version-628218 kubelet[662]: E0805 12:34:52.049768 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 12:34:52 old-k8s-version-628218 kubelet[662]: E0805 12:34:52.049768 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:05.194134 3157290 out.go:239] Aug 05 12:35:02 old-k8s-version-628218 kubelet[662]: E0805 12:35:02.049419 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
Aug 05 12:35:02 old-k8s-version-628218 kubelet[662]: E0805 12:35:02.049419 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
I0805 12:35:05.194146 3157290 out.go:304] Setting ErrFile to fd 2...
I0805 12:35:05.194152 3157290 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 12:35:15.195940 3157290 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0805 12:35:15.208704 3157290 api_server.go:72] duration metric: took 6m2.069896441s to wait for apiserver process to appear ...
I0805 12:35:15.208731 3157290 api_server.go:88] waiting for apiserver healthz status ...
I0805 12:35:15.211080 3157290 out.go:177]
W0805 12:35:15.213018 3157290 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W0805 12:35:15.213037 3157290 out.go:239] *
*
W0805 12:35:15.214064 3157290 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0805 12:35:15.216704 3157290 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-628218 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-628218
helpers_test.go:235: (dbg) docker inspect old-k8s-version-628218:
-- stdout --
[
{
"Id": "c2d4d36e9a0e1465f1cff4d5ae8dd8518d16b7d4e47c19020e78f2d4cbf0bb99",
"Created": "2024-08-05T12:26:35.866767442Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 3157499,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-08-05T12:29:05.086386167Z",
"FinishedAt": "2024-08-05T12:29:03.968256485Z"
},
"Image": "sha256:2cd84ab2172023a68162f38a55db46353562cea41552fd8e8bdec97b31b2c495",
"ResolvConfPath": "/var/lib/docker/containers/c2d4d36e9a0e1465f1cff4d5ae8dd8518d16b7d4e47c19020e78f2d4cbf0bb99/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/c2d4d36e9a0e1465f1cff4d5ae8dd8518d16b7d4e47c19020e78f2d4cbf0bb99/hostname",
"HostsPath": "/var/lib/docker/containers/c2d4d36e9a0e1465f1cff4d5ae8dd8518d16b7d4e47c19020e78f2d4cbf0bb99/hosts",
"LogPath": "/var/lib/docker/containers/c2d4d36e9a0e1465f1cff4d5ae8dd8518d16b7d4e47c19020e78f2d4cbf0bb99/c2d4d36e9a0e1465f1cff4d5ae8dd8518d16b7d4e47c19020e78f2d4cbf0bb99-json.log",
"Name": "/old-k8s-version-628218",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-628218:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-628218",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/2e29ee78f8e950e016aa5a5ed7469d3cd5e557fa1a962bd70b23405c9f1410c6-init/diff:/var/lib/docker/overlay2/3f4c5618bde614aab1765bba0c90e8349fc7e1337cca91394c48d78116bc843b/diff",
"MergedDir": "/var/lib/docker/overlay2/2e29ee78f8e950e016aa5a5ed7469d3cd5e557fa1a962bd70b23405c9f1410c6/merged",
"UpperDir": "/var/lib/docker/overlay2/2e29ee78f8e950e016aa5a5ed7469d3cd5e557fa1a962bd70b23405c9f1410c6/diff",
"WorkDir": "/var/lib/docker/overlay2/2e29ee78f8e950e016aa5a5ed7469d3cd5e557fa1a962bd70b23405c9f1410c6/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-628218",
"Source": "/var/lib/docker/volumes/old-k8s-version-628218/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-628218",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-628218",
"name.minikube.sigs.k8s.io": "old-k8s-version-628218",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "433c681a8eec3ed4193a3427a5b7f16ffbad1e50f0a6e62d1fee5050734faec3",
"SandboxKey": "/var/run/docker/netns/433c681a8eec",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "36771"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "36772"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "36775"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "36773"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "36774"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-628218": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:55:02",
"DriverOpts": null,
"NetworkID": "2d89d3f5c761f6e7aa3cc5ae6c2497e67c6013def07bb4bf55c7b8f229360d0d",
"EndpointID": "53e6e89cd0d16cc5497db8003549a451177f050e657fc7cc9b996040567e43dd",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-628218",
"c2d4d36e9a0e"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-628218 -n old-k8s-version-628218
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-628218 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-628218 logs -n 25: (2.202457428s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| ssh | -p cilium-280303 sudo find | cilium-280303 | jenkins | v1.33.1 | 05 Aug 24 12:25 UTC | |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p cilium-280303 sudo crio | cilium-280303 | jenkins | v1.33.1 | 05 Aug 24 12:25 UTC | |
| | config | | | | | |
| delete | -p cilium-280303 | cilium-280303 | jenkins | v1.33.1 | 05 Aug 24 12:25 UTC | 05 Aug 24 12:25 UTC |
| start | -p force-systemd-env-740183 | force-systemd-env-740183 | jenkins | v1.33.1 | 05 Aug 24 12:25 UTC | 05 Aug 24 12:25 UTC |
| | --memory=2048 | | | | | |
| | --alsologtostderr | | | | | |
| | -v=5 --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-flag-565091 | force-systemd-flag-565091 | jenkins | v1.33.1 | 05 Aug 24 12:25 UTC | 05 Aug 24 12:25 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-flag-565091 | force-systemd-flag-565091 | jenkins | v1.33.1 | 05 Aug 24 12:25 UTC | 05 Aug 24 12:25 UTC |
| start | -p cert-expiration-110025 | cert-expiration-110025 | jenkins | v1.33.1 | 05 Aug 24 12:25 UTC | 05 Aug 24 12:26 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-740183 | force-systemd-env-740183 | jenkins | v1.33.1 | 05 Aug 24 12:25 UTC | 05 Aug 24 12:25 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-740183 | force-systemd-env-740183 | jenkins | v1.33.1 | 05 Aug 24 12:25 UTC | 05 Aug 24 12:25 UTC |
| start | -p cert-options-385811 | cert-options-385811 | jenkins | v1.33.1 | 05 Aug 24 12:25 UTC | 05 Aug 24 12:26 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-385811 ssh | cert-options-385811 | jenkins | v1.33.1 | 05 Aug 24 12:26 UTC | 05 Aug 24 12:26 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-385811 -- sudo | cert-options-385811 | jenkins | v1.33.1 | 05 Aug 24 12:26 UTC | 05 Aug 24 12:26 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-385811 | cert-options-385811 | jenkins | v1.33.1 | 05 Aug 24 12:26 UTC | 05 Aug 24 12:26 UTC |
| start | -p old-k8s-version-628218 | old-k8s-version-628218 | jenkins | v1.33.1 | 05 Aug 24 12:26 UTC | 05 Aug 24 12:28 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-628218 | old-k8s-version-628218 | jenkins | v1.33.1 | 05 Aug 24 12:28 UTC | 05 Aug 24 12:28 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-628218 | old-k8s-version-628218 | jenkins | v1.33.1 | 05 Aug 24 12:28 UTC | 05 Aug 24 12:29 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-628218 | old-k8s-version-628218 | jenkins | v1.33.1 | 05 Aug 24 12:29 UTC | 05 Aug 24 12:29 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-628218 | old-k8s-version-628218 | jenkins | v1.33.1 | 05 Aug 24 12:29 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-110025 | cert-expiration-110025 | jenkins | v1.33.1 | 05 Aug 24 12:29 UTC | 05 Aug 24 12:29 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-110025 | cert-expiration-110025 | jenkins | v1.33.1 | 05 Aug 24 12:29 UTC | 05 Aug 24 12:29 UTC |
| start | -p no-preload-304283 | no-preload-304283 | jenkins | v1.33.1 | 05 Aug 24 12:29 UTC | 05 Aug 24 12:30 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0-rc.0 | | | | | |
| addons | enable metrics-server -p no-preload-304283 | no-preload-304283 | jenkins | v1.33.1 | 05 Aug 24 12:30 UTC | 05 Aug 24 12:30 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-304283 | no-preload-304283 | jenkins | v1.33.1 | 05 Aug 24 12:30 UTC | 05 Aug 24 12:31 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-304283 | no-preload-304283 | jenkins | v1.33.1 | 05 Aug 24 12:31 UTC | 05 Aug 24 12:31 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-304283 | no-preload-304283 | jenkins | v1.33.1 | 05 Aug 24 12:31 UTC | |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0-rc.0 | | | | | |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/08/05 12:31:02
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0805 12:31:02.979012 3165870 out.go:291] Setting OutFile to fd 1 ...
I0805 12:31:02.979140 3165870 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 12:31:02.979150 3165870 out.go:304] Setting ErrFile to fd 2...
I0805 12:31:02.979155 3165870 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 12:31:02.979392 3165870 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19378-2947781/.minikube/bin
I0805 12:31:02.979759 3165870 out.go:298] Setting JSON to false
I0805 12:31:02.981312 3165870 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":72813,"bootTime":1722788250,"procs":225,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0805 12:31:02.981401 3165870 start.go:139] virtualization:
I0805 12:31:02.985294 3165870 out.go:177] * [no-preload-304283] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0805 12:31:02.986860 3165870 out.go:177] - MINIKUBE_LOCATION=19378
I0805 12:31:02.986941 3165870 notify.go:220] Checking for updates...
I0805 12:31:02.990504 3165870 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0805 12:31:02.992267 3165870 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19378-2947781/kubeconfig
I0805 12:31:02.994125 3165870 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19378-2947781/.minikube
I0805 12:31:02.996050 3165870 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0805 12:31:02.998144 3165870 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0805 12:31:03.000539 3165870 config.go:182] Loaded profile config "no-preload-304283": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0-rc.0
I0805 12:31:03.001086 3165870 driver.go:392] Setting default libvirt URI to qemu:///system
I0805 12:31:03.026364 3165870 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0805 12:31:03.026487 3165870 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0805 12:31:03.117808 3165870 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:44 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-05 12:31:03.107524222 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0805 12:31:03.117929 3165870 docker.go:307] overlay module found
I0805 12:31:03.120584 3165870 out.go:177] * Using the docker driver based on existing profile
I0805 12:31:03.123049 3165870 start.go:297] selected driver: docker
I0805 12:31:03.123082 3165870 start.go:901] validating driver "docker" against &{Name:no-preload-304283 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-rc.0 ClusterName:no-preload-304283 Namespace:default APIServerHAVIP: APISer
verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.0-rc.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:f
alse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0805 12:31:03.123206 3165870 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0805 12:31:03.123968 3165870 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0805 12:31:03.174697 3165870 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:44 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-05 12:31:03.164928032 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0805 12:31:03.175123 3165870 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0805 12:31:03.175153 3165870 cni.go:84] Creating CNI manager for ""
I0805 12:31:03.175163 3165870 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0805 12:31:03.175223 3165870 start.go:340] cluster config:
{Name:no-preload-304283 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-rc.0 ClusterName:no-preload-304283 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con
tainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.0-rc.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:d
ocker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0805 12:31:03.177827 3165870 out.go:177] * Starting "no-preload-304283" primary control-plane node in "no-preload-304283" cluster
I0805 12:31:03.180302 3165870 cache.go:121] Beginning downloading kic base image for docker with containerd
I0805 12:31:03.182400 3165870 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0805 12:31:03.184969 3165870 preload.go:131] Checking if preload exists for k8s version v1.31.0-rc.0 and runtime containerd
I0805 12:31:03.185049 3165870 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
I0805 12:31:03.185129 3165870 profile.go:143] Saving config to /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/no-preload-304283/config.json ...
I0805 12:31:03.185552 3165870 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm.sha256
W0805 12:31:03.226384 3165870 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
I0805 12:31:03.226406 3165870 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0805 12:31:03.226477 3165870 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0805 12:31:03.226494 3165870 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0805 12:31:03.226499 3165870 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0805 12:31:03.226515 3165870 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0805 12:31:03.226530 3165870 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0805 12:31:03.380153 3165870 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm.sha256
I0805 12:31:03.382836 3165870 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0805 12:31:03.382886 3165870 cache.go:194] Successfully downloaded all kic artifacts
I0805 12:31:03.382920 3165870 start.go:360] acquireMachinesLock for no-preload-304283: {Name:mkecd1852427585d60ebf1c3d136a08495488c46 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0805 12:31:03.382988 3165870 start.go:364] duration metric: took 46.072µs to acquireMachinesLock for "no-preload-304283"
I0805 12:31:03.383024 3165870 start.go:96] Skipping create...Using existing machine configuration
I0805 12:31:03.383030 3165870 fix.go:54] fixHost starting:
I0805 12:31:03.383306 3165870 cli_runner.go:164] Run: docker container inspect no-preload-304283 --format={{.State.Status}}
I0805 12:31:03.402485 3165870 fix.go:112] recreateIfNeeded on no-preload-304283: state=Stopped err=<nil>
W0805 12:31:03.402516 3165870 fix.go:138] unexpected machine state, will restart: <nil>
I0805 12:31:03.405773 3165870 out.go:177] * Restarting existing docker container for "no-preload-304283" ...
I0805 12:31:01.440953 3157290 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:03.450109 3157290 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace has status "Ready":"True"
I0805 12:31:03.450268 3157290 pod_ready.go:81] duration metric: took 23.015625666s for pod "kube-scheduler-old-k8s-version-628218" in "kube-system" namespace to be "Ready" ...
I0805 12:31:03.450329 3157290 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace to be "Ready" ...
I0805 12:31:03.408388 3165870 cli_runner.go:164] Run: docker start no-preload-304283
I0805 12:31:03.601311 3165870 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm.sha256
I0805 12:31:03.792126 3165870 cache.go:107] acquiring lock: {Name:mk8fefac08397ea1ad372a3d66e1aedbaebef0ca Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0805 12:31:03.792232 3165870 cache.go:115] /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I0805 12:31:03.792247 3165870 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 134.523µs
I0805 12:31:03.792256 3165870 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I0805 12:31:03.792270 3165870 cache.go:107] acquiring lock: {Name:mkdd2cb1ff7a5f8c84d5dbf1a87caeb17e62b78a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0805 12:31:03.792311 3165870 cache.go:115] /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-rc.0 exists
I0805 12:31:03.792321 3165870 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.0-rc.0" -> "/home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-rc.0" took 52.882µs
I0805 12:31:03.792336 3165870 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.0-rc.0 -> /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-rc.0 succeeded
I0805 12:31:03.792352 3165870 cache.go:107] acquiring lock: {Name:mk327e788e9320cf5063e01b99a10c5d48d9c0ea Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0805 12:31:03.792385 3165870 cache.go:115] /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-rc.0 exists
I0805 12:31:03.792402 3165870 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.0-rc.0" -> "/home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-rc.0" took 50.79µs
I0805 12:31:03.792409 3165870 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.0-rc.0 -> /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-rc.0 succeeded
I0805 12:31:03.792425 3165870 cache.go:107] acquiring lock: {Name:mkd0dace9fa328238d6a527e97c47f78b77b3757 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0805 12:31:03.792456 3165870 cache.go:115] /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-rc.0 exists
I0805 12:31:03.792467 3165870 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.0-rc.0" -> "/home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-rc.0" took 43.43µs
I0805 12:31:03.792473 3165870 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.0-rc.0 -> /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-rc.0 succeeded
I0805 12:31:03.792483 3165870 cache.go:107] acquiring lock: {Name:mk2f9b7652a902a5d1cc42477f804ab50b07bfad Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0805 12:31:03.792532 3165870 cache.go:115] /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-rc.0 exists
I0805 12:31:03.792538 3165870 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.0-rc.0" -> "/home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-rc.0" took 56.304µs
I0805 12:31:03.792548 3165870 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.0-rc.0 -> /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-rc.0 succeeded
I0805 12:31:03.792557 3165870 cache.go:107] acquiring lock: {Name:mkb7894c740d270ade71517baca5c9003df0648a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0805 12:31:03.792592 3165870 cache.go:115] /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
I0805 12:31:03.792602 3165870 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 46.268µs
I0805 12:31:03.792608 3165870 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
I0805 12:31:03.792618 3165870 cache.go:107] acquiring lock: {Name:mkd245ed5f966f60b748f79abd5ac36fb0024da8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0805 12:31:03.792648 3165870 cache.go:115] /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 exists
I0805 12:31:03.792658 3165870 cache.go:96] cache image "registry.k8s.io/etcd:3.5.15-0" -> "/home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0" took 41.591µs
I0805 12:31:03.792665 3165870 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.15-0 -> /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 succeeded
I0805 12:31:03.792676 3165870 cache.go:107] acquiring lock: {Name:mkce292be894504b85eaba96813f780bbb2eb198 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0805 12:31:03.792704 3165870 cache.go:115] /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
I0805 12:31:03.792713 3165870 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 37.702µs
I0805 12:31:03.792722 3165870 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /home/jenkins/minikube-integration/19378-2947781/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
I0805 12:31:03.792728 3165870 cache.go:87] Successfully saved all images to host disk.
I0805 12:31:03.828061 3165870 cli_runner.go:164] Run: docker container inspect no-preload-304283 --format={{.State.Status}}
I0805 12:31:03.858156 3165870 kic.go:430] container "no-preload-304283" state is running.
I0805 12:31:03.858848 3165870 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-304283
I0805 12:31:03.882554 3165870 profile.go:143] Saving config to /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/no-preload-304283/config.json ...
I0805 12:31:03.883195 3165870 machine.go:94] provisionDockerMachine start ...
I0805 12:31:03.883317 3165870 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-304283
I0805 12:31:03.912935 3165870 main.go:141] libmachine: Using SSH client type: native
I0805 12:31:03.913211 3165870 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 36781 <nil> <nil>}
I0805 12:31:03.913313 3165870 main.go:141] libmachine: About to run SSH command:
hostname
I0805 12:31:03.914410 3165870 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0805 12:31:07.058156 3165870 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-304283
I0805 12:31:07.058184 3165870 ubuntu.go:169] provisioning hostname "no-preload-304283"
I0805 12:31:07.058271 3165870 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-304283
I0805 12:31:07.079823 3165870 main.go:141] libmachine: Using SSH client type: native
I0805 12:31:07.080160 3165870 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 36781 <nil> <nil>}
I0805 12:31:07.080182 3165870 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-304283 && echo "no-preload-304283" | sudo tee /etc/hostname
I0805 12:31:07.226595 3165870 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-304283
I0805 12:31:07.226675 3165870 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-304283
I0805 12:31:07.249288 3165870 main.go:141] libmachine: Using SSH client type: native
I0805 12:31:07.249610 3165870 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 36781 <nil> <nil>}
I0805 12:31:07.249635 3165870 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-304283' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-304283/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-304283' | sudo tee -a /etc/hosts;
fi
fi
I0805 12:31:07.389675 3165870 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0805 12:31:07.389704 3165870 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19378-2947781/.minikube CaCertPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19378-2947781/.minikube}
I0805 12:31:07.389727 3165870 ubuntu.go:177] setting up certificates
I0805 12:31:07.389737 3165870 provision.go:84] configureAuth start
I0805 12:31:07.389796 3165870 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-304283
I0805 12:31:07.406473 3165870 provision.go:143] copyHostCerts
I0805 12:31:07.406545 3165870 exec_runner.go:144] found /home/jenkins/minikube-integration/19378-2947781/.minikube/key.pem, removing ...
I0805 12:31:07.406560 3165870 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19378-2947781/.minikube/key.pem
I0805 12:31:07.406640 3165870 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19378-2947781/.minikube/key.pem (1675 bytes)
I0805 12:31:07.406756 3165870 exec_runner.go:144] found /home/jenkins/minikube-integration/19378-2947781/.minikube/ca.pem, removing ...
I0805 12:31:07.406769 3165870 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19378-2947781/.minikube/ca.pem
I0805 12:31:07.406800 3165870 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19378-2947781/.minikube/ca.pem (1078 bytes)
I0805 12:31:07.406922 3165870 exec_runner.go:144] found /home/jenkins/minikube-integration/19378-2947781/.minikube/cert.pem, removing ...
I0805 12:31:07.406938 3165870 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19378-2947781/.minikube/cert.pem
I0805 12:31:07.406975 3165870 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19378-2947781/.minikube/cert.pem (1123 bytes)
I0805 12:31:07.407045 3165870 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca-key.pem org=jenkins.no-preload-304283 san=[127.0.0.1 192.168.76.2 localhost minikube no-preload-304283]
I0805 12:31:07.936735 3165870 provision.go:177] copyRemoteCerts
I0805 12:31:07.936851 3165870 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0805 12:31:07.936912 3165870 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-304283
I0805 12:31:07.954645 3165870 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36781 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/no-preload-304283/id_rsa Username:docker}
I0805 12:31:05.462479 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:07.972586 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:08.054733 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0805 12:31:08.080876 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0805 12:31:08.106624 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0805 12:31:08.134291 3165870 provision.go:87] duration metric: took 744.538624ms to configureAuth
I0805 12:31:08.134320 3165870 ubuntu.go:193] setting minikube options for container-runtime
I0805 12:31:08.134506 3165870 config.go:182] Loaded profile config "no-preload-304283": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0-rc.0
I0805 12:31:08.134521 3165870 machine.go:97] duration metric: took 4.25131263s to provisionDockerMachine
I0805 12:31:08.134529 3165870 start.go:293] postStartSetup for "no-preload-304283" (driver="docker")
I0805 12:31:08.134541 3165870 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0805 12:31:08.134601 3165870 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0805 12:31:08.134657 3165870 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-304283
I0805 12:31:08.150923 3165870 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36781 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/no-preload-304283/id_rsa Username:docker}
I0805 12:31:08.246569 3165870 ssh_runner.go:195] Run: cat /etc/os-release
I0805 12:31:08.249477 3165870 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0805 12:31:08.249517 3165870 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0805 12:31:08.249527 3165870 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0805 12:31:08.249535 3165870 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0805 12:31:08.249546 3165870 filesync.go:126] Scanning /home/jenkins/minikube-integration/19378-2947781/.minikube/addons for local assets ...
I0805 12:31:08.249602 3165870 filesync.go:126] Scanning /home/jenkins/minikube-integration/19378-2947781/.minikube/files for local assets ...
I0805 12:31:08.249697 3165870 filesync.go:149] local asset: /home/jenkins/minikube-integration/19378-2947781/.minikube/files/etc/ssl/certs/29531682.pem -> 29531682.pem in /etc/ssl/certs
I0805 12:31:08.249803 3165870 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0805 12:31:08.258283 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/files/etc/ssl/certs/29531682.pem --> /etc/ssl/certs/29531682.pem (1708 bytes)
I0805 12:31:08.282407 3165870 start.go:296] duration metric: took 147.862075ms for postStartSetup
I0805 12:31:08.282514 3165870 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0805 12:31:08.282569 3165870 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-304283
I0805 12:31:08.298422 3165870 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36781 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/no-preload-304283/id_rsa Username:docker}
I0805 12:31:08.390244 3165870 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0805 12:31:08.395464 3165870 fix.go:56] duration metric: took 5.012425398s for fixHost
I0805 12:31:08.395489 3165870 start.go:83] releasing machines lock for "no-preload-304283", held for 5.012477853s
I0805 12:31:08.395562 3165870 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-304283
I0805 12:31:08.411835 3165870 ssh_runner.go:195] Run: cat /version.json
I0805 12:31:08.411888 3165870 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-304283
I0805 12:31:08.412149 3165870 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0805 12:31:08.412209 3165870 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-304283
I0805 12:31:08.430375 3165870 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36781 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/no-preload-304283/id_rsa Username:docker}
I0805 12:31:08.432026 3165870 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36781 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/no-preload-304283/id_rsa Username:docker}
I0805 12:31:08.658878 3165870 ssh_runner.go:195] Run: systemctl --version
I0805 12:31:08.663983 3165870 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0805 12:31:08.668181 3165870 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0805 12:31:08.686315 3165870 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0805 12:31:08.686437 3165870 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0805 12:31:08.696045 3165870 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0805 12:31:08.696070 3165870 start.go:495] detecting cgroup driver to use...
I0805 12:31:08.696133 3165870 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0805 12:31:08.696218 3165870 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0805 12:31:08.709839 3165870 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0805 12:31:08.721500 3165870 docker.go:217] disabling cri-docker service (if available) ...
I0805 12:31:08.721611 3165870 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0805 12:31:08.735039 3165870 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0805 12:31:08.747219 3165870 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0805 12:31:08.847354 3165870 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0805 12:31:08.932100 3165870 docker.go:233] disabling docker service ...
I0805 12:31:08.932170 3165870 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0805 12:31:08.952076 3165870 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0805 12:31:08.967523 3165870 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0805 12:31:09.074306 3165870 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0805 12:31:09.170354 3165870 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0805 12:31:09.184000 3165870 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0805 12:31:09.202650 3165870 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm.sha256
I0805 12:31:09.356761 3165870 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0805 12:31:09.370754 3165870 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0805 12:31:09.382003 3165870 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0805 12:31:09.382075 3165870 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0805 12:31:09.391864 3165870 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0805 12:31:09.402109 3165870 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0805 12:31:09.412926 3165870 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0805 12:31:09.423316 3165870 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0805 12:31:09.435292 3165870 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0805 12:31:09.445977 3165870 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0805 12:31:09.460838 3165870 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0805 12:31:09.471824 3165870 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0805 12:31:09.482032 3165870 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0805 12:31:09.491182 3165870 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0805 12:31:09.571408 3165870 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0805 12:31:09.702701 3165870 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0805 12:31:09.702776 3165870 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0805 12:31:09.707069 3165870 start.go:563] Will wait 60s for crictl version
I0805 12:31:09.707187 3165870 ssh_runner.go:195] Run: which crictl
I0805 12:31:09.711142 3165870 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0805 12:31:09.760545 3165870 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.19
RuntimeApiVersion: v1
I0805 12:31:09.760668 3165870 ssh_runner.go:195] Run: containerd --version
I0805 12:31:09.788741 3165870 ssh_runner.go:195] Run: containerd --version
I0805 12:31:09.818550 3165870 out.go:177] * Preparing Kubernetes v1.31.0-rc.0 on containerd 1.7.19 ...
I0805 12:31:09.820442 3165870 cli_runner.go:164] Run: docker network inspect no-preload-304283 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0805 12:31:09.836271 3165870 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0805 12:31:09.839943 3165870 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0805 12:31:09.851104 3165870 kubeadm.go:883] updating cluster {Name:no-preload-304283 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-rc.0 ClusterName:no-preload-304283 Namespace:default APIServerHAVIP: APIServerName:minikubeC
A APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.0-rc.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:
/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0805 12:31:09.851289 3165870 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm.sha256
I0805 12:31:10.023309 3165870 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm.sha256
I0805 12:31:10.201748 3165870 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm.sha256
I0805 12:31:10.352423 3165870 preload.go:131] Checking if preload exists for k8s version v1.31.0-rc.0 and runtime containerd
I0805 12:31:10.352509 3165870 ssh_runner.go:195] Run: sudo crictl images --output json
I0805 12:31:10.396853 3165870 containerd.go:627] all images are preloaded for containerd runtime.
I0805 12:31:10.396875 3165870 cache_images.go:84] Images are preloaded, skipping loading
I0805 12:31:10.396883 3165870 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.31.0-rc.0 containerd true true} ...
I0805 12:31:10.396991 3165870 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0-rc.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-304283 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.31.0-rc.0 ClusterName:no-preload-304283 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0805 12:31:10.397066 3165870 ssh_runner.go:195] Run: sudo crictl info
I0805 12:31:10.440750 3165870 cni.go:84] Creating CNI manager for ""
I0805 12:31:10.440776 3165870 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0805 12:31:10.440789 3165870 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0805 12:31:10.440812 3165870 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.31.0-rc.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-304283 NodeName:no-preload-304283 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0805 12:31:10.440953 3165870 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "no-preload-304283"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0-rc.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0805 12:31:10.441027 3165870 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0-rc.0
I0805 12:31:10.450093 3165870 binaries.go:44] Found k8s binaries, skipping transfer
I0805 12:31:10.450165 3165870 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0805 12:31:10.460174 3165870 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (326 bytes)
I0805 12:31:10.479106 3165870 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)
I0805 12:31:10.497929 3165870 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2176 bytes)
I0805 12:31:10.515856 3165870 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0805 12:31:10.519215 3165870 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0805 12:31:10.530727 3165870 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0805 12:31:10.612817 3165870 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0805 12:31:10.633944 3165870 certs.go:68] Setting up /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/no-preload-304283 for IP: 192.168.76.2
I0805 12:31:10.634018 3165870 certs.go:194] generating shared ca certs ...
I0805 12:31:10.634049 3165870 certs.go:226] acquiring lock for ca certs: {Name:mk267f690d6a0351f64afa94f26929de1b9470e1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:31:10.634233 3165870 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/ca.key
I0805 12:31:10.634305 3165870 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/proxy-client-ca.key
I0805 12:31:10.634334 3165870 certs.go:256] generating profile certs ...
I0805 12:31:10.634486 3165870 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/no-preload-304283/client.key
I0805 12:31:10.634576 3165870 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/no-preload-304283/apiserver.key.7b06d5c9
I0805 12:31:10.634645 3165870 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/no-preload-304283/proxy-client.key
I0805 12:31:10.634778 3165870 certs.go:484] found cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/2953168.pem (1338 bytes)
W0805 12:31:10.634839 3165870 certs.go:480] ignoring /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/2953168_empty.pem, impossibly tiny 0 bytes
I0805 12:31:10.634866 3165870 certs.go:484] found cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca-key.pem (1679 bytes)
I0805 12:31:10.634915 3165870 certs.go:484] found cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/ca.pem (1078 bytes)
I0805 12:31:10.634967 3165870 certs.go:484] found cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/cert.pem (1123 bytes)
I0805 12:31:10.635016 3165870 certs.go:484] found cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/key.pem (1675 bytes)
I0805 12:31:10.635083 3165870 certs.go:484] found cert: /home/jenkins/minikube-integration/19378-2947781/.minikube/files/etc/ssl/certs/29531682.pem (1708 bytes)
I0805 12:31:10.635760 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0805 12:31:10.663519 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0805 12:31:10.691912 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0805 12:31:10.723979 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0805 12:31:10.753467 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/no-preload-304283/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0805 12:31:10.798701 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/no-preload-304283/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0805 12:31:10.829051 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/no-preload-304283/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0805 12:31:10.854939 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/profiles/no-preload-304283/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0805 12:31:10.880507 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/files/etc/ssl/certs/29531682.pem --> /usr/share/ca-certificates/29531682.pem (1708 bytes)
I0805 12:31:10.908682 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0805 12:31:10.935849 3165870 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19378-2947781/.minikube/certs/2953168.pem --> /usr/share/ca-certificates/2953168.pem (1338 bytes)
I0805 12:31:10.963714 3165870 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0805 12:31:10.997216 3165870 ssh_runner.go:195] Run: openssl version
I0805 12:31:11.003509 3165870 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/29531682.pem && ln -fs /usr/share/ca-certificates/29531682.pem /etc/ssl/certs/29531682.pem"
I0805 12:31:11.015936 3165870 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/29531682.pem
I0805 12:31:11.019972 3165870 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 5 11:48 /usr/share/ca-certificates/29531682.pem
I0805 12:31:11.020064 3165870 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/29531682.pem
I0805 12:31:11.027600 3165870 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/29531682.pem /etc/ssl/certs/3ec20f2e.0"
I0805 12:31:11.039153 3165870 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0805 12:31:11.053987 3165870 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0805 12:31:11.058107 3165870 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 5 11:38 /usr/share/ca-certificates/minikubeCA.pem
I0805 12:31:11.058184 3165870 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0805 12:31:11.065991 3165870 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0805 12:31:11.075335 3165870 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2953168.pem && ln -fs /usr/share/ca-certificates/2953168.pem /etc/ssl/certs/2953168.pem"
I0805 12:31:11.086072 3165870 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2953168.pem
I0805 12:31:11.089566 3165870 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 5 11:48 /usr/share/ca-certificates/2953168.pem
I0805 12:31:11.089629 3165870 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2953168.pem
I0805 12:31:11.096808 3165870 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2953168.pem /etc/ssl/certs/51391683.0"
I0805 12:31:11.106133 3165870 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0805 12:31:11.110006 3165870 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0805 12:31:11.117305 3165870 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0805 12:31:11.124497 3165870 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0805 12:31:11.131528 3165870 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0805 12:31:11.138673 3165870 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0805 12:31:11.146283 3165870 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0805 12:31:11.153574 3165870 kubeadm.go:392] StartCluster: {Name:no-preload-304283 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-rc.0 ClusterName:no-preload-304283 Namespace:default APIServerHAVIP: APIServerName:minikubeCA A
PIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.0-rc.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/ho
me/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0805 12:31:11.153680 3165870 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0805 12:31:11.153752 3165870 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0805 12:31:11.194927 3165870 cri.go:89] found id: "0afc5d73a1176b7ec25312ccf4106842d686459f427e8bcc85d8ded1455cfa78"
I0805 12:31:11.194952 3165870 cri.go:89] found id: "5ab586c07d7e8bee6668e06bdec840da3225df68c75f15bb07784ff42becf86b"
I0805 12:31:11.194958 3165870 cri.go:89] found id: "59842af7185c8aec42ee4c6fa025be652415972a467149e02d7da3872e9c80fe"
I0805 12:31:11.194962 3165870 cri.go:89] found id: "0ce7682b1bc265fb5f5dd336632d5fe6915296b76b250dfecc2fcab37c759da3"
I0805 12:31:11.194966 3165870 cri.go:89] found id: "c23c871bfd96e08a48aaf69012e94c95fc526470050728080e5a7039524a930d"
I0805 12:31:11.194970 3165870 cri.go:89] found id: "d652ab15e1437cc7871da6a6469741a70421b8d07cd529169f3d4995730a672d"
I0805 12:31:11.194973 3165870 cri.go:89] found id: "9c9d867171a98722c70d7fdce4ddd33d8a27ed67c3890fe4e1b3acc24c344a28"
I0805 12:31:11.194976 3165870 cri.go:89] found id: "30aea72b4b976dcfeefed249aba02ad39fe69d472016db144dd46d6d600b26e4"
I0805 12:31:11.194980 3165870 cri.go:89] found id: ""
I0805 12:31:11.195044 3165870 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0805 12:31:11.209109 3165870 cri.go:116] JSON = null
W0805 12:31:11.209187 3165870 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0805 12:31:11.209292 3165870 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0805 12:31:11.220608 3165870 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0805 12:31:11.220669 3165870 kubeadm.go:593] restartPrimaryControlPlane start ...
I0805 12:31:11.220751 3165870 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0805 12:31:11.236281 3165870 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0805 12:31:11.236941 3165870 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-304283" does not appear in /home/jenkins/minikube-integration/19378-2947781/kubeconfig
I0805 12:31:11.237298 3165870 kubeconfig.go:62] /home/jenkins/minikube-integration/19378-2947781/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-304283" cluster setting kubeconfig missing "no-preload-304283" context setting]
I0805 12:31:11.237896 3165870 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19378-2947781/kubeconfig: {Name:mk8b7c80437a27220d1b5f905b285c444f00a590 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:31:11.241020 3165870 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0805 12:31:11.255519 3165870 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I0805 12:31:11.255594 3165870 kubeadm.go:597] duration metric: took 34.904448ms to restartPrimaryControlPlane
I0805 12:31:11.255619 3165870 kubeadm.go:394] duration metric: took 102.054663ms to StartCluster
I0805 12:31:11.255663 3165870 settings.go:142] acquiring lock: {Name:mk4dc0908f4613d53d438c1494e61599b368d805 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:31:11.255758 3165870 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19378-2947781/kubeconfig
I0805 12:31:11.256722 3165870 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19378-2947781/kubeconfig: {Name:mk8b7c80437a27220d1b5f905b285c444f00a590 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:31:11.257002 3165870 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.0-rc.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0805 12:31:11.257127 3165870 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0805 12:31:11.257444 3165870 addons.go:69] Setting storage-provisioner=true in profile "no-preload-304283"
I0805 12:31:11.257650 3165870 addons.go:234] Setting addon storage-provisioner=true in "no-preload-304283"
W0805 12:31:11.257692 3165870 addons.go:243] addon storage-provisioner should already be in state true
I0805 12:31:11.257737 3165870 host.go:66] Checking if "no-preload-304283" exists ...
I0805 12:31:11.257759 3165870 addons.go:69] Setting default-storageclass=true in profile "no-preload-304283"
I0805 12:31:11.257798 3165870 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-304283"
I0805 12:31:11.258096 3165870 cli_runner.go:164] Run: docker container inspect no-preload-304283 --format={{.State.Status}}
I0805 12:31:11.258304 3165870 cli_runner.go:164] Run: docker container inspect no-preload-304283 --format={{.State.Status}}
I0805 12:31:11.258719 3165870 addons.go:69] Setting metrics-server=true in profile "no-preload-304283"
I0805 12:31:11.258786 3165870 addons.go:234] Setting addon metrics-server=true in "no-preload-304283"
W0805 12:31:11.258810 3165870 addons.go:243] addon metrics-server should already be in state true
I0805 12:31:11.258865 3165870 host.go:66] Checking if "no-preload-304283" exists ...
I0805 12:31:11.259306 3165870 cli_runner.go:164] Run: docker container inspect no-preload-304283 --format={{.State.Status}}
I0805 12:31:11.257751 3165870 addons.go:69] Setting dashboard=true in profile "no-preload-304283"
I0805 12:31:11.265578 3165870 addons.go:234] Setting addon dashboard=true in "no-preload-304283"
W0805 12:31:11.265593 3165870 addons.go:243] addon dashboard should already be in state true
I0805 12:31:11.265628 3165870 host.go:66] Checking if "no-preload-304283" exists ...
I0805 12:31:11.266067 3165870 cli_runner.go:164] Run: docker container inspect no-preload-304283 --format={{.State.Status}}
I0805 12:31:11.257257 3165870 config.go:182] Loaded profile config "no-preload-304283": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0-rc.0
I0805 12:31:11.266902 3165870 out.go:177] * Verifying Kubernetes components...
I0805 12:31:11.275246 3165870 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0805 12:31:11.339368 3165870 addons.go:234] Setting addon default-storageclass=true in "no-preload-304283"
W0805 12:31:11.339394 3165870 addons.go:243] addon default-storageclass should already be in state true
I0805 12:31:11.339420 3165870 host.go:66] Checking if "no-preload-304283" exists ...
I0805 12:31:11.345765 3165870 cli_runner.go:164] Run: docker container inspect no-preload-304283 --format={{.State.Status}}
I0805 12:31:11.347680 3165870 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0805 12:31:11.348759 3165870 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0805 12:31:11.348775 3165870 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0805 12:31:11.349885 3165870 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0805 12:31:11.349907 3165870 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0805 12:31:11.349976 3165870 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-304283
I0805 12:31:11.352543 3165870 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0805 12:31:11.352569 3165870 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0805 12:31:11.352637 3165870 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-304283
I0805 12:31:11.355283 3165870 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0805 12:31:11.357553 3165870 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0805 12:31:11.357580 3165870 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0805 12:31:11.357665 3165870 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-304283
I0805 12:31:11.399840 3165870 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0805 12:31:11.399862 3165870 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0805 12:31:11.399928 3165870 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-304283
I0805 12:31:11.424865 3165870 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36781 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/no-preload-304283/id_rsa Username:docker}
I0805 12:31:11.445095 3165870 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36781 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/no-preload-304283/id_rsa Username:docker}
I0805 12:31:11.456783 3165870 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36781 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/no-preload-304283/id_rsa Username:docker}
I0805 12:31:11.461889 3165870 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36781 SSHKeyPath:/home/jenkins/minikube-integration/19378-2947781/.minikube/machines/no-preload-304283/id_rsa Username:docker}
I0805 12:31:11.543629 3165870 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0805 12:31:11.602062 3165870 node_ready.go:35] waiting up to 6m0s for node "no-preload-304283" to be "Ready" ...
I0805 12:31:11.671259 3165870 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0805 12:31:11.671285 3165870 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0805 12:31:11.718045 3165870 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0805 12:31:11.761097 3165870 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0805 12:31:11.803142 3165870 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0805 12:31:11.803171 3165870 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0805 12:31:11.850136 3165870 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0805 12:31:11.850166 3165870 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0805 12:31:11.990632 3165870 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0805 12:31:11.990659 3165870 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0805 12:31:12.028103 3165870 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0805 12:31:12.028143 3165870 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0805 12:31:12.225240 3165870 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0805 12:31:12.225266 3165870 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0805 12:31:12.225753 3165870 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0805 12:31:12.305868 3165870 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0805 12:31:12.305900 3165870 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0805 12:31:12.393324 3165870 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0805 12:31:12.393353 3165870 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0805 12:31:12.489226 3165870 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0805 12:31:12.489253 3165870 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0805 12:31:12.525635 3165870 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0805 12:31:12.525663 3165870 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0805 12:31:12.558158 3165870 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0805 12:31:12.558185 3165870 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0805 12:31:12.587789 3165870 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0805 12:31:12.587816 3165870 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0805 12:31:12.626457 3165870 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0805 12:31:10.456991 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:12.457164 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:16.603229 3165870 node_ready.go:49] node "no-preload-304283" has status "Ready":"True"
I0805 12:31:16.603262 3165870 node_ready.go:38] duration metric: took 5.001166483s for node "no-preload-304283" to be "Ready" ...
I0805 12:31:16.603273 3165870 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0805 12:31:16.639236 3165870 pod_ready.go:78] waiting up to 6m0s for pod "coredns-6f6b679f8f-v8jpl" in "kube-system" namespace to be "Ready" ...
I0805 12:31:16.669213 3165870 pod_ready.go:92] pod "coredns-6f6b679f8f-v8jpl" in "kube-system" namespace has status "Ready":"True"
I0805 12:31:16.669244 3165870 pod_ready.go:81] duration metric: took 29.96933ms for pod "coredns-6f6b679f8f-v8jpl" in "kube-system" namespace to be "Ready" ...
I0805 12:31:16.669256 3165870 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-304283" in "kube-system" namespace to be "Ready" ...
I0805 12:31:16.681637 3165870 pod_ready.go:92] pod "etcd-no-preload-304283" in "kube-system" namespace has status "Ready":"True"
I0805 12:31:16.681662 3165870 pod_ready.go:81] duration metric: took 12.396848ms for pod "etcd-no-preload-304283" in "kube-system" namespace to be "Ready" ...
I0805 12:31:16.681676 3165870 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-304283" in "kube-system" namespace to be "Ready" ...
I0805 12:31:16.694502 3165870 pod_ready.go:92] pod "kube-apiserver-no-preload-304283" in "kube-system" namespace has status "Ready":"True"
I0805 12:31:16.694530 3165870 pod_ready.go:81] duration metric: took 12.8462ms for pod "kube-apiserver-no-preload-304283" in "kube-system" namespace to be "Ready" ...
I0805 12:31:16.694542 3165870 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-304283" in "kube-system" namespace to be "Ready" ...
I0805 12:31:16.732121 3165870 pod_ready.go:92] pod "kube-controller-manager-no-preload-304283" in "kube-system" namespace has status "Ready":"True"
I0805 12:31:16.732157 3165870 pod_ready.go:81] duration metric: took 37.607206ms for pod "kube-controller-manager-no-preload-304283" in "kube-system" namespace to be "Ready" ...
I0805 12:31:16.732171 3165870 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-64bv8" in "kube-system" namespace to be "Ready" ...
I0805 12:31:16.808455 3165870 pod_ready.go:92] pod "kube-proxy-64bv8" in "kube-system" namespace has status "Ready":"True"
I0805 12:31:16.808487 3165870 pod_ready.go:81] duration metric: took 76.30848ms for pod "kube-proxy-64bv8" in "kube-system" namespace to be "Ready" ...
I0805 12:31:16.808498 3165870 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-304283" in "kube-system" namespace to be "Ready" ...
I0805 12:31:17.270527 3165870 pod_ready.go:92] pod "kube-scheduler-no-preload-304283" in "kube-system" namespace has status "Ready":"True"
I0805 12:31:17.270604 3165870 pod_ready.go:81] duration metric: took 462.097064ms for pod "kube-scheduler-no-preload-304283" in "kube-system" namespace to be "Ready" ...
I0805 12:31:17.270632 3165870 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace to be "Ready" ...
I0805 12:31:14.957035 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:17.456576 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:19.288275 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:19.519717 3165870 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.801630847s)
I0805 12:31:19.519776 3165870 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (7.758655195s)
I0805 12:31:19.567865 3165870 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.34207294s)
I0805 12:31:19.567923 3165870 addons.go:475] Verifying addon metrics-server=true in "no-preload-304283"
I0805 12:31:19.793707 3165870 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (7.16718806s)
I0805 12:31:19.796541 3165870 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-304283 addons enable metrics-server
I0805 12:31:19.800418 3165870 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
I0805 12:31:19.802379 3165870 addons.go:510] duration metric: took 8.545249484s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server dashboard]
I0805 12:31:21.777469 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:19.957559 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:21.958442 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:23.959618 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:24.276657 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:26.279695 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:26.458360 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:28.956879 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:28.782293 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:31.277164 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:30.956955 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:33.456197 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:33.277703 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:35.776971 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:35.456667 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:37.957847 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:38.276904 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:40.277056 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:42.278291 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:40.456677 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:42.956342 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:44.777310 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:46.777350 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:44.957625 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:47.456574 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:49.456666 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:49.279870 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:51.777926 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:51.457007 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:54.062223 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:54.276781 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:56.277443 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:56.456607 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:58.956629 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:31:58.776308 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:00.776695 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:00.956692 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:03.456404 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:03.277260 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:05.277325 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:07.277530 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:05.456584 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:07.957020 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:09.776843 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:11.777410 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:10.456213 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:12.957281 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:14.277804 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:16.777418 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:15.458618 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:17.957802 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:18.777566 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:21.279385 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:20.456777 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:22.956845 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:23.776509 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:25.777654 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:25.456830 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:27.458300 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:28.276748 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:30.277075 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:32.277641 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:29.956824 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:32.455982 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:34.456505 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:34.776876 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:37.276083 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:36.956676 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:38.957313 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:39.276986 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:41.777310 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:41.455925 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:43.456081 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:44.277423 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:46.776692 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:45.457078 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:47.458691 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:48.778363 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:51.276295 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:49.957307 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:52.456066 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:54.456318 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:53.276723 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:55.277093 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:57.778181 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:56.457407 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:32:58.963249 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:00.293399 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:02.776505 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:01.457810 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:03.957548 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:04.776797 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:06.778080 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:06.456195 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:08.956131 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:09.277437 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:11.777168 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:10.957663 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:13.456942 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:14.277248 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:16.277296 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:15.457634 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:17.957308 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:18.776772 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:21.278452 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:20.456679 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:22.957640 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:23.777062 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:26.277638 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:24.961733 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:27.456439 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:28.776750 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:31.277853 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:29.957065 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:32.456279 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:34.459566 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:33.777284 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:36.277163 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:36.465900 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:38.958536 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:38.778006 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:41.277061 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:41.456045 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:43.456696 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:43.277326 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:45.280039 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:47.777293 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:45.955957 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:47.956771 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:50.276868 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:52.777067 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:49.962794 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:52.456445 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:55.276648 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:57.277094 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:54.957245 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:57.456619 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:59.277629 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:01.776924 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:33:59.956986 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:01.957154 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:03.957362 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:03.777304 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:05.778015 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:05.957432 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:08.456204 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:08.276551 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:10.276734 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:12.776672 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:10.457666 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:12.956662 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:15.277677 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:17.778088 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:15.456333 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:17.956702 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:20.276036 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:22.277373 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:19.956818 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:22.455911 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:24.457145 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:24.776175 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:26.776808 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:26.956409 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:28.959568 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:28.777540 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:31.277065 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:31.456770 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:33.957357 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:33.277404 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:35.776086 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:37.777137 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:36.455811 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:38.456320 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:40.277426 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:42.278861 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:40.956977 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:43.456551 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:44.776584 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:46.776670 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:45.456830 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:47.956773 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:48.777234 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:50.777441 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:49.957129 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:51.957356 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:54.456748 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:53.277403 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:55.776183 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:57.777194 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:56.956905 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:34:59.456161 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:35:00.296224 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:35:02.777154 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:35:01.456714 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:35:03.457092 3157290 pod_ready.go:102] pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace has status "Ready":"False"
I0805 12:35:03.457122 3157290 pod_ready.go:81] duration metric: took 4m0.00677131s for pod "metrics-server-9975d5f86-l7dqv" in "kube-system" namespace to be "Ready" ...
E0805 12:35:03.457133 3157290 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0805 12:35:03.457142 3157290 pod_ready.go:38] duration metric: took 5m30.151131289s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0805 12:35:03.457158 3157290 api_server.go:52] waiting for apiserver process to appear ...
I0805 12:35:03.457196 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0805 12:35:03.457279 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0805 12:35:03.495609 3157290 cri.go:89] found id: "9d027ed91112d33dc082a5ea6f24f63f8af0a2ece264023d5a9c65c9045fb314"
I0805 12:35:03.495630 3157290 cri.go:89] found id: "c57b337ca22f3da57a9a16c10bab53bd21ba60b658216f543ec77c7c261d76d0"
I0805 12:35:03.495636 3157290 cri.go:89] found id: ""
I0805 12:35:03.495644 3157290 logs.go:276] 2 containers: [9d027ed91112d33dc082a5ea6f24f63f8af0a2ece264023d5a9c65c9045fb314 c57b337ca22f3da57a9a16c10bab53bd21ba60b658216f543ec77c7c261d76d0]
I0805 12:35:03.495725 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.500029 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.503821 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0805 12:35:03.503898 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0805 12:35:03.541801 3157290 cri.go:89] found id: "fc5593e0a311c4edb26ac47b996d6217f34a1b0217ceb94d9e21dd25e21e53a4"
I0805 12:35:03.541824 3157290 cri.go:89] found id: "cb79833ef66834cddc4c8aa73ebb5d899ac9bf1ca03e023bb8cc835970bd7a80"
I0805 12:35:03.541830 3157290 cri.go:89] found id: ""
I0805 12:35:03.541838 3157290 logs.go:276] 2 containers: [fc5593e0a311c4edb26ac47b996d6217f34a1b0217ceb94d9e21dd25e21e53a4 cb79833ef66834cddc4c8aa73ebb5d899ac9bf1ca03e023bb8cc835970bd7a80]
I0805 12:35:03.541895 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.545430 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.548868 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0805 12:35:03.548993 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0805 12:35:03.591653 3157290 cri.go:89] found id: "53ed5e9b18f6113ff814a6524c9d92af757e6842423a180676c1c82e954378a6"
I0805 12:35:03.591719 3157290 cri.go:89] found id: "d6fba388564c793c5389933336d0672c6073a88eaef246caace2ea874e623866"
I0805 12:35:03.591748 3157290 cri.go:89] found id: ""
I0805 12:35:03.591771 3157290 logs.go:276] 2 containers: [53ed5e9b18f6113ff814a6524c9d92af757e6842423a180676c1c82e954378a6 d6fba388564c793c5389933336d0672c6073a88eaef246caace2ea874e623866]
I0805 12:35:03.591853 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.595399 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.598948 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0805 12:35:03.599043 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0805 12:35:03.646743 3157290 cri.go:89] found id: "4e9e6aad998c20b415ab501ad4ebf77382e0735f38873fbccc09b8238df675e4"
I0805 12:35:03.646825 3157290 cri.go:89] found id: "b0f295274cc0dc24801c47922225033790a049a64a2da070072638a1a5783324"
I0805 12:35:03.646845 3157290 cri.go:89] found id: ""
I0805 12:35:03.646867 3157290 logs.go:276] 2 containers: [4e9e6aad998c20b415ab501ad4ebf77382e0735f38873fbccc09b8238df675e4 b0f295274cc0dc24801c47922225033790a049a64a2da070072638a1a5783324]
I0805 12:35:03.646961 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.650611 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.654254 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0805 12:35:03.654325 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0805 12:35:03.694026 3157290 cri.go:89] found id: "db3f6af771289732d5839bbcfb2bfaf22499949eeebfa4d8704c5ad09201ad7f"
I0805 12:35:03.694050 3157290 cri.go:89] found id: "7d92baabf40f37efdaf5f9a0ea099e97d5b9d67ab0c5057b0c2da9047637454b"
I0805 12:35:03.694056 3157290 cri.go:89] found id: ""
I0805 12:35:03.694063 3157290 logs.go:276] 2 containers: [db3f6af771289732d5839bbcfb2bfaf22499949eeebfa4d8704c5ad09201ad7f 7d92baabf40f37efdaf5f9a0ea099e97d5b9d67ab0c5057b0c2da9047637454b]
I0805 12:35:03.694118 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.697550 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.700830 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0805 12:35:03.700955 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0805 12:35:03.745197 3157290 cri.go:89] found id: "1520cc7f0130657302bb29ef6e58b4d1572d9cefc349039b32f44bc842874834"
I0805 12:35:03.745221 3157290 cri.go:89] found id: "ebe0210d2958f3fd3a26d3ca59083ac59c13e1ec92612ca8962604e2fde9e6f9"
I0805 12:35:03.745226 3157290 cri.go:89] found id: ""
I0805 12:35:03.745233 3157290 logs.go:276] 2 containers: [1520cc7f0130657302bb29ef6e58b4d1572d9cefc349039b32f44bc842874834 ebe0210d2958f3fd3a26d3ca59083ac59c13e1ec92612ca8962604e2fde9e6f9]
I0805 12:35:03.745308 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.748933 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.752442 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0805 12:35:03.752548 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0805 12:35:03.805088 3157290 cri.go:89] found id: "6abdebaafdd0f48350b41babf057972779046beacd70845b0894694eba1254f2"
I0805 12:35:03.805112 3157290 cri.go:89] found id: "3a48910e06110ae02c128be9c2e75b0359c0f6d5b1d8a5a3e228123d153ce298"
I0805 12:35:03.805118 3157290 cri.go:89] found id: ""
I0805 12:35:03.805126 3157290 logs.go:276] 2 containers: [6abdebaafdd0f48350b41babf057972779046beacd70845b0894694eba1254f2 3a48910e06110ae02c128be9c2e75b0359c0f6d5b1d8a5a3e228123d153ce298]
I0805 12:35:03.805215 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.809813 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.813319 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0805 12:35:03.813414 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0805 12:35:03.854479 3157290 cri.go:89] found id: "9256f116f633efac70a5c047632a53fe479bb5daa0f8c1c913b2d146080322b7"
I0805 12:35:03.854504 3157290 cri.go:89] found id: "a8b821ffe6b918edfd2170a30e9fcd75c26fa0825e5cb49a3ad44b5c0374ae0e"
I0805 12:35:03.854510 3157290 cri.go:89] found id: ""
I0805 12:35:03.854517 3157290 logs.go:276] 2 containers: [9256f116f633efac70a5c047632a53fe479bb5daa0f8c1c913b2d146080322b7 a8b821ffe6b918edfd2170a30e9fcd75c26fa0825e5cb49a3ad44b5c0374ae0e]
I0805 12:35:03.854610 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.858391 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.862021 3157290 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0805 12:35:03.862164 3157290 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0805 12:35:03.912533 3157290 cri.go:89] found id: "505644f5a96f3c69382ed44085987497e61cce3698d7ed213d9fef18b1de9a03"
I0805 12:35:03.912561 3157290 cri.go:89] found id: ""
I0805 12:35:03.912570 3157290 logs.go:276] 1 containers: [505644f5a96f3c69382ed44085987497e61cce3698d7ed213d9fef18b1de9a03]
I0805 12:35:03.912632 3157290 ssh_runner.go:195] Run: which crictl
I0805 12:35:03.916151 3157290 logs.go:123] Gathering logs for kubelet ...
I0805 12:35:03.916176 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0805 12:35:03.975316 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:33 old-k8s-version-628218 kubelet[662]: E0805 12:29:33.210108 662 reflector.go:138] object-"kube-system"/"storage-provisioner-token-lrgb7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-lrgb7" is forbidden: User "system:node:old-k8s-version-628218" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-628218' and this object
W0805 12:35:03.975561 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:33 old-k8s-version-628218 kubelet[662]: E0805 12:29:33.210228 662 reflector.go:138] object-"kube-system"/"kube-proxy-token-qnks5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-qnks5" is forbidden: User "system:node:old-k8s-version-628218" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-628218' and this object
W0805 12:35:03.975779 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:33 old-k8s-version-628218 kubelet[662]: E0805 12:29:33.210293 662 reflector.go:138] object-"kube-system"/"kindnet-token-bt9x6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-bt9x6" is forbidden: User "system:node:old-k8s-version-628218" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-628218' and this object
W0805 12:35:03.975997 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:33 old-k8s-version-628218 kubelet[662]: E0805 12:29:33.210372 662 reflector.go:138] object-"kube-system"/"coredns-token-dnl82": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-dnl82" is forbidden: User "system:node:old-k8s-version-628218" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-628218' and this object
W0805 12:35:03.976205 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:33 old-k8s-version-628218 kubelet[662]: E0805 12:29:33.210437 662 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-628218" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-628218' and this object
W0805 12:35:03.976430 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:33 old-k8s-version-628218 kubelet[662]: E0805 12:29:33.210936 662 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-628218" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-628218' and this object
W0805 12:35:03.982780 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:34 old-k8s-version-628218 kubelet[662]: E0805 12:29:34.991530 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 12:35:03.982973 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:35 old-k8s-version-628218 kubelet[662]: E0805 12:29:35.595846 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:03.985818 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:47 old-k8s-version-628218 kubelet[662]: E0805 12:29:47.077645 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 12:35:03.987512 3157290 logs.go:138] Found kubelet problem: Aug 05 12:29:59 old-k8s-version-628218 kubelet[662]: E0805 12:29:59.054405 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:03.987985 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:00 old-k8s-version-628218 kubelet[662]: E0805 12:30:00.796689 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.988799 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:01 old-k8s-version-628218 kubelet[662]: E0805 12:30:01.807154 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.989133 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:04 old-k8s-version-628218 kubelet[662]: E0805 12:30:04.078679 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.989587 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:07 old-k8s-version-628218 kubelet[662]: E0805 12:30:07.837421 662 pod_workers.go:191] Error syncing pod 07b493c6-e53f-470c-87a3-7cb8aede6c6e ("storage-provisioner_kube-system(07b493c6-e53f-470c-87a3-7cb8aede6c6e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(07b493c6-e53f-470c-87a3-7cb8aede6c6e)"
W0805 12:35:03.992418 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:14 old-k8s-version-628218 kubelet[662]: E0805 12:30:14.060397 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 12:35:03.993046 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:16 old-k8s-version-628218 kubelet[662]: E0805 12:30:16.871687 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.993518 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:24 old-k8s-version-628218 kubelet[662]: E0805 12:30:24.078612 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.993706 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:25 old-k8s-version-628218 kubelet[662]: E0805 12:30:25.054058 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:03.994038 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:35 old-k8s-version-628218 kubelet[662]: E0805 12:30:35.058487 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.994225 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:36 old-k8s-version-628218 kubelet[662]: E0805 12:30:36.054476 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:03.994828 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:46 old-k8s-version-628218 kubelet[662]: E0805 12:30:46.947337 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.995020 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:50 old-k8s-version-628218 kubelet[662]: E0805 12:30:50.049700 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:03.995356 3157290 logs.go:138] Found kubelet problem: Aug 05 12:30:54 old-k8s-version-628218 kubelet[662]: E0805 12:30:54.079016 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.997874 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:01 old-k8s-version-628218 kubelet[662]: E0805 12:31:01.060228 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 12:35:03.998209 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:07 old-k8s-version-628218 kubelet[662]: E0805 12:31:07.049999 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.998397 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:13 old-k8s-version-628218 kubelet[662]: E0805 12:31:13.061032 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:03.998729 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:19 old-k8s-version-628218 kubelet[662]: E0805 12:31:19.049423 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.998917 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:24 old-k8s-version-628218 kubelet[662]: E0805 12:31:24.049838 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:03.999514 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:34 old-k8s-version-628218 kubelet[662]: E0805 12:31:34.137243 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:03.999700 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:39 old-k8s-version-628218 kubelet[662]: E0805 12:31:39.054072 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.000031 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:44 old-k8s-version-628218 kubelet[662]: E0805 12:31:44.078484 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.000218 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:51 old-k8s-version-628218 kubelet[662]: E0805 12:31:51.050363 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.000552 3157290 logs.go:138] Found kubelet problem: Aug 05 12:31:57 old-k8s-version-628218 kubelet[662]: E0805 12:31:57.053538 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.000740 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:02 old-k8s-version-628218 kubelet[662]: E0805 12:32:02.049734 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.001073 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:08 old-k8s-version-628218 kubelet[662]: E0805 12:32:08.049902 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.001259 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:15 old-k8s-version-628218 kubelet[662]: E0805 12:32:15.050679 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.001656 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:19 old-k8s-version-628218 kubelet[662]: E0805 12:32:19.050105 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.004132 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:26 old-k8s-version-628218 kubelet[662]: E0805 12:32:26.057893 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 12:35:04.004468 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:32 old-k8s-version-628218 kubelet[662]: E0805 12:32:32.049403 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.004651 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:41 old-k8s-version-628218 kubelet[662]: E0805 12:32:41.050575 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.004981 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:44 old-k8s-version-628218 kubelet[662]: E0805 12:32:44.049984 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.005163 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:53 old-k8s-version-628218 kubelet[662]: E0805 12:32:53.050229 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.005773 3157290 logs.go:138] Found kubelet problem: Aug 05 12:32:57 old-k8s-version-628218 kubelet[662]: E0805 12:32:57.356327 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.005963 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:04 old-k8s-version-628218 kubelet[662]: E0805 12:33:04.050147 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.006303 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:04 old-k8s-version-628218 kubelet[662]: E0805 12:33:04.078938 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.006641 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:16 old-k8s-version-628218 kubelet[662]: E0805 12:33:16.049972 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.006830 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:17 old-k8s-version-628218 kubelet[662]: E0805 12:33:17.050046 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.007163 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:27 old-k8s-version-628218 kubelet[662]: E0805 12:33:27.051058 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.007346 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:32 old-k8s-version-628218 kubelet[662]: E0805 12:33:32.049949 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.007683 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:39 old-k8s-version-628218 kubelet[662]: E0805 12:33:39.051084 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.007866 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:45 old-k8s-version-628218 kubelet[662]: E0805 12:33:45.053788 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.008199 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:54 old-k8s-version-628218 kubelet[662]: E0805 12:33:54.049443 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.008386 3157290 logs.go:138] Found kubelet problem: Aug 05 12:33:58 old-k8s-version-628218 kubelet[662]: E0805 12:33:58.049767 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.008715 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:09 old-k8s-version-628218 kubelet[662]: E0805 12:34:09.050774 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.008900 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:12 old-k8s-version-628218 kubelet[662]: E0805 12:34:12.050180 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.009229 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:20 old-k8s-version-628218 kubelet[662]: E0805 12:34:20.049373 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.009411 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:27 old-k8s-version-628218 kubelet[662]: E0805 12:34:27.049948 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.009808 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:33 old-k8s-version-628218 kubelet[662]: E0805 12:34:33.050830 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.010005 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:39 old-k8s-version-628218 kubelet[662]: E0805 12:34:39.050798 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.010346 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:47 old-k8s-version-628218 kubelet[662]: E0805 12:34:47.050116 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:04.010534 3157290 logs.go:138] Found kubelet problem: Aug 05 12:34:52 old-k8s-version-628218 kubelet[662]: E0805 12:34:52.049768 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:04.010869 3157290 logs.go:138] Found kubelet problem: Aug 05 12:35:02 old-k8s-version-628218 kubelet[662]: E0805 12:35:02.049419 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
I0805 12:35:04.010884 3157290 logs.go:123] Gathering logs for describe nodes ...
I0805 12:35:04.010900 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0805 12:35:04.195597 3157290 logs.go:123] Gathering logs for coredns [53ed5e9b18f6113ff814a6524c9d92af757e6842423a180676c1c82e954378a6] ...
I0805 12:35:04.195629 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 53ed5e9b18f6113ff814a6524c9d92af757e6842423a180676c1c82e954378a6"
I0805 12:35:04.238577 3157290 logs.go:123] Gathering logs for kindnet [6abdebaafdd0f48350b41babf057972779046beacd70845b0894694eba1254f2] ...
I0805 12:35:04.238606 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6abdebaafdd0f48350b41babf057972779046beacd70845b0894694eba1254f2"
I0805 12:35:04.306491 3157290 logs.go:123] Gathering logs for container status ...
I0805 12:35:04.306526 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0805 12:35:04.356627 3157290 logs.go:123] Gathering logs for etcd [fc5593e0a311c4edb26ac47b996d6217f34a1b0217ceb94d9e21dd25e21e53a4] ...
I0805 12:35:04.356658 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fc5593e0a311c4edb26ac47b996d6217f34a1b0217ceb94d9e21dd25e21e53a4"
I0805 12:35:04.401044 3157290 logs.go:123] Gathering logs for coredns [d6fba388564c793c5389933336d0672c6073a88eaef246caace2ea874e623866] ...
I0805 12:35:04.401074 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d6fba388564c793c5389933336d0672c6073a88eaef246caace2ea874e623866"
I0805 12:35:04.440190 3157290 logs.go:123] Gathering logs for kube-scheduler [4e9e6aad998c20b415ab501ad4ebf77382e0735f38873fbccc09b8238df675e4] ...
I0805 12:35:04.440218 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4e9e6aad998c20b415ab501ad4ebf77382e0735f38873fbccc09b8238df675e4"
I0805 12:35:04.484017 3157290 logs.go:123] Gathering logs for containerd ...
I0805 12:35:04.484047 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0805 12:35:05.277547 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:35:07.777791 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:35:04.544561 3157290 logs.go:123] Gathering logs for dmesg ...
I0805 12:35:04.544603 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0805 12:35:04.566729 3157290 logs.go:123] Gathering logs for kube-apiserver [c57b337ca22f3da57a9a16c10bab53bd21ba60b658216f543ec77c7c261d76d0] ...
I0805 12:35:04.566830 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c57b337ca22f3da57a9a16c10bab53bd21ba60b658216f543ec77c7c261d76d0"
I0805 12:35:04.630910 3157290 logs.go:123] Gathering logs for kube-scheduler [b0f295274cc0dc24801c47922225033790a049a64a2da070072638a1a5783324] ...
I0805 12:35:04.630946 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b0f295274cc0dc24801c47922225033790a049a64a2da070072638a1a5783324"
I0805 12:35:04.692936 3157290 logs.go:123] Gathering logs for kube-proxy [db3f6af771289732d5839bbcfb2bfaf22499949eeebfa4d8704c5ad09201ad7f] ...
I0805 12:35:04.693005 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db3f6af771289732d5839bbcfb2bfaf22499949eeebfa4d8704c5ad09201ad7f"
I0805 12:35:04.736820 3157290 logs.go:123] Gathering logs for kube-controller-manager [ebe0210d2958f3fd3a26d3ca59083ac59c13e1ec92612ca8962604e2fde9e6f9] ...
I0805 12:35:04.736855 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ebe0210d2958f3fd3a26d3ca59083ac59c13e1ec92612ca8962604e2fde9e6f9"
I0805 12:35:04.797140 3157290 logs.go:123] Gathering logs for kindnet [3a48910e06110ae02c128be9c2e75b0359c0f6d5b1d8a5a3e228123d153ce298] ...
I0805 12:35:04.797187 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3a48910e06110ae02c128be9c2e75b0359c0f6d5b1d8a5a3e228123d153ce298"
I0805 12:35:04.851364 3157290 logs.go:123] Gathering logs for storage-provisioner [9256f116f633efac70a5c047632a53fe479bb5daa0f8c1c913b2d146080322b7] ...
I0805 12:35:04.851398 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9256f116f633efac70a5c047632a53fe479bb5daa0f8c1c913b2d146080322b7"
I0805 12:35:04.890074 3157290 logs.go:123] Gathering logs for storage-provisioner [a8b821ffe6b918edfd2170a30e9fcd75c26fa0825e5cb49a3ad44b5c0374ae0e] ...
I0805 12:35:04.890103 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a8b821ffe6b918edfd2170a30e9fcd75c26fa0825e5cb49a3ad44b5c0374ae0e"
I0805 12:35:04.927061 3157290 logs.go:123] Gathering logs for kube-apiserver [9d027ed91112d33dc082a5ea6f24f63f8af0a2ece264023d5a9c65c9045fb314] ...
I0805 12:35:04.927093 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9d027ed91112d33dc082a5ea6f24f63f8af0a2ece264023d5a9c65c9045fb314"
I0805 12:35:04.986598 3157290 logs.go:123] Gathering logs for etcd [cb79833ef66834cddc4c8aa73ebb5d899ac9bf1ca03e023bb8cc835970bd7a80] ...
I0805 12:35:04.986635 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cb79833ef66834cddc4c8aa73ebb5d899ac9bf1ca03e023bb8cc835970bd7a80"
I0805 12:35:05.029759 3157290 logs.go:123] Gathering logs for kube-proxy [7d92baabf40f37efdaf5f9a0ea099e97d5b9d67ab0c5057b0c2da9047637454b] ...
I0805 12:35:05.029835 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7d92baabf40f37efdaf5f9a0ea099e97d5b9d67ab0c5057b0c2da9047637454b"
I0805 12:35:05.080513 3157290 logs.go:123] Gathering logs for kube-controller-manager [1520cc7f0130657302bb29ef6e58b4d1572d9cefc349039b32f44bc842874834] ...
I0805 12:35:05.080544 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1520cc7f0130657302bb29ef6e58b4d1572d9cefc349039b32f44bc842874834"
I0805 12:35:05.149737 3157290 logs.go:123] Gathering logs for kubernetes-dashboard [505644f5a96f3c69382ed44085987497e61cce3698d7ed213d9fef18b1de9a03] ...
I0805 12:35:05.149777 3157290 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 505644f5a96f3c69382ed44085987497e61cce3698d7ed213d9fef18b1de9a03"
I0805 12:35:05.193953 3157290 out.go:304] Setting ErrFile to fd 2...
I0805 12:35:05.193980 3157290 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0805 12:35:05.194073 3157290 out.go:239] X Problems detected in kubelet:
W0805 12:35:05.194099 3157290 out.go:239] Aug 05 12:34:33 old-k8s-version-628218 kubelet[662]: E0805 12:34:33.050830 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:05.194112 3157290 out.go:239] Aug 05 12:34:39 old-k8s-version-628218 kubelet[662]: E0805 12:34:39.050798 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:05.194120 3157290 out.go:239] Aug 05 12:34:47 old-k8s-version-628218 kubelet[662]: E0805 12:34:47.050116 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
W0805 12:35:05.194126 3157290 out.go:239] Aug 05 12:34:52 old-k8s-version-628218 kubelet[662]: E0805 12:34:52.049768 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 12:35:05.194134 3157290 out.go:239] Aug 05 12:35:02 old-k8s-version-628218 kubelet[662]: E0805 12:35:02.049419 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
I0805 12:35:05.194146 3157290 out.go:304] Setting ErrFile to fd 2...
I0805 12:35:05.194152 3157290 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 12:35:10.277776 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:35:12.776294 3165870 pod_ready.go:102] pod "metrics-server-6867b74b74-znjls" in "kube-system" namespace has status "Ready":"False"
I0805 12:35:15.195940 3157290 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0805 12:35:15.208704 3157290 api_server.go:72] duration metric: took 6m2.069896441s to wait for apiserver process to appear ...
I0805 12:35:15.208731 3157290 api_server.go:88] waiting for apiserver healthz status ...
I0805 12:35:15.211080 3157290 out.go:177]
W0805 12:35:15.213018 3157290 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W0805 12:35:15.213037 3157290 out.go:239] *
W0805 12:35:15.214064 3157290 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0805 12:35:15.216704 3157290 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
ff5632cf38cbc 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 08431535979fa dashboard-metrics-scraper-8d5bb5db8-5ftcd
9256f116f633e ba04bb24b9575 4 minutes ago Running storage-provisioner 2 4b9cac998481b storage-provisioner
505644f5a96f3 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 900c954c8a2db kubernetes-dashboard-cd95d586-mg8z4
db3f6af771289 25a5233254979 5 minutes ago Running kube-proxy 1 ad3ec9b37492f kube-proxy-6lls2
6abdebaafdd0f d5e283bc63d43 5 minutes ago Running kindnet-cni 1 7bbe312b6aa58 kindnet-7sbx8
53ed5e9b18f61 db91994f4ee8f 5 minutes ago Running coredns 1 d445fb398aff7 coredns-74ff55c5b-879s2
a8b821ffe6b91 ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 4b9cac998481b storage-provisioner
c54407ee6a61a 1611cd07b61d5 5 minutes ago Running busybox 1 adb5a86adcd65 busybox
9d027ed91112d 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 f72c205f7e008 kube-apiserver-old-k8s-version-628218
fc5593e0a311c 05b738aa1bc63 5 minutes ago Running etcd 1 1c8df9cbf970e etcd-old-k8s-version-628218
4e9e6aad998c2 e7605f88f17d6 5 minutes ago Running kube-scheduler 1 b391c06cba9f4 kube-scheduler-old-k8s-version-628218
1520cc7f01306 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 4e02401274961 kube-controller-manager-old-k8s-version-628218
35f1f5726156e 1611cd07b61d5 6 minutes ago Exited busybox 0 4b4360ae1f9e0 busybox
d6fba388564c7 db91994f4ee8f 7 minutes ago Exited coredns 0 adce164c84396 coredns-74ff55c5b-879s2
3a48910e06110 d5e283bc63d43 7 minutes ago Exited kindnet-cni 0 d0072cde5ce70 kindnet-7sbx8
7d92baabf40f3 25a5233254979 7 minutes ago Exited kube-proxy 0 52836d0ea6288 kube-proxy-6lls2
ebe0210d2958f 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 9431fbbb79557 kube-controller-manager-old-k8s-version-628218
b0f295274cc0d e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 4bcef877ddd78 kube-scheduler-old-k8s-version-628218
cb79833ef6683 05b738aa1bc63 8 minutes ago Exited etcd 0 42e01d9373cb8 etcd-old-k8s-version-628218
c57b337ca22f3 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 16f66f901a0d5 kube-apiserver-old-k8s-version-628218
==> containerd <==
Aug 05 12:31:01 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:31:01.057422902Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Aug 05 12:31:01 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:31:01.058950067Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Aug 05 12:31:01 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:31:01.058991305Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Aug 05 12:31:33 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:31:33.052077962Z" level=info msg="CreateContainer within sandbox \"08431535979fafc0ebaf9d80972299a61811c50f0225fd47375b7b1f666e91ea\" for container name:\"dashboard-metrics-scraper\" attempt:4"
Aug 05 12:31:33 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:31:33.082686534Z" level=info msg="CreateContainer within sandbox \"08431535979fafc0ebaf9d80972299a61811c50f0225fd47375b7b1f666e91ea\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"6baf74ce1d0c34de16e2ef0a49af9183e75ffd0374aa0632551265d50cd773b2\""
Aug 05 12:31:33 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:31:33.083417116Z" level=info msg="StartContainer for \"6baf74ce1d0c34de16e2ef0a49af9183e75ffd0374aa0632551265d50cd773b2\""
Aug 05 12:31:33 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:31:33.164955564Z" level=info msg="StartContainer for \"6baf74ce1d0c34de16e2ef0a49af9183e75ffd0374aa0632551265d50cd773b2\" returns successfully"
Aug 05 12:31:33 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:31:33.528194572Z" level=info msg="shim disconnected" id=6baf74ce1d0c34de16e2ef0a49af9183e75ffd0374aa0632551265d50cd773b2 namespace=k8s.io
Aug 05 12:31:33 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:31:33.528255077Z" level=warning msg="cleaning up after shim disconnected" id=6baf74ce1d0c34de16e2ef0a49af9183e75ffd0374aa0632551265d50cd773b2 namespace=k8s.io
Aug 05 12:31:33 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:31:33.528266482Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 05 12:31:34 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:31:34.138708287Z" level=info msg="RemoveContainer for \"f015b822a1772baa24b44d4e667656f83a221cf52f343d1afecdcd5928f44daf\""
Aug 05 12:31:34 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:31:34.144985726Z" level=info msg="RemoveContainer for \"f015b822a1772baa24b44d4e667656f83a221cf52f343d1afecdcd5928f44daf\" returns successfully"
Aug 05 12:32:26 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:32:26.050094819Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 12:32:26 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:32:26.055466490Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Aug 05 12:32:26 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:32:26.057338531Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Aug 05 12:32:26 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:32:26.057400381Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Aug 05 12:32:57 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:32:57.052597268Z" level=info msg="CreateContainer within sandbox \"08431535979fafc0ebaf9d80972299a61811c50f0225fd47375b7b1f666e91ea\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Aug 05 12:32:57 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:32:57.068917021Z" level=info msg="CreateContainer within sandbox \"08431535979fafc0ebaf9d80972299a61811c50f0225fd47375b7b1f666e91ea\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"ff5632cf38cbc6e995ffc99b208888bdd45970ae4cd22b0898de86e7308b4fff\""
Aug 05 12:32:57 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:32:57.069887610Z" level=info msg="StartContainer for \"ff5632cf38cbc6e995ffc99b208888bdd45970ae4cd22b0898de86e7308b4fff\""
Aug 05 12:32:57 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:32:57.136195123Z" level=info msg="StartContainer for \"ff5632cf38cbc6e995ffc99b208888bdd45970ae4cd22b0898de86e7308b4fff\" returns successfully"
Aug 05 12:32:57 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:32:57.161701464Z" level=info msg="shim disconnected" id=ff5632cf38cbc6e995ffc99b208888bdd45970ae4cd22b0898de86e7308b4fff namespace=k8s.io
Aug 05 12:32:57 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:32:57.161760286Z" level=warning msg="cleaning up after shim disconnected" id=ff5632cf38cbc6e995ffc99b208888bdd45970ae4cd22b0898de86e7308b4fff namespace=k8s.io
Aug 05 12:32:57 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:32:57.161769689Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 05 12:32:57 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:32:57.382617505Z" level=info msg="RemoveContainer for \"6baf74ce1d0c34de16e2ef0a49af9183e75ffd0374aa0632551265d50cd773b2\""
Aug 05 12:32:57 old-k8s-version-628218 containerd[569]: time="2024-08-05T12:32:57.388157765Z" level=info msg="RemoveContainer for \"6baf74ce1d0c34de16e2ef0a49af9183e75ffd0374aa0632551265d50cd773b2\" returns successfully"
==> coredns [53ed5e9b18f6113ff814a6524c9d92af757e6842423a180676c1c82e954378a6] <==
[INFO] plugin/ready: Still waiting on: "kubernetes"
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:36833 - 14766 "HINFO IN 1808901308689523393.8858336793768040414. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.047586873s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0805 12:30:06.657347 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-05 12:29:36.65465768 +0000 UTC m=+0.042258207) (total time: 30.002590407s):
Trace[2019727887]: [30.002590407s] [30.002590407s] END
I0805 12:30:06.657793 1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-05 12:29:36.654655826 +0000 UTC m=+0.042256344) (total time: 30.003115903s):
Trace[1427131847]: [30.003115903s] [30.003115903s] END
E0805 12:30:06.657817 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0805 12:30:06.657893 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-05 12:29:36.654739099 +0000 UTC m=+0.042339618) (total time: 30.003144932s):
Trace[911902081]: [30.003144932s] [30.003144932s] END
E0805 12:30:06.657902 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
E0805 12:30:06.658180 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> coredns [d6fba388564c793c5389933336d0672c6073a88eaef246caace2ea874e623866] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:50379 - 6466 "HINFO IN 3381682498122951899.1450731127541629935. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.011795061s
==> describe nodes <==
Name: old-k8s-version-628218
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-628218
kubernetes.io/os=linux
minikube.k8s.io/commit=bfc5536a1db2098b1093d0066c2e3ed947830b19
minikube.k8s.io/name=old-k8s-version-628218
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_08_05T12_27_14_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 05 Aug 2024 12:27:10 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-628218
AcquireTime: <unset>
RenewTime: Mon, 05 Aug 2024 12:35:15 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 05 Aug 2024 12:30:24 +0000 Mon, 05 Aug 2024 12:27:04 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 05 Aug 2024 12:30:24 +0000 Mon, 05 Aug 2024 12:27:04 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 05 Aug 2024 12:30:24 +0000 Mon, 05 Aug 2024 12:27:04 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 05 Aug 2024 12:30:24 +0000 Mon, 05 Aug 2024 12:27:29 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-628218
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
System Info:
Machine ID: cf247cdd699d4f84a8cf0e94fad9d805
System UUID: 8c1efec8-b15f-4cac-9e5e-77e598e91eff
Boot ID: ea68312d-eec8-480a-bf3a-75f393183927
Kernel Version: 5.15.0-1066-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.19
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m34s
kube-system coredns-74ff55c5b-879s2 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 7m46s
kube-system etcd-old-k8s-version-628218 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 7m54s
kube-system kindnet-7sbx8 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 7m47s
kube-system kube-apiserver-old-k8s-version-628218 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m54s
kube-system kube-controller-manager-old-k8s-version-628218 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m54s
kube-system kube-proxy-6lls2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m47s
kube-system kube-scheduler-old-k8s-version-628218 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m54s
kube-system metrics-server-9975d5f86-l7dqv 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m24s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m45s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-5ftcd 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m24s
kubernetes-dashboard kubernetes-dashboard-cd95d586-mg8z4 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m24s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m14s (x5 over 8m14s) kubelet Node old-k8s-version-628218 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m14s (x4 over 8m14s) kubelet Node old-k8s-version-628218 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m14s (x4 over 8m14s) kubelet Node old-k8s-version-628218 status is now: NodeHasSufficientPID
Normal Starting 7m54s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 7m54s kubelet Node old-k8s-version-628218 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 7m54s kubelet Node old-k8s-version-628218 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 7m54s kubelet Node old-k8s-version-628218 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 7m54s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 7m47s kubelet Node old-k8s-version-628218 status is now: NodeReady
Normal Starting 7m45s kube-proxy Starting kube-proxy.
Normal Starting 5m56s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m55s (x8 over 5m56s) kubelet Node old-k8s-version-628218 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m55s (x8 over 5m56s) kubelet Node old-k8s-version-628218 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m55s (x7 over 5m56s) kubelet Node old-k8s-version-628218 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m55s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m39s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000942] FS-Cache: O-key=[8] 'af4c5c0100000000'
[ +0.000634] FS-Cache: N-cookie c=000000c1 [p=000000b7 fl=2 nc=0 na=1]
[ +0.000840] FS-Cache: N-cookie d=000000001fa0ac4c{9p.inode} n=000000004a89f134
[ +0.000967] FS-Cache: N-key=[8] 'af4c5c0100000000'
[ +2.536818] FS-Cache: Duplicate cookie detected
[ +0.000636] FS-Cache: O-cookie c=000000b8 [p=000000b7 fl=226 nc=0 na=1]
[ +0.000866] FS-Cache: O-cookie d=000000001fa0ac4c{9p.inode} n=00000000119c755f
[ +0.000933] FS-Cache: O-key=[8] 'ae4c5c0100000000'
[ +0.000688] FS-Cache: N-cookie c=000000c3 [p=000000b7 fl=2 nc=0 na=1]
[ +0.000848] FS-Cache: N-cookie d=000000001fa0ac4c{9p.inode} n=000000003639bcff
[ +0.001014] FS-Cache: N-key=[8] 'ae4c5c0100000000'
[ +0.274572] FS-Cache: Duplicate cookie detected
[ +0.000636] FS-Cache: O-cookie c=000000bd [p=000000b7 fl=226 nc=0 na=1]
[ +0.000869] FS-Cache: O-cookie d=000000001fa0ac4c{9p.inode} n=00000000c295f653
[ +0.000953] FS-Cache: O-key=[8] 'b44c5c0100000000'
[ +0.000636] FS-Cache: N-cookie c=000000c4 [p=000000b7 fl=2 nc=0 na=1]
[ +0.000880] FS-Cache: N-cookie d=000000001fa0ac4c{9p.inode} n=00000000b2af4765
[ +0.000944] FS-Cache: N-key=[8] 'b44c5c0100000000'
[ +2.756995] FS-Cache: Duplicate cookie detected
[ +0.000753] FS-Cache: O-cookie c=000000c7 [p=00000002 fl=222 nc=0 na=1]
[ +0.000967] FS-Cache: O-cookie d=00000000eccdcd65{9P.session} n=000000006eb17d48
[ +0.001045] FS-Cache: O-key=[10] '34333132353035343034'
[ +0.000696] FS-Cache: N-cookie c=000000c8 [p=00000002 fl=2 nc=0 na=1]
[ +0.000861] FS-Cache: N-cookie d=00000000eccdcd65{9P.session} n=00000000dba80f05
[ +0.000967] FS-Cache: N-key=[10] '34333132353035343034'
==> etcd [cb79833ef66834cddc4c8aa73ebb5d899ac9bf1ca03e023bb8cc835970bd7a80] <==
2024-08-05 12:27:03.769736 I | embed: listening for peers on 192.168.85.2:2380
raft2024/08/05 12:27:03 INFO: 9f0758e1c58a86ed switched to configuration voters=(11459225503572592365)
2024-08-05 12:27:03.770353 I | etcdserver/membership: added member 9f0758e1c58a86ed [https://192.168.85.2:2380] to cluster 68eaea490fab4e05
raft2024/08/05 12:27:04 INFO: 9f0758e1c58a86ed is starting a new election at term 1
raft2024/08/05 12:27:04 INFO: 9f0758e1c58a86ed became candidate at term 2
raft2024/08/05 12:27:04 INFO: 9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2
raft2024/08/05 12:27:04 INFO: 9f0758e1c58a86ed became leader at term 2
raft2024/08/05 12:27:04 INFO: raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2
2024-08-05 12:27:04.019250 I | etcdserver: setting up the initial cluster version to 3.4
2024-08-05 12:27:04.020619 N | etcdserver/membership: set the initial cluster version to 3.4
2024-08-05 12:27:04.020831 I | etcdserver/api: enabled capabilities for version 3.4
2024-08-05 12:27:04.020969 I | etcdserver: published {Name:old-k8s-version-628218 ClientURLs:[https://192.168.85.2:2379]} to cluster 68eaea490fab4e05
2024-08-05 12:27:04.021188 I | embed: ready to serve client requests
2024-08-05 12:27:04.021414 I | embed: ready to serve client requests
2024-08-05 12:27:04.043702 I | embed: serving client requests on 192.168.85.2:2379
2024-08-05 12:27:04.046887 I | embed: serving client requests on 127.0.0.1:2379
2024-08-05 12:27:26.726078 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:27:32.472920 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:27:42.472612 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:27:52.472881 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:28:02.472952 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:28:12.472754 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:28:22.472921 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:28:32.472736 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:28:42.472791 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [fc5593e0a311c4edb26ac47b996d6217f34a1b0217ceb94d9e21dd25e21e53a4] <==
2024-08-05 12:31:13.880544 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:31:23.880522 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:31:33.880435 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:31:43.880606 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:31:53.880582 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:32:03.880339 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:32:13.880427 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:32:23.880425 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:32:33.880538 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:32:43.880399 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:32:53.880468 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:33:03.880676 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:33:13.880486 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:33:23.880499 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:33:33.880574 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:33:43.880443 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:33:53.880488 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:34:03.880393 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:34:13.880535 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:34:23.880453 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:34:33.880606 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:34:43.880481 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:34:53.880543 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:35:03.882407 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 12:35:13.880583 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
12:35:16 up 20:17, 0 users, load average: 0.55, 1.68, 2.21
Linux old-k8s-version-628218 5.15.0-1066-aws #72~20.04.1-Ubuntu SMP Sat Jul 20 07:44:07 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [3a48910e06110ae02c128be9c2e75b0359c0f6d5b1d8a5a3e228123d153ce298] <==
E0805 12:27:49.302582 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
W0805 12:27:50.316559 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0805 12:27:50.316602 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
W0805 12:27:51.103761 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0805 12:27:51.103799 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0805 12:27:53.390396 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 12:27:53.390433 1 main.go:299] handling current node
I0805 12:28:03.390156 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 12:28:03.390199 1 main.go:299] handling current node
W0805 12:28:04.084561 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0805 12:28:04.084635 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
W0805 12:28:10.870515 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0805 12:28:10.870555 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
W0805 12:28:12.594507 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0805 12:28:12.594565 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0805 12:28:13.391002 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 12:28:13.391050 1 main.go:299] handling current node
I0805 12:28:23.390917 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 12:28:23.390955 1 main.go:299] handling current node
I0805 12:28:33.389988 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 12:28:33.390025 1 main.go:299] handling current node
W0805 12:28:36.601325 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0805 12:28:36.601363 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0805 12:28:43.390027 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 12:28:43.390067 1 main.go:299] handling current node
==> kindnet [6abdebaafdd0f48350b41babf057972779046beacd70845b0894694eba1254f2] <==
E0805 12:33:52.026137 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0805 12:33:57.191143 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 12:33:57.191183 1 main.go:299] handling current node
I0805 12:34:07.190845 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 12:34:07.190884 1 main.go:299] handling current node
I0805 12:34:17.190580 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 12:34:17.190618 1 main.go:299] handling current node
W0805 12:34:23.287086 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0805 12:34:23.287149 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0805 12:34:27.191013 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 12:34:27.191048 1 main.go:299] handling current node
W0805 12:34:28.598620 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0805 12:34:28.598656 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0805 12:34:37.190975 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 12:34:37.191139 1 main.go:299] handling current node
W0805 12:34:41.376269 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0805 12:34:41.376365 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0805 12:34:47.190700 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 12:34:47.190739 1 main.go:299] handling current node
I0805 12:34:57.192129 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 12:34:57.192222 1 main.go:299] handling current node
I0805 12:35:07.190875 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 12:35:07.190998 1 main.go:299] handling current node
W0805 12:35:10.579670 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0805 12:35:10.579705 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
==> kube-apiserver [9d027ed91112d33dc082a5ea6f24f63f8af0a2ece264023d5a9c65c9045fb314] <==
I0805 12:32:01.091554 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 12:32:01.091586 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0805 12:32:32.726280 1 client.go:360] parsed scheme: "passthrough"
I0805 12:32:32.726339 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 12:32:32.726348 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0805 12:32:36.782121 1 handler_proxy.go:102] no RequestInfo found in the context
E0805 12:32:36.782238 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0805 12:32:36.782255 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0805 12:33:08.580949 1 client.go:360] parsed scheme: "passthrough"
I0805 12:33:08.581051 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 12:33:08.581080 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0805 12:33:43.117925 1 client.go:360] parsed scheme: "passthrough"
I0805 12:33:43.117974 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 12:33:43.117983 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0805 12:34:26.318116 1 client.go:360] parsed scheme: "passthrough"
I0805 12:34:26.318163 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 12:34:26.318201 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0805 12:34:34.121266 1 handler_proxy.go:102] no RequestInfo found in the context
E0805 12:34:34.121332 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0805 12:34:34.121340 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0805 12:35:10.478967 1 client.go:360] parsed scheme: "passthrough"
I0805 12:35:10.479015 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 12:35:10.479026 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [c57b337ca22f3da57a9a16c10bab53bd21ba60b658216f543ec77c7c261d76d0] <==
I0805 12:27:10.937531 1 shared_informer.go:247] Caches are synced for crd-autoregister
I0805 12:27:10.969894 1 shared_informer.go:247] Caches are synced for node_authorizer
I0805 12:27:11.597995 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0805 12:27:11.598027 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0805 12:27:11.632865 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0805 12:27:11.636614 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0805 12:27:11.636650 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0805 12:27:12.090742 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0805 12:27:12.149039 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0805 12:27:12.297263 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
I0805 12:27:12.299281 1 controller.go:606] quota admission added evaluator for: endpoints
I0805 12:27:12.303734 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0805 12:27:13.227463 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0805 12:27:13.609747 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0805 12:27:13.679831 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0805 12:27:22.118265 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0805 12:27:29.840014 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0805 12:27:30.035712 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0805 12:27:39.714574 1 client.go:360] parsed scheme: "passthrough"
I0805 12:27:39.714622 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 12:27:39.714657 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0805 12:28:22.162374 1 client.go:360] parsed scheme: "passthrough"
I0805 12:28:22.162418 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 12:28:22.162428 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
E0805 12:28:52.014913 1 available_controller.go:508] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again
==> kube-controller-manager [1520cc7f0130657302bb29ef6e58b4d1572d9cefc349039b32f44bc842874834] <==
E0805 12:30:55.078060 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 12:30:57.905977 1 request.go:655] Throttling request took 1.048628676s, request: GET:https://192.168.85.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
W0805 12:30:58.757522 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 12:31:25.579840 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 12:31:30.407944 1 request.go:655] Throttling request took 1.048322642s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0805 12:31:31.259304 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 12:31:56.081866 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 12:32:02.909912 1 request.go:655] Throttling request took 1.048393122s, request: GET:https://192.168.85.2:8443/apis/rbac.authorization.k8s.io/v1?timeout=32s
W0805 12:32:03.761393 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 12:32:26.583719 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 12:32:35.461973 1 request.go:655] Throttling request took 1.047935244s, request: GET:https://192.168.85.2:8443/apis/policy/v1beta1?timeout=32s
W0805 12:32:36.263480 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 12:32:57.086149 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 12:33:07.914024 1 request.go:655] Throttling request took 1.048362965s, request: GET:https://192.168.85.2:8443/apis/coordination.k8s.io/v1?timeout=32s
W0805 12:33:08.765445 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 12:33:27.587943 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 12:33:40.415918 1 request.go:655] Throttling request took 1.048198295s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0805 12:33:41.267501 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 12:33:58.089882 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 12:34:12.918063 1 request.go:655] Throttling request took 1.048420462s, request: GET:https://192.168.85.2:8443/apis/scheduling.k8s.io/v1beta1?timeout=32s
W0805 12:34:13.769807 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 12:34:28.591793 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 12:34:45.420211 1 request.go:655] Throttling request took 1.045190909s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0805 12:34:46.272208 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 12:34:59.094938 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
==> kube-controller-manager [ebe0210d2958f3fd3a26d3ca59083ac59c13e1ec92612ca8962604e2fde9e6f9] <==
I0805 12:27:29.952981 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-7sbx8"
I0805 12:27:29.953011 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-6lls2"
I0805 12:27:29.975407 1 shared_informer.go:247] Caches are synced for taint
I0805 12:27:29.975632 1 node_lifecycle_controller.go:1429] Initializing eviction metric for zone:
W0805 12:27:29.975687 1 node_lifecycle_controller.go:1044] Missing timestamp for Node old-k8s-version-628218. Assuming now as a timestamp.
I0805 12:27:29.975719 1 node_lifecycle_controller.go:1245] Controller detected that zone is now in state Normal.
I0805 12:27:29.976554 1 taint_manager.go:187] Starting NoExecuteTaintManager
I0805 12:27:29.976877 1 event.go:291] "Event occurred" object="old-k8s-version-628218" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-628218 event: Registered Node old-k8s-version-628218 in Controller"
I0805 12:27:29.999717 1 shared_informer.go:247] Caches are synced for disruption
I0805 12:27:29.999735 1 disruption.go:339] Sending events to api server.
I0805 12:27:30.002808 1 shared_informer.go:247] Caches are synced for resource quota
I0805 12:27:30.029863 1 shared_informer.go:247] Caches are synced for deployment
I0805 12:27:30.068154 1 shared_informer.go:247] Caches are synced for ReplicaSet
I0805 12:27:30.080372 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
I0805 12:27:30.096398 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-qftmh"
I0805 12:27:30.132528 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-879s2"
I0805 12:27:30.180441 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0805 12:27:30.260899 1 shared_informer.go:240] Waiting for caches to sync for resource quota
I0805 12:27:30.260935 1 shared_informer.go:247] Caches are synced for resource quota
I0805 12:27:30.457274 1 shared_informer.go:247] Caches are synced for garbage collector
I0805 12:27:30.457296 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0805 12:27:30.480961 1 shared_informer.go:247] Caches are synced for garbage collector
I0805 12:27:31.383677 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0805 12:27:31.396818 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-qftmh"
I0805 12:28:51.748051 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
==> kube-proxy [7d92baabf40f37efdaf5f9a0ea099e97d5b9d67ab0c5057b0c2da9047637454b] <==
I0805 12:27:31.011904 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0805 12:27:31.012107 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0805 12:27:31.074636 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0805 12:27:31.074744 1 server_others.go:185] Using iptables Proxier.
I0805 12:27:31.074967 1 server.go:650] Version: v1.20.0
I0805 12:27:31.075514 1 config.go:315] Starting service config controller
I0805 12:27:31.075524 1 shared_informer.go:240] Waiting for caches to sync for service config
I0805 12:27:31.077716 1 config.go:224] Starting endpoint slice config controller
I0805 12:27:31.077730 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0805 12:27:31.175647 1 shared_informer.go:247] Caches are synced for service config
I0805 12:27:31.177849 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-proxy [db3f6af771289732d5839bbcfb2bfaf22499949eeebfa4d8704c5ad09201ad7f] <==
I0805 12:29:36.914105 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0805 12:29:36.914199 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0805 12:29:37.018333 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0805 12:29:37.018648 1 server_others.go:185] Using iptables Proxier.
I0805 12:29:37.019190 1 server.go:650] Version: v1.20.0
I0805 12:29:37.020283 1 config.go:315] Starting service config controller
I0805 12:29:37.020570 1 shared_informer.go:240] Waiting for caches to sync for service config
I0805 12:29:37.023017 1 config.go:224] Starting endpoint slice config controller
I0805 12:29:37.023274 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0805 12:29:37.123496 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0805 12:29:37.124201 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [4e9e6aad998c20b415ab501ad4ebf77382e0735f38873fbccc09b8238df675e4] <==
I0805 12:29:26.107716 1 serving.go:331] Generated self-signed cert in-memory
W0805 12:29:33.036158 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0805 12:29:33.036202 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0805 12:29:33.036212 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0805 12:29:33.036217 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0805 12:29:33.497261 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0805 12:29:33.500792 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0805 12:29:33.500811 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0805 12:29:33.501266 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0805 12:29:33.715123 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [b0f295274cc0dc24801c47922225033790a049a64a2da070072638a1a5783324] <==
I0805 12:27:06.453048 1 serving.go:331] Generated self-signed cert in-memory
W0805 12:27:10.750586 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0805 12:27:10.751406 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0805 12:27:10.751556 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0805 12:27:10.751681 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0805 12:27:10.810185 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0805 12:27:10.814070 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0805 12:27:10.814862 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0805 12:27:10.815022 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0805 12:27:10.830078 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0805 12:27:10.831124 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0805 12:27:10.832735 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0805 12:27:10.832984 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0805 12:27:10.833261 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0805 12:27:10.833639 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0805 12:27:10.834978 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0805 12:27:10.835376 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0805 12:27:10.835615 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0805 12:27:10.836528 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0805 12:27:10.838059 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0805 12:27:10.838699 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0805 12:27:11.667197 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0805 12:27:11.672098 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0805 12:27:11.862188 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
I0805 12:27:12.315452 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Aug 05 12:33:27 old-k8s-version-628218 kubelet[662]: E0805 12:33:27.051058 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
Aug 05 12:33:32 old-k8s-version-628218 kubelet[662]: E0805 12:33:32.049949 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 12:33:39 old-k8s-version-628218 kubelet[662]: I0805 12:33:39.049373 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ff5632cf38cbc6e995ffc99b208888bdd45970ae4cd22b0898de86e7308b4fff
Aug 05 12:33:39 old-k8s-version-628218 kubelet[662]: E0805 12:33:39.051084 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
Aug 05 12:33:45 old-k8s-version-628218 kubelet[662]: E0805 12:33:45.053788 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 12:33:54 old-k8s-version-628218 kubelet[662]: I0805 12:33:54.049074 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ff5632cf38cbc6e995ffc99b208888bdd45970ae4cd22b0898de86e7308b4fff
Aug 05 12:33:54 old-k8s-version-628218 kubelet[662]: E0805 12:33:54.049443 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
Aug 05 12:33:58 old-k8s-version-628218 kubelet[662]: E0805 12:33:58.049767 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 12:34:09 old-k8s-version-628218 kubelet[662]: I0805 12:34:09.049881 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ff5632cf38cbc6e995ffc99b208888bdd45970ae4cd22b0898de86e7308b4fff
Aug 05 12:34:09 old-k8s-version-628218 kubelet[662]: E0805 12:34:09.050774 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
Aug 05 12:34:12 old-k8s-version-628218 kubelet[662]: E0805 12:34:12.050180 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 12:34:20 old-k8s-version-628218 kubelet[662]: I0805 12:34:20.049017 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ff5632cf38cbc6e995ffc99b208888bdd45970ae4cd22b0898de86e7308b4fff
Aug 05 12:34:20 old-k8s-version-628218 kubelet[662]: E0805 12:34:20.049373 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
Aug 05 12:34:27 old-k8s-version-628218 kubelet[662]: E0805 12:34:27.049948 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 12:34:33 old-k8s-version-628218 kubelet[662]: I0805 12:34:33.050410 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ff5632cf38cbc6e995ffc99b208888bdd45970ae4cd22b0898de86e7308b4fff
Aug 05 12:34:33 old-k8s-version-628218 kubelet[662]: E0805 12:34:33.050830 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
Aug 05 12:34:39 old-k8s-version-628218 kubelet[662]: E0805 12:34:39.050798 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 12:34:47 old-k8s-version-628218 kubelet[662]: I0805 12:34:47.049192 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ff5632cf38cbc6e995ffc99b208888bdd45970ae4cd22b0898de86e7308b4fff
Aug 05 12:34:47 old-k8s-version-628218 kubelet[662]: E0805 12:34:47.050116 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
Aug 05 12:34:52 old-k8s-version-628218 kubelet[662]: E0805 12:34:52.049768 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 12:35:02 old-k8s-version-628218 kubelet[662]: I0805 12:35:02.049034 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ff5632cf38cbc6e995ffc99b208888bdd45970ae4cd22b0898de86e7308b4fff
Aug 05 12:35:02 old-k8s-version-628218 kubelet[662]: E0805 12:35:02.049419 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
Aug 05 12:35:05 old-k8s-version-628218 kubelet[662]: E0805 12:35:05.053692 662 pod_workers.go:191] Error syncing pod 21c2e3f4-1538-40bf-8587-9ab36ab8265c ("metrics-server-9975d5f86-l7dqv_kube-system(21c2e3f4-1538-40bf-8587-9ab36ab8265c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 12:35:13 old-k8s-version-628218 kubelet[662]: I0805 12:35:13.049022 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ff5632cf38cbc6e995ffc99b208888bdd45970ae4cd22b0898de86e7308b4fff
Aug 05 12:35:13 old-k8s-version-628218 kubelet[662]: E0805 12:35:13.049879 662 pod_workers.go:191] Error syncing pod fe6dba0d-0b0b-4d03-a430-df79436328a7 ("dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5ftcd_kubernetes-dashboard(fe6dba0d-0b0b-4d03-a430-df79436328a7)"
==> kubernetes-dashboard [505644f5a96f3c69382ed44085987497e61cce3698d7ed213d9fef18b1de9a03] <==
2024/08/05 12:30:04 Using namespace: kubernetes-dashboard
2024/08/05 12:30:04 Using in-cluster config to connect to apiserver
2024/08/05 12:30:04 Using secret token for csrf signing
2024/08/05 12:30:04 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/08/05 12:30:04 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/08/05 12:30:04 Successful initial request to the apiserver, version: v1.20.0
2024/08/05 12:30:04 Generating JWE encryption key
2024/08/05 12:30:04 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/08/05 12:30:04 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/08/05 12:30:04 Initializing JWE encryption key from synchronized object
2024/08/05 12:30:05 Creating in-cluster Sidecar client
2024/08/05 12:30:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 12:30:05 Serving insecurely on HTTP port: 9090
2024/08/05 12:30:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 12:31:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 12:31:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 12:32:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 12:32:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 12:33:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 12:33:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 12:34:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 12:34:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 12:35:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 12:30:04 Starting overwatch
==> storage-provisioner [9256f116f633efac70a5c047632a53fe479bb5daa0f8c1c913b2d146080322b7] <==
I0805 12:30:23.169056 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0805 12:30:23.182606 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0805 12:30:23.182799 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0805 12:30:40.657509 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0805 12:30:40.660446 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-628218_16de067e-a279-48b6-8e52-7205a1ef8399!
I0805 12:30:40.660466 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"cddc9f5e-fc22-4ddd-8aea-904d076998f2", APIVersion:"v1", ResourceVersion:"840", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-628218_16de067e-a279-48b6-8e52-7205a1ef8399 became leader
I0805 12:30:40.761635 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-628218_16de067e-a279-48b6-8e52-7205a1ef8399!
==> storage-provisioner [a8b821ffe6b918edfd2170a30e9fcd75c26fa0825e5cb49a3ad44b5c0374ae0e] <==
I0805 12:29:36.522399 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0805 12:30:06.523982 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-628218 -n old-k8s-version-628218
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-628218 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-l7dqv
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-628218 describe pod metrics-server-9975d5f86-l7dqv
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-628218 describe pod metrics-server-9975d5f86-l7dqv: exit status 1 (133.787381ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-l7dqv" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-628218 describe pod metrics-server-9975d5f86-l7dqv: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (374.43s)