=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-375611 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-375611 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m16.537159183s)
-- stdout --
* [old-k8s-version-375611] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19373
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19373-295474/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19373-295474/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
* Using the docker driver based on existing profile
* Starting "old-k8s-version-375611" primary control-plane node in "old-k8s-version-375611" cluster
* Pulling base image v0.0.44-1721902582-19326 ...
* Restarting existing docker container for "old-k8s-version-375611" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
* Verifying Kubernetes components...
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-375611 addons enable metrics-server
* Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
-- /stdout --
** stderr **
I0805 23:41:21.978628 507478 out.go:291] Setting OutFile to fd 1 ...
I0805 23:41:21.978852 507478 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 23:41:21.978880 507478 out.go:304] Setting ErrFile to fd 2...
I0805 23:41:21.978898 507478 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 23:41:21.979150 507478 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19373-295474/.minikube/bin
I0805 23:41:21.979558 507478 out.go:298] Setting JSON to false
I0805 23:41:21.980594 507478 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":12221,"bootTime":1722889061,"procs":203,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0805 23:41:21.980685 507478 start.go:139] virtualization:
I0805 23:41:21.984065 507478 out.go:177] * [old-k8s-version-375611] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0805 23:41:21.985716 507478 out.go:177] - MINIKUBE_LOCATION=19373
I0805 23:41:21.985781 507478 notify.go:220] Checking for updates...
I0805 23:41:21.989453 507478 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0805 23:41:21.992826 507478 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19373-295474/kubeconfig
I0805 23:41:21.994957 507478 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19373-295474/.minikube
I0805 23:41:21.996443 507478 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0805 23:41:21.998134 507478 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0805 23:41:22.003212 507478 config.go:182] Loaded profile config "old-k8s-version-375611": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0805 23:41:22.005685 507478 out.go:177] * Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
I0805 23:41:22.007960 507478 driver.go:392] Setting default libvirt URI to qemu:///system
I0805 23:41:22.048882 507478 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0805 23:41:22.048998 507478 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0805 23:41:22.141661 507478 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:49 OomKillDisable:true NGoroutines:68 SystemTime:2024-08-05 23:41:22.126519798 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0805 23:41:22.141770 507478 docker.go:307] overlay module found
I0805 23:41:22.143686 507478 out.go:177] * Using the docker driver based on existing profile
I0805 23:41:22.145195 507478 start.go:297] selected driver: docker
I0805 23:41:22.145209 507478 start.go:901] validating driver "docker" against &{Name:old-k8s-version-375611 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-375611 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0805 23:41:22.145332 507478 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0805 23:41:22.145896 507478 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0805 23:41:22.230612 507478 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:49 OomKillDisable:true NGoroutines:68 SystemTime:2024-08-05 23:41:22.221458954 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0805 23:41:22.230960 507478 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0805 23:41:22.230981 507478 cni.go:84] Creating CNI manager for ""
I0805 23:41:22.230989 507478 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0805 23:41:22.231032 507478 start.go:340] cluster config:
{Name:old-k8s-version-375611 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-375611 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0805 23:41:22.233074 507478 out.go:177] * Starting "old-k8s-version-375611" primary control-plane node in "old-k8s-version-375611" cluster
I0805 23:41:22.234717 507478 cache.go:121] Beginning downloading kic base image for docker with containerd
I0805 23:41:22.236320 507478 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0805 23:41:22.237894 507478 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0805 23:41:22.237960 507478 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19373-295474/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0805 23:41:22.237972 507478 cache.go:56] Caching tarball of preloaded images
I0805 23:41:22.238049 507478 preload.go:172] Found /home/jenkins/minikube-integration/19373-295474/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0805 23:41:22.238058 507478 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0805 23:41:22.238169 507478 profile.go:143] Saving config to /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/old-k8s-version-375611/config.json ...
I0805 23:41:22.238388 507478 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
W0805 23:41:22.259636 507478 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
I0805 23:41:22.259653 507478 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0805 23:41:22.259720 507478 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0805 23:41:22.259741 507478 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0805 23:41:22.259745 507478 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0805 23:41:22.259752 507478 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0805 23:41:22.259758 507478 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0805 23:41:22.401140 507478 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0805 23:41:22.401179 507478 cache.go:194] Successfully downloaded all kic artifacts
I0805 23:41:22.401209 507478 start.go:360] acquireMachinesLock for old-k8s-version-375611: {Name:mk10f0dd2bbb7e734c61da3b6695a69df06e65c9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0805 23:41:22.401273 507478 start.go:364] duration metric: took 38.663µs to acquireMachinesLock for "old-k8s-version-375611"
I0805 23:41:22.401294 507478 start.go:96] Skipping create...Using existing machine configuration
I0805 23:41:22.401300 507478 fix.go:54] fixHost starting:
I0805 23:41:22.401573 507478 cli_runner.go:164] Run: docker container inspect old-k8s-version-375611 --format={{.State.Status}}
I0805 23:41:22.420849 507478 fix.go:112] recreateIfNeeded on old-k8s-version-375611: state=Stopped err=<nil>
W0805 23:41:22.420876 507478 fix.go:138] unexpected machine state, will restart: <nil>
I0805 23:41:22.423241 507478 out.go:177] * Restarting existing docker container for "old-k8s-version-375611" ...
I0805 23:41:22.424849 507478 cli_runner.go:164] Run: docker start old-k8s-version-375611
I0805 23:41:22.804274 507478 cli_runner.go:164] Run: docker container inspect old-k8s-version-375611 --format={{.State.Status}}
I0805 23:41:22.856769 507478 kic.go:430] container "old-k8s-version-375611" state is running.
I0805 23:41:22.857202 507478 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-375611
I0805 23:41:22.889891 507478 profile.go:143] Saving config to /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/old-k8s-version-375611/config.json ...
I0805 23:41:22.890137 507478 machine.go:94] provisionDockerMachine start ...
I0805 23:41:22.890201 507478 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-375611
I0805 23:41:22.913200 507478 main.go:141] libmachine: Using SSH client type: native
I0805 23:41:22.913469 507478 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33433 <nil> <nil>}
I0805 23:41:22.913477 507478 main.go:141] libmachine: About to run SSH command:
hostname
I0805 23:41:22.914337 507478 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0805 23:41:26.051033 507478 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-375611
I0805 23:41:26.051060 507478 ubuntu.go:169] provisioning hostname "old-k8s-version-375611"
I0805 23:41:26.051124 507478 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-375611
I0805 23:41:26.076280 507478 main.go:141] libmachine: Using SSH client type: native
I0805 23:41:26.076518 507478 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33433 <nil> <nil>}
I0805 23:41:26.076530 507478 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-375611 && echo "old-k8s-version-375611" | sudo tee /etc/hostname
I0805 23:41:26.226581 507478 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-375611
I0805 23:41:26.226688 507478 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-375611
I0805 23:41:26.261319 507478 main.go:141] libmachine: Using SSH client type: native
I0805 23:41:26.261570 507478 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33433 <nil> <nil>}
I0805 23:41:26.261614 507478 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-375611' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-375611/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-375611' | sudo tee -a /etc/hosts;
fi
fi
I0805 23:41:26.395211 507478 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0805 23:41:26.395244 507478 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19373-295474/.minikube CaCertPath:/home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19373-295474/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19373-295474/.minikube}
I0805 23:41:26.395327 507478 ubuntu.go:177] setting up certificates
I0805 23:41:26.395337 507478 provision.go:84] configureAuth start
I0805 23:41:26.395428 507478 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-375611
I0805 23:41:26.417983 507478 provision.go:143] copyHostCerts
I0805 23:41:26.418054 507478 exec_runner.go:144] found /home/jenkins/minikube-integration/19373-295474/.minikube/ca.pem, removing ...
I0805 23:41:26.418067 507478 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19373-295474/.minikube/ca.pem
I0805 23:41:26.418144 507478 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19373-295474/.minikube/ca.pem (1078 bytes)
I0805 23:41:26.418268 507478 exec_runner.go:144] found /home/jenkins/minikube-integration/19373-295474/.minikube/cert.pem, removing ...
I0805 23:41:26.418290 507478 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19373-295474/.minikube/cert.pem
I0805 23:41:26.418324 507478 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19373-295474/.minikube/cert.pem (1123 bytes)
I0805 23:41:26.418383 507478 exec_runner.go:144] found /home/jenkins/minikube-integration/19373-295474/.minikube/key.pem, removing ...
I0805 23:41:26.418395 507478 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19373-295474/.minikube/key.pem
I0805 23:41:26.418423 507478 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19373-295474/.minikube/key.pem (1679 bytes)
I0805 23:41:26.418475 507478 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19373-295474/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-375611 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-375611]
I0805 23:41:26.953453 507478 provision.go:177] copyRemoteCerts
I0805 23:41:26.953537 507478 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0805 23:41:26.953589 507478 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-375611
I0805 23:41:26.983944 507478 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33433 SSHKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/old-k8s-version-375611/id_rsa Username:docker}
I0805 23:41:27.081405 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0805 23:41:27.109693 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0805 23:41:27.137259 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0805 23:41:27.164136 507478 provision.go:87] duration metric: took 768.779871ms to configureAuth
I0805 23:41:27.164178 507478 ubuntu.go:193] setting minikube options for container-runtime
I0805 23:41:27.164395 507478 config.go:182] Loaded profile config "old-k8s-version-375611": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0805 23:41:27.164410 507478 machine.go:97] duration metric: took 4.274265003s to provisionDockerMachine
I0805 23:41:27.164418 507478 start.go:293] postStartSetup for "old-k8s-version-375611" (driver="docker")
I0805 23:41:27.164433 507478 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0805 23:41:27.164488 507478 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0805 23:41:27.164530 507478 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-375611
I0805 23:41:27.208983 507478 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33433 SSHKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/old-k8s-version-375611/id_rsa Username:docker}
I0805 23:41:27.307632 507478 ssh_runner.go:195] Run: cat /etc/os-release
I0805 23:41:27.312395 507478 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0805 23:41:27.312452 507478 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0805 23:41:27.312468 507478 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0805 23:41:27.312484 507478 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0805 23:41:27.312495 507478 filesync.go:126] Scanning /home/jenkins/minikube-integration/19373-295474/.minikube/addons for local assets ...
I0805 23:41:27.312557 507478 filesync.go:126] Scanning /home/jenkins/minikube-integration/19373-295474/.minikube/files for local assets ...
I0805 23:41:27.312682 507478 filesync.go:149] local asset: /home/jenkins/minikube-integration/19373-295474/.minikube/files/etc/ssl/certs/3008692.pem -> 3008692.pem in /etc/ssl/certs
I0805 23:41:27.312821 507478 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0805 23:41:27.325066 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/files/etc/ssl/certs/3008692.pem --> /etc/ssl/certs/3008692.pem (1708 bytes)
I0805 23:41:27.359394 507478 start.go:296] duration metric: took 194.955703ms for postStartSetup
I0805 23:41:27.359556 507478 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0805 23:41:27.359663 507478 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-375611
I0805 23:41:27.384516 507478 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33433 SSHKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/old-k8s-version-375611/id_rsa Username:docker}
I0805 23:41:27.480860 507478 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0805 23:41:27.485782 507478 fix.go:56] duration metric: took 5.084474279s for fixHost
I0805 23:41:27.485811 507478 start.go:83] releasing machines lock for "old-k8s-version-375611", held for 5.084527497s
I0805 23:41:27.485878 507478 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-375611
I0805 23:41:27.506101 507478 ssh_runner.go:195] Run: cat /version.json
I0805 23:41:27.506151 507478 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-375611
I0805 23:41:27.506181 507478 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0805 23:41:27.506251 507478 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-375611
I0805 23:41:27.546092 507478 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33433 SSHKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/old-k8s-version-375611/id_rsa Username:docker}
I0805 23:41:27.551352 507478 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33433 SSHKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/old-k8s-version-375611/id_rsa Username:docker}
I0805 23:41:27.653119 507478 ssh_runner.go:195] Run: systemctl --version
I0805 23:41:27.813655 507478 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0805 23:41:27.820104 507478 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0805 23:41:27.839401 507478 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0805 23:41:27.839534 507478 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0805 23:41:27.849882 507478 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0805 23:41:27.849918 507478 start.go:495] detecting cgroup driver to use...
I0805 23:41:27.849951 507478 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0805 23:41:27.850011 507478 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0805 23:41:27.865399 507478 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0805 23:41:27.879093 507478 docker.go:217] disabling cri-docker service (if available) ...
I0805 23:41:27.879162 507478 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0805 23:41:27.893860 507478 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0805 23:41:27.906770 507478 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0805 23:41:28.045028 507478 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0805 23:41:28.179902 507478 docker.go:233] disabling docker service ...
I0805 23:41:28.180017 507478 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0805 23:41:28.209004 507478 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0805 23:41:28.228423 507478 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0805 23:41:28.356853 507478 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0805 23:41:28.460565 507478 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0805 23:41:28.473075 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0805 23:41:28.490752 507478 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0805 23:41:28.502058 507478 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0805 23:41:28.512491 507478 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0805 23:41:28.512559 507478 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0805 23:41:28.522845 507478 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0805 23:41:28.533257 507478 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0805 23:41:28.543868 507478 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0805 23:41:28.554187 507478 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0805 23:41:28.563772 507478 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0805 23:41:28.574192 507478 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0805 23:41:28.583616 507478 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0805 23:41:28.592804 507478 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0805 23:41:28.714461 507478 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0805 23:41:28.962758 507478 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0805 23:41:28.962880 507478 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0805 23:41:28.970789 507478 start.go:563] Will wait 60s for crictl version
I0805 23:41:28.970914 507478 ssh_runner.go:195] Run: which crictl
I0805 23:41:28.975312 507478 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0805 23:41:29.038258 507478 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.19
RuntimeApiVersion: v1
I0805 23:41:29.038382 507478 ssh_runner.go:195] Run: containerd --version
I0805 23:41:29.065527 507478 ssh_runner.go:195] Run: containerd --version
I0805 23:41:29.096953 507478 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
I0805 23:41:29.098857 507478 cli_runner.go:164] Run: docker network inspect old-k8s-version-375611 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0805 23:41:29.123888 507478 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0805 23:41:29.127953 507478 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0805 23:41:29.142094 507478 kubeadm.go:883] updating cluster {Name:old-k8s-version-375611 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-375611 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0805 23:41:29.142208 507478 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0805 23:41:29.142280 507478 ssh_runner.go:195] Run: sudo crictl images --output json
I0805 23:41:29.189544 507478 containerd.go:627] all images are preloaded for containerd runtime.
I0805 23:41:29.189565 507478 containerd.go:534] Images already preloaded, skipping extraction
I0805 23:41:29.189623 507478 ssh_runner.go:195] Run: sudo crictl images --output json
I0805 23:41:29.234685 507478 containerd.go:627] all images are preloaded for containerd runtime.
I0805 23:41:29.234754 507478 cache_images.go:84] Images are preloaded, skipping loading
I0805 23:41:29.234776 507478 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.20.0 containerd true true} ...
I0805 23:41:29.234932 507478 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-375611 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-375611 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0805 23:41:29.235029 507478 ssh_runner.go:195] Run: sudo crictl info
I0805 23:41:29.280961 507478 cni.go:84] Creating CNI manager for ""
I0805 23:41:29.280980 507478 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0805 23:41:29.280989 507478 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0805 23:41:29.281009 507478 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-375611 NodeName:old-k8s-version-375611 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0805 23:41:29.281139 507478 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-375611"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0805 23:41:29.281203 507478 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0805 23:41:29.291153 507478 binaries.go:44] Found k8s binaries, skipping transfer
I0805 23:41:29.291311 507478 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0805 23:41:29.300920 507478 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0805 23:41:29.323569 507478 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0805 23:41:29.343095 507478 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0805 23:41:29.363975 507478 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0805 23:41:29.367834 507478 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0805 23:41:29.379117 507478 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0805 23:41:29.492493 507478 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0805 23:41:29.511406 507478 certs.go:68] Setting up /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/old-k8s-version-375611 for IP: 192.168.85.2
I0805 23:41:29.511431 507478 certs.go:194] generating shared ca certs ...
I0805 23:41:29.511454 507478 certs.go:226] acquiring lock for ca certs: {Name:mk408d7b8fa372609a5c7cd4ef69cc7a591c2d2a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 23:41:29.511596 507478 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19373-295474/.minikube/ca.key
I0805 23:41:29.511648 507478 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19373-295474/.minikube/proxy-client-ca.key
I0805 23:41:29.511660 507478 certs.go:256] generating profile certs ...
I0805 23:41:29.511772 507478 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/old-k8s-version-375611/client.key
I0805 23:41:29.511832 507478 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/old-k8s-version-375611/apiserver.key.a1d1b7b0
I0805 23:41:29.511875 507478 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/old-k8s-version-375611/proxy-client.key
I0805 23:41:29.511995 507478 certs.go:484] found cert: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/300869.pem (1338 bytes)
W0805 23:41:29.512029 507478 certs.go:480] ignoring /home/jenkins/minikube-integration/19373-295474/.minikube/certs/300869_empty.pem, impossibly tiny 0 bytes
I0805 23:41:29.512041 507478 certs.go:484] found cert: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca-key.pem (1679 bytes)
I0805 23:41:29.512066 507478 certs.go:484] found cert: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca.pem (1078 bytes)
I0805 23:41:29.512091 507478 certs.go:484] found cert: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/cert.pem (1123 bytes)
I0805 23:41:29.512117 507478 certs.go:484] found cert: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/key.pem (1679 bytes)
I0805 23:41:29.512163 507478 certs.go:484] found cert: /home/jenkins/minikube-integration/19373-295474/.minikube/files/etc/ssl/certs/3008692.pem (1708 bytes)
I0805 23:41:29.512824 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0805 23:41:29.543642 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0805 23:41:29.570245 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0805 23:41:29.598042 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0805 23:41:29.643833 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/old-k8s-version-375611/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0805 23:41:29.722091 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/old-k8s-version-375611/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0805 23:41:29.763347 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/old-k8s-version-375611/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0805 23:41:29.801962 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/old-k8s-version-375611/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0805 23:41:29.832678 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/files/etc/ssl/certs/3008692.pem --> /usr/share/ca-certificates/3008692.pem (1708 bytes)
I0805 23:41:29.869147 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0805 23:41:29.895409 507478 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/certs/300869.pem --> /usr/share/ca-certificates/300869.pem (1338 bytes)
I0805 23:41:29.921322 507478 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0805 23:41:29.945390 507478 ssh_runner.go:195] Run: openssl version
I0805 23:41:29.950799 507478 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0805 23:41:29.961014 507478 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0805 23:41:29.964730 507478 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 5 22:49 /usr/share/ca-certificates/minikubeCA.pem
I0805 23:41:29.964819 507478 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0805 23:41:29.972592 507478 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0805 23:41:29.982727 507478 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/300869.pem && ln -fs /usr/share/ca-certificates/300869.pem /etc/ssl/certs/300869.pem"
I0805 23:41:29.994054 507478 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/300869.pem
I0805 23:41:29.997563 507478 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 5 23:00 /usr/share/ca-certificates/300869.pem
I0805 23:41:29.997645 507478 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/300869.pem
I0805 23:41:30.007692 507478 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/300869.pem /etc/ssl/certs/51391683.0"
I0805 23:41:30.044341 507478 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3008692.pem && ln -fs /usr/share/ca-certificates/3008692.pem /etc/ssl/certs/3008692.pem"
I0805 23:41:30.057277 507478 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3008692.pem
I0805 23:41:30.062190 507478 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 5 23:00 /usr/share/ca-certificates/3008692.pem
I0805 23:41:30.062325 507478 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3008692.pem
I0805 23:41:30.070885 507478 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3008692.pem /etc/ssl/certs/3ec20f2e.0"
I0805 23:41:30.081666 507478 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0805 23:41:30.086415 507478 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0805 23:41:30.094600 507478 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0805 23:41:30.103428 507478 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0805 23:41:30.112052 507478 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0805 23:41:30.120571 507478 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0805 23:41:30.128730 507478 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0805 23:41:30.136685 507478 kubeadm.go:392] StartCluster: {Name:old-k8s-version-375611 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-375611 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0805 23:41:30.136846 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0805 23:41:30.136923 507478 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0805 23:41:30.188675 507478 cri.go:89] found id: "6064aa025609bb6d981e24f1c08cf4fc365902e17c5e558d538e6910a7f12728"
I0805 23:41:30.188709 507478 cri.go:89] found id: "a6fb77f7718de46e631aaa130f88714ab2e52f578f3fab363700a1a3dd05d055"
I0805 23:41:30.188715 507478 cri.go:89] found id: "41cf79dd5f1310161781ecef777def36b1c177fb874e28de5d8fef142c0487da"
I0805 23:41:30.188718 507478 cri.go:89] found id: "f0a58f073f5c7bc4f777cc7a18e11f853b1f72c4bf017997a3961d1d4be66f9a"
I0805 23:41:30.188721 507478 cri.go:89] found id: "2a47927d464e133242dacb82b11fb63a8e3e384ee3265d3b5929e64ec31c8b2d"
I0805 23:41:30.188725 507478 cri.go:89] found id: "6fde48373a0e71e9ae888db24d7116069eff729936107f8a14b69f87f46ae620"
I0805 23:41:30.188729 507478 cri.go:89] found id: "5cf8d64c50fe281293e3e52f57b92667c5e8e2e65e7d3ce6796012a33141f207"
I0805 23:41:30.188732 507478 cri.go:89] found id: "9591fcf9ec50f9c0dc47d7cf116b4bc84f0890bf85707a0eaa905012b906f848"
I0805 23:41:30.188736 507478 cri.go:89] found id: "b1b8743da3a076d6a5f3ed1c16dbf583bd9eb6f2908f11daae833fe8e843cfdf"
I0805 23:41:30.188742 507478 cri.go:89] found id: ""
I0805 23:41:30.188813 507478 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0805 23:41:30.202356 507478 cri.go:116] JSON = null
W0805 23:41:30.202463 507478 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 9
I0805 23:41:30.202560 507478 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0805 23:41:30.212509 507478 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0805 23:41:30.212531 507478 kubeadm.go:593] restartPrimaryControlPlane start ...
I0805 23:41:30.212585 507478 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0805 23:41:30.221578 507478 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0805 23:41:30.222059 507478 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-375611" does not appear in /home/jenkins/minikube-integration/19373-295474/kubeconfig
I0805 23:41:30.222176 507478 kubeconfig.go:62] /home/jenkins/minikube-integration/19373-295474/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-375611" cluster setting kubeconfig missing "old-k8s-version-375611" context setting]
I0805 23:41:30.222485 507478 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19373-295474/kubeconfig: {Name:mk274f42d75cc39b0473102f9d6f817c10421355 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 23:41:30.223919 507478 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0805 23:41:30.233555 507478 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2
I0805 23:41:30.233635 507478 kubeadm.go:597] duration metric: took 21.097088ms to restartPrimaryControlPlane
I0805 23:41:30.233653 507478 kubeadm.go:394] duration metric: took 96.990063ms to StartCluster
I0805 23:41:30.233671 507478 settings.go:142] acquiring lock: {Name:mk65e51c523ded2f25e5f03b5b2deaa9f12d12a5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 23:41:30.233749 507478 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19373-295474/kubeconfig
I0805 23:41:30.234553 507478 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19373-295474/kubeconfig: {Name:mk274f42d75cc39b0473102f9d6f817c10421355 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 23:41:30.234783 507478 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0805 23:41:30.235198 507478 config.go:182] Loaded profile config "old-k8s-version-375611": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0805 23:41:30.235283 507478 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0805 23:41:30.235401 507478 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-375611"
I0805 23:41:30.235428 507478 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-375611"
W0805 23:41:30.235438 507478 addons.go:243] addon storage-provisioner should already be in state true
I0805 23:41:30.235474 507478 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-375611"
I0805 23:41:30.235495 507478 addons.go:69] Setting dashboard=true in profile "old-k8s-version-375611"
I0805 23:41:30.235519 507478 addons.go:234] Setting addon dashboard=true in "old-k8s-version-375611"
W0805 23:41:30.235529 507478 addons.go:243] addon dashboard should already be in state true
I0805 23:41:30.235546 507478 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-375611"
I0805 23:41:30.235553 507478 host.go:66] Checking if "old-k8s-version-375611" exists ...
I0805 23:41:30.236113 507478 cli_runner.go:164] Run: docker container inspect old-k8s-version-375611 --format={{.State.Status}}
I0805 23:41:30.236458 507478 cli_runner.go:164] Run: docker container inspect old-k8s-version-375611 --format={{.State.Status}}
I0805 23:41:30.235487 507478 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-375611"
I0805 23:41:30.236668 507478 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-375611"
W0805 23:41:30.236679 507478 addons.go:243] addon metrics-server should already be in state true
I0805 23:41:30.236712 507478 host.go:66] Checking if "old-k8s-version-375611" exists ...
I0805 23:41:30.237277 507478 cli_runner.go:164] Run: docker container inspect old-k8s-version-375611 --format={{.State.Status}}
I0805 23:41:30.235479 507478 host.go:66] Checking if "old-k8s-version-375611" exists ...
I0805 23:41:30.238114 507478 cli_runner.go:164] Run: docker container inspect old-k8s-version-375611 --format={{.State.Status}}
I0805 23:41:30.241842 507478 out.go:177] * Verifying Kubernetes components...
I0805 23:41:30.248683 507478 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0805 23:41:30.308356 507478 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0805 23:41:30.311621 507478 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0805 23:41:30.311657 507478 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0805 23:41:30.311746 507478 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-375611
I0805 23:41:30.320230 507478 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-375611"
W0805 23:41:30.320250 507478 addons.go:243] addon default-storageclass should already be in state true
I0805 23:41:30.320277 507478 host.go:66] Checking if "old-k8s-version-375611" exists ...
I0805 23:41:30.320673 507478 cli_runner.go:164] Run: docker container inspect old-k8s-version-375611 --format={{.State.Status}}
I0805 23:41:30.327614 507478 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0805 23:41:30.334358 507478 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0805 23:41:30.334387 507478 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0805 23:41:30.334458 507478 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-375611
I0805 23:41:30.334609 507478 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0805 23:41:30.336401 507478 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0805 23:41:30.339338 507478 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0805 23:41:30.339369 507478 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0805 23:41:30.339447 507478 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-375611
I0805 23:41:30.367548 507478 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0805 23:41:30.367569 507478 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0805 23:41:30.367630 507478 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-375611
I0805 23:41:30.375151 507478 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33433 SSHKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/old-k8s-version-375611/id_rsa Username:docker}
I0805 23:41:30.421959 507478 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33433 SSHKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/old-k8s-version-375611/id_rsa Username:docker}
I0805 23:41:30.429680 507478 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33433 SSHKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/old-k8s-version-375611/id_rsa Username:docker}
I0805 23:41:30.440113 507478 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33433 SSHKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/old-k8s-version-375611/id_rsa Username:docker}
I0805 23:41:30.509737 507478 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0805 23:41:30.556393 507478 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-375611" to be "Ready" ...
I0805 23:41:30.611838 507478 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0805 23:41:30.611923 507478 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0805 23:41:30.670815 507478 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0805 23:41:30.670896 507478 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0805 23:41:30.690633 507478 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0805 23:41:30.690660 507478 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0805 23:41:30.728214 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0805 23:41:30.730393 507478 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0805 23:41:30.730452 507478 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0805 23:41:30.733109 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0805 23:41:30.767876 507478 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0805 23:41:30.767956 507478 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0805 23:41:30.803817 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0805 23:41:30.852392 507478 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0805 23:41:30.852475 507478 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0805 23:41:31.034999 507478 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0805 23:41:31.035076 507478 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0805 23:41:31.124100 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 23:41:31.124289 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:31.124344 507478 retry.go:31] will retry after 229.72384ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:31.124320 507478 retry.go:31] will retry after 350.331652ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 23:41:31.124152 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:31.124447 507478 retry.go:31] will retry after 151.646035ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:31.132720 507478 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0805 23:41:31.132797 507478 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0805 23:41:31.159194 507478 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0805 23:41:31.159310 507478 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0805 23:41:31.188537 507478 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0805 23:41:31.188612 507478 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0805 23:41:31.222494 507478 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0805 23:41:31.222566 507478 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0805 23:41:31.250596 507478 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0805 23:41:31.250674 507478 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0805 23:41:31.277176 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0805 23:41:31.290034 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0805 23:41:31.354340 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0805 23:41:31.475879 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0805 23:41:31.543811 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:31.543888 507478 retry.go:31] will retry after 501.629883ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 23:41:31.588750 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:31.588831 507478 retry.go:31] will retry after 137.603345ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 23:41:31.664715 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:31.664810 507478 retry.go:31] will retry after 387.460984ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:31.727111 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0805 23:41:31.756568 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:31.756656 507478 retry.go:31] will retry after 241.594041ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 23:41:31.880641 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:31.880722 507478 retry.go:31] will retry after 547.858604ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:31.998422 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0805 23:41:32.045936 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0805 23:41:32.053443 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0805 23:41:32.167720 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:32.167758 507478 retry.go:31] will retry after 472.404398ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 23:41:32.298697 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:32.298731 507478 retry.go:31] will retry after 668.068115ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 23:41:32.312962 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:32.313003 507478 retry.go:31] will retry after 669.240426ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:32.429205 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0805 23:41:32.546367 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:32.546401 507478 retry.go:31] will retry after 721.388933ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:32.557866 507478 node_ready.go:53] error getting node "old-k8s-version-375611": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-375611": dial tcp 192.168.85.2:8443: connect: connection refused
I0805 23:41:32.641145 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0805 23:41:32.784889 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:32.784923 507478 retry.go:31] will retry after 982.458881ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:32.967389 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0805 23:41:32.982882 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0805 23:41:33.177244 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:33.177284 507478 retry.go:31] will retry after 716.289998ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 23:41:33.209697 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:33.209755 507478 retry.go:31] will retry after 423.072235ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:33.268998 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0805 23:41:33.382297 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:33.382342 507478 retry.go:31] will retry after 751.59762ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:33.633249 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0805 23:41:33.767765 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0805 23:41:33.776995 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:33.777047 507478 retry.go:31] will retry after 1.489306746s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:33.894385 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0805 23:41:33.939920 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:33.939972 507478 retry.go:31] will retry after 826.557027ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 23:41:33.994515 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:33.994563 507478 retry.go:31] will retry after 958.455328ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:34.134441 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0805 23:41:34.249512 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:34.249558 507478 retry.go:31] will retry after 1.886601052s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:34.766780 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0805 23:41:34.902519 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:34.902555 507478 retry.go:31] will retry after 1.586412444s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:34.953874 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0805 23:41:35.057636 507478 node_ready.go:53] error getting node "old-k8s-version-375611": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-375611": dial tcp 192.168.85.2:8443: connect: connection refused
W0805 23:41:35.075708 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:35.075741 507478 retry.go:31] will retry after 2.772908572s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:35.267123 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0805 23:41:35.390555 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:35.390592 507478 retry.go:31] will retry after 1.882018706s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:36.137368 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0805 23:41:36.239541 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:36.239571 507478 retry.go:31] will retry after 1.12958667s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:36.490086 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0805 23:41:36.606350 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:36.606379 507478 retry.go:31] will retry after 3.756043049s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:37.272824 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0805 23:41:37.370152 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0805 23:41:37.375681 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:37.375711 507478 retry.go:31] will retry after 3.237953072s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0805 23:41:37.487963 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:37.487991 507478 retry.go:31] will retry after 1.950026602s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:37.557529 507478 node_ready.go:53] error getting node "old-k8s-version-375611": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-375611": dial tcp 192.168.85.2:8443: connect: connection refused
I0805 23:41:37.848845 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0805 23:41:37.951327 507478 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:37.951361 507478 retry.go:31] will retry after 3.823566326s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0805 23:41:39.438805 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0805 23:41:40.363359 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0805 23:41:40.614000 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0805 23:41:41.775742 507478 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0805 23:41:49.557427 507478 node_ready.go:53] error getting node "old-k8s-version-375611": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-375611": net/http: TLS handshake timeout
I0805 23:41:50.236403 507478 node_ready.go:49] node "old-k8s-version-375611" has status "Ready":"True"
I0805 23:41:50.236437 507478 node_ready.go:38] duration metric: took 19.679944448s for node "old-k8s-version-375611" to be "Ready" ...
I0805 23:41:50.236447 507478 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0805 23:41:50.304678 507478 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-z2bp2" in "kube-system" namespace to be "Ready" ...
I0805 23:41:50.415430 507478 pod_ready.go:92] pod "coredns-74ff55c5b-z2bp2" in "kube-system" namespace has status "Ready":"True"
I0805 23:41:50.415455 507478 pod_ready.go:81] duration metric: took 110.745178ms for pod "coredns-74ff55c5b-z2bp2" in "kube-system" namespace to be "Ready" ...
I0805 23:41:50.415467 507478 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-375611" in "kube-system" namespace to be "Ready" ...
I0805 23:41:50.458206 507478 pod_ready.go:92] pod "etcd-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"True"
I0805 23:41:50.458247 507478 pod_ready.go:81] duration metric: took 42.771521ms for pod "etcd-old-k8s-version-375611" in "kube-system" namespace to be "Ready" ...
I0805 23:41:50.458263 507478 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-375611" in "kube-system" namespace to be "Ready" ...
I0805 23:41:50.505391 507478 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"True"
I0805 23:41:50.505423 507478 pod_ready.go:81] duration metric: took 47.148115ms for pod "kube-apiserver-old-k8s-version-375611" in "kube-system" namespace to be "Ready" ...
I0805 23:41:50.505441 507478 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace to be "Ready" ...
I0805 23:41:51.538776 507478 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (12.099917756s)
I0805 23:41:51.539065 507478 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (11.175675664s)
I0805 23:41:51.539148 507478 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.925110662s)
I0805 23:41:51.539188 507478 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-375611"
I0805 23:41:51.539241 507478 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (9.763477827s)
I0805 23:41:51.541786 507478 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-375611 addons enable metrics-server
I0805 23:41:51.550758 507478 out.go:177] * Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
I0805 23:41:51.553689 507478 addons.go:510] duration metric: took 21.318402161s for enable addons: enabled=[storage-provisioner metrics-server dashboard default-storageclass]
I0805 23:41:52.513033 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:41:55.023850 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:41:57.511386 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:41:59.512669 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:01.512864 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:04.019702 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:06.025691 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:08.512084 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:10.512850 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:12.512913 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:15.017851 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:17.515939 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:20.020888 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:22.512978 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:25.015347 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:27.511530 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:29.512841 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:32.014914 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:34.016311 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:36.017219 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:38.019435 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:40.512707 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:43.016331 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:45.027576 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:47.516971 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:50.114521 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:52.512933 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:54.514049 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:57.015099 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:42:59.512546 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:02.015987 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:04.033962 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:06.511810 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:08.512679 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:11.015168 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:13.021318 507478 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:14.512958 507478 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"True"
I0805 23:43:14.512984 507478 pod_ready.go:81] duration metric: took 1m24.007534536s for pod "kube-controller-manager-old-k8s-version-375611" in "kube-system" namespace to be "Ready" ...
I0805 23:43:14.512997 507478 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-q4vrh" in "kube-system" namespace to be "Ready" ...
I0805 23:43:14.518488 507478 pod_ready.go:92] pod "kube-proxy-q4vrh" in "kube-system" namespace has status "Ready":"True"
I0805 23:43:14.518518 507478 pod_ready.go:81] duration metric: took 5.51311ms for pod "kube-proxy-q4vrh" in "kube-system" namespace to be "Ready" ...
I0805 23:43:14.518531 507478 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-375611" in "kube-system" namespace to be "Ready" ...
I0805 23:43:14.524035 507478 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-375611" in "kube-system" namespace has status "Ready":"True"
I0805 23:43:14.524060 507478 pod_ready.go:81] duration metric: took 5.52083ms for pod "kube-scheduler-old-k8s-version-375611" in "kube-system" namespace to be "Ready" ...
I0805 23:43:14.524072 507478 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace to be "Ready" ...
I0805 23:43:16.529819 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:18.530449 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:21.030846 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:23.031623 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:25.530258 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:27.530528 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:30.035531 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:32.537689 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:35.031739 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:37.032491 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:39.034983 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:41.530103 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:43.531858 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:46.030338 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:48.030947 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:50.031443 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:52.530892 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:55.030649 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:57.530278 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:43:59.530803 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:01.532209 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:04.031667 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:06.037123 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:08.531106 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:11.029540 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:13.029751 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:15.035025 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:17.529812 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:19.534184 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:22.030821 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:24.031872 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:26.530596 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:29.031546 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:31.065460 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:33.531187 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:36.030715 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:38.031041 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:40.031895 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:42.530858 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:45.040250 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:47.529865 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:49.530699 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:52.030382 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:54.036743 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:56.530139 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:44:58.530365 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:00.535340 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:03.030825 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:05.030862 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:07.530367 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:10.031237 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:12.530889 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:15.033040 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:17.529225 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:19.530761 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:21.531034 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:24.030137 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:26.030273 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:28.530629 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:31.031184 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:33.031850 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:35.530337 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:37.530415 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:39.531140 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:42.034191 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:44.530828 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:47.030902 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:49.030980 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:51.031210 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:53.531122 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:56.029716 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:45:58.030477 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:00.123960 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:02.531311 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:05.032239 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:07.529902 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:09.530799 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:12.031709 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:14.529787 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:16.530551 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:18.531657 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:21.031522 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:23.531536 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:26.030112 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:28.030526 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:30.033851 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:32.530971 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:35.030630 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:37.032167 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:39.530061 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:41.530204 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:44.030994 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:46.031316 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:48.530915 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:51.031734 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:53.531329 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:56.032134 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:46:58.033645 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:47:00.095807 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:47:02.531049 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:47:05.032264 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:47:07.044069 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:47:09.536713 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:47:12.031857 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:47:14.530963 507478 pod_ready.go:102] pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace has status "Ready":"False"
I0805 23:47:14.530993 507478 pod_ready.go:81] duration metric: took 4m0.006913156s for pod "metrics-server-9975d5f86-jpdq8" in "kube-system" namespace to be "Ready" ...
E0805 23:47:14.531004 507478 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0805 23:47:14.531012 507478 pod_ready.go:38] duration metric: took 5m24.29455512s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0805 23:47:14.531025 507478 api_server.go:52] waiting for apiserver process to appear ...
I0805 23:47:14.531053 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0805 23:47:14.531119 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0805 23:47:14.577975 507478 cri.go:89] found id: "fb4412296d907ebe940afee2bcd959a113ae813b5af39f21c4fd257b8dc9eccc"
I0805 23:47:14.577997 507478 cri.go:89] found id: "b1b8743da3a076d6a5f3ed1c16dbf583bd9eb6f2908f11daae833fe8e843cfdf"
I0805 23:47:14.578002 507478 cri.go:89] found id: ""
I0805 23:47:14.578009 507478 logs.go:276] 2 containers: [fb4412296d907ebe940afee2bcd959a113ae813b5af39f21c4fd257b8dc9eccc b1b8743da3a076d6a5f3ed1c16dbf583bd9eb6f2908f11daae833fe8e843cfdf]
I0805 23:47:14.578071 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.581830 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.585307 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0805 23:47:14.585375 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0805 23:47:14.632364 507478 cri.go:89] found id: "e68c71f7afc0dc37539082c1c20c925d963d28664511ac67f8a6c2e7d3db85fc"
I0805 23:47:14.632383 507478 cri.go:89] found id: "9591fcf9ec50f9c0dc47d7cf116b4bc84f0890bf85707a0eaa905012b906f848"
I0805 23:47:14.632388 507478 cri.go:89] found id: ""
I0805 23:47:14.632397 507478 logs.go:276] 2 containers: [e68c71f7afc0dc37539082c1c20c925d963d28664511ac67f8a6c2e7d3db85fc 9591fcf9ec50f9c0dc47d7cf116b4bc84f0890bf85707a0eaa905012b906f848]
I0805 23:47:14.632450 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.636300 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.641012 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0805 23:47:14.641116 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0805 23:47:14.680900 507478 cri.go:89] found id: "2b39caa6f1085047518aeb7a6117b5a3fc78d5496f8ddfe327efd3a89e20b70c"
I0805 23:47:14.680923 507478 cri.go:89] found id: "a6fb77f7718de46e631aaa130f88714ab2e52f578f3fab363700a1a3dd05d055"
I0805 23:47:14.680927 507478 cri.go:89] found id: ""
I0805 23:47:14.680935 507478 logs.go:276] 2 containers: [2b39caa6f1085047518aeb7a6117b5a3fc78d5496f8ddfe327efd3a89e20b70c a6fb77f7718de46e631aaa130f88714ab2e52f578f3fab363700a1a3dd05d055]
I0805 23:47:14.681017 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.684793 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.688507 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0805 23:47:14.688577 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0805 23:47:14.725691 507478 cri.go:89] found id: "239f2943bc1fa036cffa005d7bc59654ed4aa71550999412ce96d16c5ee24c87"
I0805 23:47:14.725713 507478 cri.go:89] found id: "6fde48373a0e71e9ae888db24d7116069eff729936107f8a14b69f87f46ae620"
I0805 23:47:14.725717 507478 cri.go:89] found id: ""
I0805 23:47:14.725724 507478 logs.go:276] 2 containers: [239f2943bc1fa036cffa005d7bc59654ed4aa71550999412ce96d16c5ee24c87 6fde48373a0e71e9ae888db24d7116069eff729936107f8a14b69f87f46ae620]
I0805 23:47:14.725798 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.729495 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.732894 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0805 23:47:14.732987 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0805 23:47:14.771777 507478 cri.go:89] found id: "4533e7c882251f02335ccb9737a3a4302d3a2e79f479d6d0c81c62f137524de7"
I0805 23:47:14.771801 507478 cri.go:89] found id: "f0a58f073f5c7bc4f777cc7a18e11f853b1f72c4bf017997a3961d1d4be66f9a"
I0805 23:47:14.771806 507478 cri.go:89] found id: ""
I0805 23:47:14.771814 507478 logs.go:276] 2 containers: [4533e7c882251f02335ccb9737a3a4302d3a2e79f479d6d0c81c62f137524de7 f0a58f073f5c7bc4f777cc7a18e11f853b1f72c4bf017997a3961d1d4be66f9a]
I0805 23:47:14.771898 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.775554 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.778877 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0805 23:47:14.778948 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0805 23:47:14.826401 507478 cri.go:89] found id: "b2e5dbb97a8bce87cd5b22a5fb4d35f69eb570ca797a284b2a97e1908b4f01b3"
I0805 23:47:14.826422 507478 cri.go:89] found id: "5cf8d64c50fe281293e3e52f57b92667c5e8e2e65e7d3ce6796012a33141f207"
I0805 23:47:14.826428 507478 cri.go:89] found id: ""
I0805 23:47:14.826435 507478 logs.go:276] 2 containers: [b2e5dbb97a8bce87cd5b22a5fb4d35f69eb570ca797a284b2a97e1908b4f01b3 5cf8d64c50fe281293e3e52f57b92667c5e8e2e65e7d3ce6796012a33141f207]
I0805 23:47:14.826490 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.830180 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.833421 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0805 23:47:14.833536 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0805 23:47:14.874505 507478 cri.go:89] found id: "2735e7564bd9c0c6184f71ef1f354aeccbcfa5d6372704cdf34531f23e66f8c2"
I0805 23:47:14.874527 507478 cri.go:89] found id: "41cf79dd5f1310161781ecef777def36b1c177fb874e28de5d8fef142c0487da"
I0805 23:47:14.874532 507478 cri.go:89] found id: ""
I0805 23:47:14.874539 507478 logs.go:276] 2 containers: [2735e7564bd9c0c6184f71ef1f354aeccbcfa5d6372704cdf34531f23e66f8c2 41cf79dd5f1310161781ecef777def36b1c177fb874e28de5d8fef142c0487da]
I0805 23:47:14.874624 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.878283 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.882920 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0805 23:47:14.883010 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0805 23:47:14.929018 507478 cri.go:89] found id: "156ce89ed6d27a90c91eab334249d8a894d2759a3dd64666b519f2334cea4d83"
I0805 23:47:14.929095 507478 cri.go:89] found id: ""
I0805 23:47:14.929113 507478 logs.go:276] 1 containers: [156ce89ed6d27a90c91eab334249d8a894d2759a3dd64666b519f2334cea4d83]
I0805 23:47:14.929173 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.932547 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0805 23:47:14.932638 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0805 23:47:14.970960 507478 cri.go:89] found id: "7d004de9baf7e1f5fe4d38a3eda0e0394f9fe775247b84a622dee9432f9b3d45"
I0805 23:47:14.970982 507478 cri.go:89] found id: "6064aa025609bb6d981e24f1c08cf4fc365902e17c5e558d538e6910a7f12728"
I0805 23:47:14.970988 507478 cri.go:89] found id: ""
I0805 23:47:14.970997 507478 logs.go:276] 2 containers: [7d004de9baf7e1f5fe4d38a3eda0e0394f9fe775247b84a622dee9432f9b3d45 6064aa025609bb6d981e24f1c08cf4fc365902e17c5e558d538e6910a7f12728]
I0805 23:47:14.971054 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.975113 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:14.978957 507478 logs.go:123] Gathering logs for kube-scheduler [6fde48373a0e71e9ae888db24d7116069eff729936107f8a14b69f87f46ae620] ...
I0805 23:47:14.978985 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6fde48373a0e71e9ae888db24d7116069eff729936107f8a14b69f87f46ae620"
I0805 23:47:15.040839 507478 logs.go:123] Gathering logs for kube-controller-manager [b2e5dbb97a8bce87cd5b22a5fb4d35f69eb570ca797a284b2a97e1908b4f01b3] ...
I0805 23:47:15.040923 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b2e5dbb97a8bce87cd5b22a5fb4d35f69eb570ca797a284b2a97e1908b4f01b3"
I0805 23:47:15.120258 507478 logs.go:123] Gathering logs for kindnet [2735e7564bd9c0c6184f71ef1f354aeccbcfa5d6372704cdf34531f23e66f8c2] ...
I0805 23:47:15.120301 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2735e7564bd9c0c6184f71ef1f354aeccbcfa5d6372704cdf34531f23e66f8c2"
I0805 23:47:15.208879 507478 logs.go:123] Gathering logs for kubelet ...
I0805 23:47:15.208912 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0805 23:47:15.266819 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.228962 664 reflector.go:138] object-"kube-system"/"coredns-token-7zgp7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-7zgp7" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:15.267068 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229084 664 reflector.go:138] object-"kube-system"/"storage-provisioner-token-z4qt7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-z4qt7" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:15.267292 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229143 664 reflector.go:138] object-"default"/"default-token-7hcnm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-7hcnm" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:15.267519 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229195 664 reflector.go:138] object-"kube-system"/"metrics-server-token-f2542": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-f2542" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:15.267729 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229245 664 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:15.267948 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229289 664 reflector.go:138] object-"kube-system"/"kube-proxy-token-q2xzp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-q2xzp" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:15.268164 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229333 664 reflector.go:138] object-"kube-system"/"kindnet-token-xzcsg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-xzcsg" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:15.268366 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229373 664 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:15.281042 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:54 old-k8s-version-375611 kubelet[664]: E0805 23:41:54.235161 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:15.281242 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:54 old-k8s-version-375611 kubelet[664]: E0805 23:41:54.616631 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.284070 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:08 old-k8s-version-375611 kubelet[664]: E0805 23:42:08.270532 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:15.286172 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:15 old-k8s-version-375611 kubelet[664]: E0805 23:42:15.691034 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.286509 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:16 old-k8s-version-375611 kubelet[664]: E0805 23:42:16.695660 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.286841 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:17 old-k8s-version-375611 kubelet[664]: E0805 23:42:17.701301 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.287372 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:21 old-k8s-version-375611 kubelet[664]: E0805 23:42:21.253942 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.288302 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:31 old-k8s-version-375611 kubelet[664]: E0805 23:42:31.743412 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.290762 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:35 old-k8s-version-375611 kubelet[664]: E0805 23:42:35.262616 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:15.291093 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:36 old-k8s-version-375611 kubelet[664]: E0805 23:42:36.850604 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.291284 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:48 old-k8s-version-375611 kubelet[664]: E0805 23:42:48.259531 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.291616 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:50 old-k8s-version-375611 kubelet[664]: E0805 23:42:50.261178 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.291810 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:59 old-k8s-version-375611 kubelet[664]: E0805 23:42:59.254330 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.292412 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:03 old-k8s-version-375611 kubelet[664]: E0805 23:43:03.836002 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.292747 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:06 old-k8s-version-375611 kubelet[664]: E0805 23:43:06.850605 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.292933 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:11 old-k8s-version-375611 kubelet[664]: E0805 23:43:11.254086 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.293266 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:19 old-k8s-version-375611 kubelet[664]: E0805 23:43:19.253663 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.295737 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:24 old-k8s-version-375611 kubelet[664]: E0805 23:43:24.265875 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:15.296072 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:33 old-k8s-version-375611 kubelet[664]: E0805 23:43:33.253770 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.296266 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:39 old-k8s-version-375611 kubelet[664]: E0805 23:43:39.262796 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.296879 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:47 old-k8s-version-375611 kubelet[664]: E0805 23:43:47.949904 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.297072 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:51 old-k8s-version-375611 kubelet[664]: E0805 23:43:51.254061 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.297405 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:56 old-k8s-version-375611 kubelet[664]: E0805 23:43:56.850999 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.297592 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:06 old-k8s-version-375611 kubelet[664]: E0805 23:44:06.253938 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.297922 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:09 old-k8s-version-375611 kubelet[664]: E0805 23:44:09.253682 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.298109 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:17 old-k8s-version-375611 kubelet[664]: E0805 23:44:17.254002 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.298443 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:22 old-k8s-version-375611 kubelet[664]: E0805 23:44:22.253626 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.298631 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:28 old-k8s-version-375611 kubelet[664]: E0805 23:44:28.254408 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.298964 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:37 old-k8s-version-375611 kubelet[664]: E0805 23:44:37.253654 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.299152 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:40 old-k8s-version-375611 kubelet[664]: E0805 23:44:40.257289 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.299490 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:52 old-k8s-version-375611 kubelet[664]: E0805 23:44:52.254219 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.301959 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:54 old-k8s-version-375611 kubelet[664]: E0805 23:44:54.262392 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:15.302295 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:05 old-k8s-version-375611 kubelet[664]: E0805 23:45:05.253597 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.302483 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:06 old-k8s-version-375611 kubelet[664]: E0805 23:45:06.267947 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.302804 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:18 old-k8s-version-375611 kubelet[664]: E0805 23:45:18.279524 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.303296 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:19 old-k8s-version-375611 kubelet[664]: E0805 23:45:19.232909 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.303627 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:26 old-k8s-version-375611 kubelet[664]: E0805 23:45:26.855630 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.303813 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:33 old-k8s-version-375611 kubelet[664]: E0805 23:45:33.254159 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.304145 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:40 old-k8s-version-375611 kubelet[664]: E0805 23:45:40.254168 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.304330 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:48 old-k8s-version-375611 kubelet[664]: E0805 23:45:48.259557 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.304659 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:52 old-k8s-version-375611 kubelet[664]: E0805 23:45:52.253861 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.304844 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:59 old-k8s-version-375611 kubelet[664]: E0805 23:45:59.253981 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.305179 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:06 old-k8s-version-375611 kubelet[664]: E0805 23:46:06.254418 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.305365 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:10 old-k8s-version-375611 kubelet[664]: E0805 23:46:10.254218 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.305695 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:17 old-k8s-version-375611 kubelet[664]: E0805 23:46:17.253633 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.305880 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:25 old-k8s-version-375611 kubelet[664]: E0805 23:46:25.253988 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.306209 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:28 old-k8s-version-375611 kubelet[664]: E0805 23:46:28.254493 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.306393 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:36 old-k8s-version-375611 kubelet[664]: E0805 23:46:36.255023 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.306722 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:42 old-k8s-version-375611 kubelet[664]: E0805 23:46:42.254426 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.306913 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:47 old-k8s-version-375611 kubelet[664]: E0805 23:46:47.253936 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.307243 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:57 old-k8s-version-375611 kubelet[664]: E0805 23:46:57.255244 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:15.307459 507478 logs.go:138] Found kubelet problem: Aug 05 23:47:01 old-k8s-version-375611 kubelet[664]: E0805 23:47:01.254026 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:15.307789 507478 logs.go:138] Found kubelet problem: Aug 05 23:47:10 old-k8s-version-375611 kubelet[664]: E0805 23:47:10.255321 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
I0805 23:47:15.307799 507478 logs.go:123] Gathering logs for dmesg ...
I0805 23:47:15.307813 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0805 23:47:15.325993 507478 logs.go:123] Gathering logs for kube-apiserver [b1b8743da3a076d6a5f3ed1c16dbf583bd9eb6f2908f11daae833fe8e843cfdf] ...
I0805 23:47:15.326026 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b1b8743da3a076d6a5f3ed1c16dbf583bd9eb6f2908f11daae833fe8e843cfdf"
I0805 23:47:15.381927 507478 logs.go:123] Gathering logs for etcd [9591fcf9ec50f9c0dc47d7cf116b4bc84f0890bf85707a0eaa905012b906f848] ...
I0805 23:47:15.381962 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9591fcf9ec50f9c0dc47d7cf116b4bc84f0890bf85707a0eaa905012b906f848"
I0805 23:47:15.432712 507478 logs.go:123] Gathering logs for coredns [2b39caa6f1085047518aeb7a6117b5a3fc78d5496f8ddfe327efd3a89e20b70c] ...
I0805 23:47:15.432741 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2b39caa6f1085047518aeb7a6117b5a3fc78d5496f8ddfe327efd3a89e20b70c"
I0805 23:47:15.472881 507478 logs.go:123] Gathering logs for kindnet [41cf79dd5f1310161781ecef777def36b1c177fb874e28de5d8fef142c0487da] ...
I0805 23:47:15.472955 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 41cf79dd5f1310161781ecef777def36b1c177fb874e28de5d8fef142c0487da"
I0805 23:47:15.524477 507478 logs.go:123] Gathering logs for storage-provisioner [7d004de9baf7e1f5fe4d38a3eda0e0394f9fe775247b84a622dee9432f9b3d45] ...
I0805 23:47:15.524511 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7d004de9baf7e1f5fe4d38a3eda0e0394f9fe775247b84a622dee9432f9b3d45"
I0805 23:47:15.568029 507478 logs.go:123] Gathering logs for container status ...
I0805 23:47:15.568057 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0805 23:47:15.636581 507478 logs.go:123] Gathering logs for kube-apiserver [fb4412296d907ebe940afee2bcd959a113ae813b5af39f21c4fd257b8dc9eccc] ...
I0805 23:47:15.636612 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb4412296d907ebe940afee2bcd959a113ae813b5af39f21c4fd257b8dc9eccc"
I0805 23:47:15.721068 507478 logs.go:123] Gathering logs for etcd [e68c71f7afc0dc37539082c1c20c925d963d28664511ac67f8a6c2e7d3db85fc] ...
I0805 23:47:15.721104 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e68c71f7afc0dc37539082c1c20c925d963d28664511ac67f8a6c2e7d3db85fc"
I0805 23:47:15.766133 507478 logs.go:123] Gathering logs for kube-proxy [f0a58f073f5c7bc4f777cc7a18e11f853b1f72c4bf017997a3961d1d4be66f9a] ...
I0805 23:47:15.766164 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f0a58f073f5c7bc4f777cc7a18e11f853b1f72c4bf017997a3961d1d4be66f9a"
I0805 23:47:15.811917 507478 logs.go:123] Gathering logs for containerd ...
I0805 23:47:15.811955 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0805 23:47:15.874341 507478 logs.go:123] Gathering logs for describe nodes ...
I0805 23:47:15.874378 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0805 23:47:16.090693 507478 logs.go:123] Gathering logs for kube-scheduler [239f2943bc1fa036cffa005d7bc59654ed4aa71550999412ce96d16c5ee24c87] ...
I0805 23:47:16.090774 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 239f2943bc1fa036cffa005d7bc59654ed4aa71550999412ce96d16c5ee24c87"
I0805 23:47:16.142960 507478 logs.go:123] Gathering logs for coredns [a6fb77f7718de46e631aaa130f88714ab2e52f578f3fab363700a1a3dd05d055] ...
I0805 23:47:16.142992 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a6fb77f7718de46e631aaa130f88714ab2e52f578f3fab363700a1a3dd05d055"
I0805 23:47:16.183454 507478 logs.go:123] Gathering logs for kube-proxy [4533e7c882251f02335ccb9737a3a4302d3a2e79f479d6d0c81c62f137524de7] ...
I0805 23:47:16.183486 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4533e7c882251f02335ccb9737a3a4302d3a2e79f479d6d0c81c62f137524de7"
I0805 23:47:16.226028 507478 logs.go:123] Gathering logs for kube-controller-manager [5cf8d64c50fe281293e3e52f57b92667c5e8e2e65e7d3ce6796012a33141f207] ...
I0805 23:47:16.226057 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5cf8d64c50fe281293e3e52f57b92667c5e8e2e65e7d3ce6796012a33141f207"
I0805 23:47:16.288367 507478 logs.go:123] Gathering logs for kubernetes-dashboard [156ce89ed6d27a90c91eab334249d8a894d2759a3dd64666b519f2334cea4d83] ...
I0805 23:47:16.288402 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 156ce89ed6d27a90c91eab334249d8a894d2759a3dd64666b519f2334cea4d83"
I0805 23:47:16.334751 507478 logs.go:123] Gathering logs for storage-provisioner [6064aa025609bb6d981e24f1c08cf4fc365902e17c5e558d538e6910a7f12728] ...
I0805 23:47:16.334796 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6064aa025609bb6d981e24f1c08cf4fc365902e17c5e558d538e6910a7f12728"
I0805 23:47:16.388742 507478 out.go:304] Setting ErrFile to fd 2...
I0805 23:47:16.388768 507478 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0805 23:47:16.388824 507478 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0805 23:47:16.388835 507478 out.go:239] Aug 05 23:46:42 old-k8s-version-375611 kubelet[664]: E0805 23:46:42.254426 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
Aug 05 23:46:42 old-k8s-version-375611 kubelet[664]: E0805 23:46:42.254426 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:16.388863 507478 out.go:239] Aug 05 23:46:47 old-k8s-version-375611 kubelet[664]: E0805 23:46:47.253936 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 23:46:47 old-k8s-version-375611 kubelet[664]: E0805 23:46:47.253936 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:16.388873 507478 out.go:239] Aug 05 23:46:57 old-k8s-version-375611 kubelet[664]: E0805 23:46:57.255244 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
Aug 05 23:46:57 old-k8s-version-375611 kubelet[664]: E0805 23:46:57.255244 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:16.388886 507478 out.go:239] Aug 05 23:47:01 old-k8s-version-375611 kubelet[664]: E0805 23:47:01.254026 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 23:47:01 old-k8s-version-375611 kubelet[664]: E0805 23:47:01.254026 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:16.388892 507478 out.go:239] Aug 05 23:47:10 old-k8s-version-375611 kubelet[664]: E0805 23:47:10.255321 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
Aug 05 23:47:10 old-k8s-version-375611 kubelet[664]: E0805 23:47:10.255321 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
I0805 23:47:16.388901 507478 out.go:304] Setting ErrFile to fd 2...
I0805 23:47:16.388907 507478 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 23:47:26.390235 507478 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0805 23:47:26.404620 507478 api_server.go:72] duration metric: took 5m56.169789618s to wait for apiserver process to appear ...
I0805 23:47:26.404646 507478 api_server.go:88] waiting for apiserver healthz status ...
I0805 23:47:26.404680 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0805 23:47:26.404741 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0805 23:47:26.450749 507478 cri.go:89] found id: "fb4412296d907ebe940afee2bcd959a113ae813b5af39f21c4fd257b8dc9eccc"
I0805 23:47:26.450770 507478 cri.go:89] found id: "b1b8743da3a076d6a5f3ed1c16dbf583bd9eb6f2908f11daae833fe8e843cfdf"
I0805 23:47:26.450774 507478 cri.go:89] found id: ""
I0805 23:47:26.450781 507478 logs.go:276] 2 containers: [fb4412296d907ebe940afee2bcd959a113ae813b5af39f21c4fd257b8dc9eccc b1b8743da3a076d6a5f3ed1c16dbf583bd9eb6f2908f11daae833fe8e843cfdf]
I0805 23:47:26.450840 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.454853 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.458431 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0805 23:47:26.458506 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0805 23:47:26.501105 507478 cri.go:89] found id: "e68c71f7afc0dc37539082c1c20c925d963d28664511ac67f8a6c2e7d3db85fc"
I0805 23:47:26.501127 507478 cri.go:89] found id: "9591fcf9ec50f9c0dc47d7cf116b4bc84f0890bf85707a0eaa905012b906f848"
I0805 23:47:26.501132 507478 cri.go:89] found id: ""
I0805 23:47:26.501138 507478 logs.go:276] 2 containers: [e68c71f7afc0dc37539082c1c20c925d963d28664511ac67f8a6c2e7d3db85fc 9591fcf9ec50f9c0dc47d7cf116b4bc84f0890bf85707a0eaa905012b906f848]
I0805 23:47:26.501193 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.505303 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.509562 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0805 23:47:26.509632 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0805 23:47:26.561939 507478 cri.go:89] found id: "2b39caa6f1085047518aeb7a6117b5a3fc78d5496f8ddfe327efd3a89e20b70c"
I0805 23:47:26.561958 507478 cri.go:89] found id: "a6fb77f7718de46e631aaa130f88714ab2e52f578f3fab363700a1a3dd05d055"
I0805 23:47:26.561963 507478 cri.go:89] found id: ""
I0805 23:47:26.561970 507478 logs.go:276] 2 containers: [2b39caa6f1085047518aeb7a6117b5a3fc78d5496f8ddfe327efd3a89e20b70c a6fb77f7718de46e631aaa130f88714ab2e52f578f3fab363700a1a3dd05d055]
I0805 23:47:26.562030 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.566190 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.570104 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0805 23:47:26.570224 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0805 23:47:26.625569 507478 cri.go:89] found id: "239f2943bc1fa036cffa005d7bc59654ed4aa71550999412ce96d16c5ee24c87"
I0805 23:47:26.625588 507478 cri.go:89] found id: "6fde48373a0e71e9ae888db24d7116069eff729936107f8a14b69f87f46ae620"
I0805 23:47:26.625593 507478 cri.go:89] found id: ""
I0805 23:47:26.625600 507478 logs.go:276] 2 containers: [239f2943bc1fa036cffa005d7bc59654ed4aa71550999412ce96d16c5ee24c87 6fde48373a0e71e9ae888db24d7116069eff729936107f8a14b69f87f46ae620]
I0805 23:47:26.625656 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.630618 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.634786 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0805 23:47:26.634862 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0805 23:47:26.691402 507478 cri.go:89] found id: "4533e7c882251f02335ccb9737a3a4302d3a2e79f479d6d0c81c62f137524de7"
I0805 23:47:26.691474 507478 cri.go:89] found id: "f0a58f073f5c7bc4f777cc7a18e11f853b1f72c4bf017997a3961d1d4be66f9a"
I0805 23:47:26.691492 507478 cri.go:89] found id: ""
I0805 23:47:26.691510 507478 logs.go:276] 2 containers: [4533e7c882251f02335ccb9737a3a4302d3a2e79f479d6d0c81c62f137524de7 f0a58f073f5c7bc4f777cc7a18e11f853b1f72c4bf017997a3961d1d4be66f9a]
I0805 23:47:26.691579 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.695402 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.698832 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0805 23:47:26.698902 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0805 23:47:26.764117 507478 cri.go:89] found id: "b2e5dbb97a8bce87cd5b22a5fb4d35f69eb570ca797a284b2a97e1908b4f01b3"
I0805 23:47:26.764253 507478 cri.go:89] found id: "5cf8d64c50fe281293e3e52f57b92667c5e8e2e65e7d3ce6796012a33141f207"
I0805 23:47:26.764275 507478 cri.go:89] found id: ""
I0805 23:47:26.764296 507478 logs.go:276] 2 containers: [b2e5dbb97a8bce87cd5b22a5fb4d35f69eb570ca797a284b2a97e1908b4f01b3 5cf8d64c50fe281293e3e52f57b92667c5e8e2e65e7d3ce6796012a33141f207]
I0805 23:47:26.764385 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.768478 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.773341 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0805 23:47:26.773413 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0805 23:47:26.839288 507478 cri.go:89] found id: "2735e7564bd9c0c6184f71ef1f354aeccbcfa5d6372704cdf34531f23e66f8c2"
I0805 23:47:26.839351 507478 cri.go:89] found id: "41cf79dd5f1310161781ecef777def36b1c177fb874e28de5d8fef142c0487da"
I0805 23:47:26.839368 507478 cri.go:89] found id: ""
I0805 23:47:26.839385 507478 logs.go:276] 2 containers: [2735e7564bd9c0c6184f71ef1f354aeccbcfa5d6372704cdf34531f23e66f8c2 41cf79dd5f1310161781ecef777def36b1c177fb874e28de5d8fef142c0487da]
I0805 23:47:26.839467 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.843332 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.847533 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0805 23:47:26.847650 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0805 23:47:26.895920 507478 cri.go:89] found id: "156ce89ed6d27a90c91eab334249d8a894d2759a3dd64666b519f2334cea4d83"
I0805 23:47:26.895997 507478 cri.go:89] found id: ""
I0805 23:47:26.896017 507478 logs.go:276] 1 containers: [156ce89ed6d27a90c91eab334249d8a894d2759a3dd64666b519f2334cea4d83]
I0805 23:47:26.896109 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.903891 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0805 23:47:26.904019 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0805 23:47:26.950198 507478 cri.go:89] found id: "7d004de9baf7e1f5fe4d38a3eda0e0394f9fe775247b84a622dee9432f9b3d45"
I0805 23:47:26.950273 507478 cri.go:89] found id: "6064aa025609bb6d981e24f1c08cf4fc365902e17c5e558d538e6910a7f12728"
I0805 23:47:26.950291 507478 cri.go:89] found id: ""
I0805 23:47:26.950312 507478 logs.go:276] 2 containers: [7d004de9baf7e1f5fe4d38a3eda0e0394f9fe775247b84a622dee9432f9b3d45 6064aa025609bb6d981e24f1c08cf4fc365902e17c5e558d538e6910a7f12728]
I0805 23:47:26.950397 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.954566 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.958256 507478 logs.go:123] Gathering logs for kube-apiserver [b1b8743da3a076d6a5f3ed1c16dbf583bd9eb6f2908f11daae833fe8e843cfdf] ...
I0805 23:47:26.958283 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b1b8743da3a076d6a5f3ed1c16dbf583bd9eb6f2908f11daae833fe8e843cfdf"
I0805 23:47:27.055331 507478 logs.go:123] Gathering logs for etcd [9591fcf9ec50f9c0dc47d7cf116b4bc84f0890bf85707a0eaa905012b906f848] ...
I0805 23:47:27.055367 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9591fcf9ec50f9c0dc47d7cf116b4bc84f0890bf85707a0eaa905012b906f848"
I0805 23:47:27.105647 507478 logs.go:123] Gathering logs for kube-scheduler [239f2943bc1fa036cffa005d7bc59654ed4aa71550999412ce96d16c5ee24c87] ...
I0805 23:47:27.105674 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 239f2943bc1fa036cffa005d7bc59654ed4aa71550999412ce96d16c5ee24c87"
I0805 23:47:27.161669 507478 logs.go:123] Gathering logs for kube-proxy [f0a58f073f5c7bc4f777cc7a18e11f853b1f72c4bf017997a3961d1d4be66f9a] ...
I0805 23:47:27.161698 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f0a58f073f5c7bc4f777cc7a18e11f853b1f72c4bf017997a3961d1d4be66f9a"
I0805 23:47:27.218662 507478 logs.go:123] Gathering logs for kindnet [41cf79dd5f1310161781ecef777def36b1c177fb874e28de5d8fef142c0487da] ...
I0805 23:47:27.218691 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 41cf79dd5f1310161781ecef777def36b1c177fb874e28de5d8fef142c0487da"
I0805 23:47:27.290432 507478 logs.go:123] Gathering logs for kubernetes-dashboard [156ce89ed6d27a90c91eab334249d8a894d2759a3dd64666b519f2334cea4d83] ...
I0805 23:47:27.290466 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 156ce89ed6d27a90c91eab334249d8a894d2759a3dd64666b519f2334cea4d83"
I0805 23:47:27.340422 507478 logs.go:123] Gathering logs for dmesg ...
I0805 23:47:27.340450 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0805 23:47:27.361915 507478 logs.go:123] Gathering logs for kube-apiserver [fb4412296d907ebe940afee2bcd959a113ae813b5af39f21c4fd257b8dc9eccc] ...
I0805 23:47:27.361943 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb4412296d907ebe940afee2bcd959a113ae813b5af39f21c4fd257b8dc9eccc"
I0805 23:47:27.436055 507478 logs.go:123] Gathering logs for etcd [e68c71f7afc0dc37539082c1c20c925d963d28664511ac67f8a6c2e7d3db85fc] ...
I0805 23:47:27.436089 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e68c71f7afc0dc37539082c1c20c925d963d28664511ac67f8a6c2e7d3db85fc"
I0805 23:47:27.483595 507478 logs.go:123] Gathering logs for coredns [2b39caa6f1085047518aeb7a6117b5a3fc78d5496f8ddfe327efd3a89e20b70c] ...
I0805 23:47:27.483625 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2b39caa6f1085047518aeb7a6117b5a3fc78d5496f8ddfe327efd3a89e20b70c"
I0805 23:47:27.551414 507478 logs.go:123] Gathering logs for kube-controller-manager [b2e5dbb97a8bce87cd5b22a5fb4d35f69eb570ca797a284b2a97e1908b4f01b3] ...
I0805 23:47:27.551499 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b2e5dbb97a8bce87cd5b22a5fb4d35f69eb570ca797a284b2a97e1908b4f01b3"
I0805 23:47:27.623177 507478 logs.go:123] Gathering logs for container status ...
I0805 23:47:27.623208 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0805 23:47:27.674618 507478 logs.go:123] Gathering logs for describe nodes ...
I0805 23:47:27.674757 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0805 23:47:27.839936 507478 logs.go:123] Gathering logs for coredns [a6fb77f7718de46e631aaa130f88714ab2e52f578f3fab363700a1a3dd05d055] ...
I0805 23:47:27.840008 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a6fb77f7718de46e631aaa130f88714ab2e52f578f3fab363700a1a3dd05d055"
I0805 23:47:27.888112 507478 logs.go:123] Gathering logs for kube-scheduler [6fde48373a0e71e9ae888db24d7116069eff729936107f8a14b69f87f46ae620] ...
I0805 23:47:27.888188 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6fde48373a0e71e9ae888db24d7116069eff729936107f8a14b69f87f46ae620"
I0805 23:47:27.939586 507478 logs.go:123] Gathering logs for kube-controller-manager [5cf8d64c50fe281293e3e52f57b92667c5e8e2e65e7d3ce6796012a33141f207] ...
I0805 23:47:27.939666 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5cf8d64c50fe281293e3e52f57b92667c5e8e2e65e7d3ce6796012a33141f207"
I0805 23:47:28.025648 507478 logs.go:123] Gathering logs for storage-provisioner [7d004de9baf7e1f5fe4d38a3eda0e0394f9fe775247b84a622dee9432f9b3d45] ...
I0805 23:47:28.025688 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7d004de9baf7e1f5fe4d38a3eda0e0394f9fe775247b84a622dee9432f9b3d45"
I0805 23:47:28.079696 507478 logs.go:123] Gathering logs for kubelet ...
I0805 23:47:28.079725 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0805 23:47:28.136417 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.228962 664 reflector.go:138] object-"kube-system"/"coredns-token-7zgp7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-7zgp7" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.136733 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229084 664 reflector.go:138] object-"kube-system"/"storage-provisioner-token-z4qt7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-z4qt7" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.137031 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229143 664 reflector.go:138] object-"default"/"default-token-7hcnm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-7hcnm" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.137273 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229195 664 reflector.go:138] object-"kube-system"/"metrics-server-token-f2542": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-f2542" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.137536 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229245 664 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.137923 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229289 664 reflector.go:138] object-"kube-system"/"kube-proxy-token-q2xzp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-q2xzp" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.138176 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229333 664 reflector.go:138] object-"kube-system"/"kindnet-token-xzcsg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-xzcsg" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.138471 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229373 664 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.151206 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:54 old-k8s-version-375611 kubelet[664]: E0805 23:41:54.235161 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:28.152025 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:54 old-k8s-version-375611 kubelet[664]: E0805 23:41:54.616631 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.154916 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:08 old-k8s-version-375611 kubelet[664]: E0805 23:42:08.270532 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:28.157230 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:15 old-k8s-version-375611 kubelet[664]: E0805 23:42:15.691034 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.157592 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:16 old-k8s-version-375611 kubelet[664]: E0805 23:42:16.695660 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.157949 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:17 old-k8s-version-375611 kubelet[664]: E0805 23:42:17.701301 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.158501 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:21 old-k8s-version-375611 kubelet[664]: E0805 23:42:21.253942 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.159580 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:31 old-k8s-version-375611 kubelet[664]: E0805 23:42:31.743412 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.162075 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:35 old-k8s-version-375611 kubelet[664]: E0805 23:42:35.262616 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:28.162492 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:36 old-k8s-version-375611 kubelet[664]: E0805 23:42:36.850604 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.162699 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:48 old-k8s-version-375611 kubelet[664]: E0805 23:42:48.259531 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.163050 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:50 old-k8s-version-375611 kubelet[664]: E0805 23:42:50.261178 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.163266 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:59 old-k8s-version-375611 kubelet[664]: E0805 23:42:59.254330 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.163894 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:03 old-k8s-version-375611 kubelet[664]: E0805 23:43:03.836002 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.164248 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:06 old-k8s-version-375611 kubelet[664]: E0805 23:43:06.850605 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.164462 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:11 old-k8s-version-375611 kubelet[664]: E0805 23:43:11.254086 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.164813 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:19 old-k8s-version-375611 kubelet[664]: E0805 23:43:19.253663 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.167423 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:24 old-k8s-version-375611 kubelet[664]: E0805 23:43:24.265875 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:28.167756 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:33 old-k8s-version-375611 kubelet[664]: E0805 23:43:33.253770 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.167944 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:39 old-k8s-version-375611 kubelet[664]: E0805 23:43:39.262796 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.168531 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:47 old-k8s-version-375611 kubelet[664]: E0805 23:43:47.949904 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.168712 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:51 old-k8s-version-375611 kubelet[664]: E0805 23:43:51.254061 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.169043 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:56 old-k8s-version-375611 kubelet[664]: E0805 23:43:56.850999 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.169223 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:06 old-k8s-version-375611 kubelet[664]: E0805 23:44:06.253938 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.169546 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:09 old-k8s-version-375611 kubelet[664]: E0805 23:44:09.253682 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.169734 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:17 old-k8s-version-375611 kubelet[664]: E0805 23:44:17.254002 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.170058 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:22 old-k8s-version-375611 kubelet[664]: E0805 23:44:22.253626 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.170237 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:28 old-k8s-version-375611 kubelet[664]: E0805 23:44:28.254408 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.170559 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:37 old-k8s-version-375611 kubelet[664]: E0805 23:44:37.253654 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.170740 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:40 old-k8s-version-375611 kubelet[664]: E0805 23:44:40.257289 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.171063 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:52 old-k8s-version-375611 kubelet[664]: E0805 23:44:52.254219 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.173553 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:54 old-k8s-version-375611 kubelet[664]: E0805 23:44:54.262392 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:28.173921 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:05 old-k8s-version-375611 kubelet[664]: E0805 23:45:05.253597 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.174124 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:06 old-k8s-version-375611 kubelet[664]: E0805 23:45:06.267947 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.174487 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:18 old-k8s-version-375611 kubelet[664]: E0805 23:45:18.279524 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.175022 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:19 old-k8s-version-375611 kubelet[664]: E0805 23:45:19.232909 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.175390 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:26 old-k8s-version-375611 kubelet[664]: E0805 23:45:26.855630 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.175592 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:33 old-k8s-version-375611 kubelet[664]: E0805 23:45:33.254159 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.175936 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:40 old-k8s-version-375611 kubelet[664]: E0805 23:45:40.254168 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.176139 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:48 old-k8s-version-375611 kubelet[664]: E0805 23:45:48.259557 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.176485 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:52 old-k8s-version-375611 kubelet[664]: E0805 23:45:52.253861 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.176688 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:59 old-k8s-version-375611 kubelet[664]: E0805 23:45:59.253981 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.177039 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:06 old-k8s-version-375611 kubelet[664]: E0805 23:46:06.254418 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.177248 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:10 old-k8s-version-375611 kubelet[664]: E0805 23:46:10.254218 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.177592 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:17 old-k8s-version-375611 kubelet[664]: E0805 23:46:17.253633 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.177795 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:25 old-k8s-version-375611 kubelet[664]: E0805 23:46:25.253988 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.178140 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:28 old-k8s-version-375611 kubelet[664]: E0805 23:46:28.254493 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.178344 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:36 old-k8s-version-375611 kubelet[664]: E0805 23:46:36.255023 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.178691 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:42 old-k8s-version-375611 kubelet[664]: E0805 23:46:42.254426 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.178895 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:47 old-k8s-version-375611 kubelet[664]: E0805 23:46:47.253936 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.179244 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:57 old-k8s-version-375611 kubelet[664]: E0805 23:46:57.255244 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.179472 507478 logs.go:138] Found kubelet problem: Aug 05 23:47:01 old-k8s-version-375611 kubelet[664]: E0805 23:47:01.254026 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.179817 507478 logs.go:138] Found kubelet problem: Aug 05 23:47:10 old-k8s-version-375611 kubelet[664]: E0805 23:47:10.255321 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.180018 507478 logs.go:138] Found kubelet problem: Aug 05 23:47:16 old-k8s-version-375611 kubelet[664]: E0805 23:47:16.254092 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.180364 507478 logs.go:138] Found kubelet problem: Aug 05 23:47:23 old-k8s-version-375611 kubelet[664]: E0805 23:47:23.254370 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
I0805 23:47:28.180392 507478 logs.go:123] Gathering logs for kindnet [2735e7564bd9c0c6184f71ef1f354aeccbcfa5d6372704cdf34531f23e66f8c2] ...
I0805 23:47:28.180422 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2735e7564bd9c0c6184f71ef1f354aeccbcfa5d6372704cdf34531f23e66f8c2"
I0805 23:47:28.245243 507478 logs.go:123] Gathering logs for storage-provisioner [6064aa025609bb6d981e24f1c08cf4fc365902e17c5e558d538e6910a7f12728] ...
I0805 23:47:28.245317 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6064aa025609bb6d981e24f1c08cf4fc365902e17c5e558d538e6910a7f12728"
I0805 23:47:28.317807 507478 logs.go:123] Gathering logs for containerd ...
I0805 23:47:28.317876 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0805 23:47:28.380729 507478 logs.go:123] Gathering logs for kube-proxy [4533e7c882251f02335ccb9737a3a4302d3a2e79f479d6d0c81c62f137524de7] ...
I0805 23:47:28.380807 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4533e7c882251f02335ccb9737a3a4302d3a2e79f479d6d0c81c62f137524de7"
I0805 23:47:28.422971 507478 out.go:304] Setting ErrFile to fd 2...
I0805 23:47:28.422996 507478 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0805 23:47:28.423050 507478 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0805 23:47:28.423062 507478 out.go:239] Aug 05 23:46:57 old-k8s-version-375611 kubelet[664]: E0805 23:46:57.255244 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
Aug 05 23:46:57 old-k8s-version-375611 kubelet[664]: E0805 23:46:57.255244 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.423070 507478 out.go:239] Aug 05 23:47:01 old-k8s-version-375611 kubelet[664]: E0805 23:47:01.254026 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 23:47:01 old-k8s-version-375611 kubelet[664]: E0805 23:47:01.254026 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.423084 507478 out.go:239] Aug 05 23:47:10 old-k8s-version-375611 kubelet[664]: E0805 23:47:10.255321 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
Aug 05 23:47:10 old-k8s-version-375611 kubelet[664]: E0805 23:47:10.255321 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.423094 507478 out.go:239] Aug 05 23:47:16 old-k8s-version-375611 kubelet[664]: E0805 23:47:16.254092 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 23:47:16 old-k8s-version-375611 kubelet[664]: E0805 23:47:16.254092 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.423105 507478 out.go:239] Aug 05 23:47:23 old-k8s-version-375611 kubelet[664]: E0805 23:47:23.254370 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
Aug 05 23:47:23 old-k8s-version-375611 kubelet[664]: E0805 23:47:23.254370 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
I0805 23:47:28.423113 507478 out.go:304] Setting ErrFile to fd 2...
I0805 23:47:28.423118 507478 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 23:47:38.424611 507478 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0805 23:47:38.435595 507478 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0805 23:47:38.437814 507478 out.go:177]
W0805 23:47:38.439587 507478 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0805 23:47:38.439790 507478 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0805 23:47:38.439873 507478 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0805 23:47:38.439917 507478 out.go:239] *
*
W0805 23:47:38.441220 507478 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0805 23:47:38.443895 507478 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-375611 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-375611
helpers_test.go:235: (dbg) docker inspect old-k8s-version-375611:
-- stdout --
[
{
"Id": "9c65a6e6e671a49ffb2c001b5ea1b4eef5b34d16cace2077aa372057f0986537",
"Created": "2024-08-05T23:38:10.745207058Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 507691,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-08-05T23:41:22.567611109Z",
"FinishedAt": "2024-08-05T23:41:21.383587328Z"
},
"Image": "sha256:2cd84ab2172023a68162f38a55db46353562cea41552fd8e8bdec97b31b2c495",
"ResolvConfPath": "/var/lib/docker/containers/9c65a6e6e671a49ffb2c001b5ea1b4eef5b34d16cace2077aa372057f0986537/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/9c65a6e6e671a49ffb2c001b5ea1b4eef5b34d16cace2077aa372057f0986537/hostname",
"HostsPath": "/var/lib/docker/containers/9c65a6e6e671a49ffb2c001b5ea1b4eef5b34d16cace2077aa372057f0986537/hosts",
"LogPath": "/var/lib/docker/containers/9c65a6e6e671a49ffb2c001b5ea1b4eef5b34d16cace2077aa372057f0986537/9c65a6e6e671a49ffb2c001b5ea1b4eef5b34d16cace2077aa372057f0986537-json.log",
"Name": "/old-k8s-version-375611",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-375611:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-375611",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/a0c5f7d0bf9ca68986174ca9ec4ac1d1929435e153cff38cc6db34d285f49777-init/diff:/var/lib/docker/overlay2/717e77eefffded5de5595e46fb0b2bb6779248e50ff78a63415ceffb363df786/diff",
"MergedDir": "/var/lib/docker/overlay2/a0c5f7d0bf9ca68986174ca9ec4ac1d1929435e153cff38cc6db34d285f49777/merged",
"UpperDir": "/var/lib/docker/overlay2/a0c5f7d0bf9ca68986174ca9ec4ac1d1929435e153cff38cc6db34d285f49777/diff",
"WorkDir": "/var/lib/docker/overlay2/a0c5f7d0bf9ca68986174ca9ec4ac1d1929435e153cff38cc6db34d285f49777/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-375611",
"Source": "/var/lib/docker/volumes/old-k8s-version-375611/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-375611",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-375611",
"name.minikube.sigs.k8s.io": "old-k8s-version-375611",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "094272248d89bf1394f2601bb7e15aa8fcd600bdb16e131b0a6bc442b459c5bd",
"SandboxKey": "/var/run/docker/netns/094272248d89",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33433"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33434"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33437"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33435"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33436"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-375611": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:55:02",
"DriverOpts": null,
"NetworkID": "527dd3a3ed806ff463c6a590f1577886e8291ac9ea41c53bfe0b0c529736c246",
"EndpointID": "94f883fc403065c6d931c728f148c7e590b78f69274f7c3b845b2c9603c8580e",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-375611",
"9c65a6e6e671"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-375611 -n old-k8s-version-375611
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-375611 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-375611 logs -n 25: (2.836163788s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| start | -p cert-expiration-228363 | cert-expiration-228363 | jenkins | v1.33.1 | 05 Aug 24 23:37 UTC | 05 Aug 24 23:37 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-308238 | force-systemd-env-308238 | jenkins | v1.33.1 | 05 Aug 24 23:37 UTC | 05 Aug 24 23:37 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-308238 | force-systemd-env-308238 | jenkins | v1.33.1 | 05 Aug 24 23:37 UTC | 05 Aug 24 23:37 UTC |
| start | -p cert-options-751697 | cert-options-751697 | jenkins | v1.33.1 | 05 Aug 24 23:37 UTC | 05 Aug 24 23:38 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-751697 ssh | cert-options-751697 | jenkins | v1.33.1 | 05 Aug 24 23:38 UTC | 05 Aug 24 23:38 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-751697 -- sudo | cert-options-751697 | jenkins | v1.33.1 | 05 Aug 24 23:38 UTC | 05 Aug 24 23:38 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-751697 | cert-options-751697 | jenkins | v1.33.1 | 05 Aug 24 23:38 UTC | 05 Aug 24 23:38 UTC |
| start | -p old-k8s-version-375611 | old-k8s-version-375611 | jenkins | v1.33.1 | 05 Aug 24 23:38 UTC | 05 Aug 24 23:40 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-228363 | cert-expiration-228363 | jenkins | v1.33.1 | 05 Aug 24 23:40 UTC | 05 Aug 24 23:40 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-228363 | cert-expiration-228363 | jenkins | v1.33.1 | 05 Aug 24 23:40 UTC | 05 Aug 24 23:40 UTC |
| start | -p no-preload-842506 | no-preload-842506 | jenkins | v1.33.1 | 05 Aug 24 23:40 UTC | 05 Aug 24 23:42 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0-rc.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-375611 | old-k8s-version-375611 | jenkins | v1.33.1 | 05 Aug 24 23:41 UTC | 05 Aug 24 23:41 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-375611 | old-k8s-version-375611 | jenkins | v1.33.1 | 05 Aug 24 23:41 UTC | 05 Aug 24 23:41 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-375611 | old-k8s-version-375611 | jenkins | v1.33.1 | 05 Aug 24 23:41 UTC | 05 Aug 24 23:41 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-375611 | old-k8s-version-375611 | jenkins | v1.33.1 | 05 Aug 24 23:41 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-842506 | no-preload-842506 | jenkins | v1.33.1 | 05 Aug 24 23:42 UTC | 05 Aug 24 23:42 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-842506 | no-preload-842506 | jenkins | v1.33.1 | 05 Aug 24 23:42 UTC | 05 Aug 24 23:42 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-842506 | no-preload-842506 | jenkins | v1.33.1 | 05 Aug 24 23:42 UTC | 05 Aug 24 23:42 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-842506 | no-preload-842506 | jenkins | v1.33.1 | 05 Aug 24 23:42 UTC | 05 Aug 24 23:47 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0-rc.0 | | | | | |
| image | no-preload-842506 image list | no-preload-842506 | jenkins | v1.33.1 | 05 Aug 24 23:47 UTC | 05 Aug 24 23:47 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-842506 | no-preload-842506 | jenkins | v1.33.1 | 05 Aug 24 23:47 UTC | 05 Aug 24 23:47 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-842506 | no-preload-842506 | jenkins | v1.33.1 | 05 Aug 24 23:47 UTC | 05 Aug 24 23:47 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-842506 | no-preload-842506 | jenkins | v1.33.1 | 05 Aug 24 23:47 UTC | 05 Aug 24 23:47 UTC |
| delete | -p no-preload-842506 | no-preload-842506 | jenkins | v1.33.1 | 05 Aug 24 23:47 UTC | 05 Aug 24 23:47 UTC |
| start | -p embed-certs-796481 | embed-certs-796481 | jenkins | v1.33.1 | 05 Aug 24 23:47 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.3 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/08/05 23:47:23
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0805 23:47:23.630001 518398 out.go:291] Setting OutFile to fd 1 ...
I0805 23:47:23.630173 518398 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 23:47:23.630204 518398 out.go:304] Setting ErrFile to fd 2...
I0805 23:47:23.630223 518398 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 23:47:23.630479 518398 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19373-295474/.minikube/bin
I0805 23:47:23.630930 518398 out.go:298] Setting JSON to false
I0805 23:47:23.632009 518398 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":12583,"bootTime":1722889061,"procs":228,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0805 23:47:23.632118 518398 start.go:139] virtualization:
I0805 23:47:23.636032 518398 out.go:177] * [embed-certs-796481] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0805 23:47:23.638915 518398 out.go:177] - MINIKUBE_LOCATION=19373
I0805 23:47:23.638999 518398 notify.go:220] Checking for updates...
I0805 23:47:23.643756 518398 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0805 23:47:23.646183 518398 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19373-295474/kubeconfig
I0805 23:47:23.649748 518398 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19373-295474/.minikube
I0805 23:47:23.652084 518398 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0805 23:47:23.654266 518398 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0805 23:47:23.657002 518398 config.go:182] Loaded profile config "old-k8s-version-375611": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0805 23:47:23.657100 518398 driver.go:392] Setting default libvirt URI to qemu:///system
I0805 23:47:23.680761 518398 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0805 23:47:23.680888 518398 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0805 23:47:23.747715 518398 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-05 23:47:23.737613917 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0805 23:47:23.747854 518398 docker.go:307] overlay module found
I0805 23:47:23.750403 518398 out.go:177] * Using the docker driver based on user configuration
I0805 23:47:23.752316 518398 start.go:297] selected driver: docker
I0805 23:47:23.752334 518398 start.go:901] validating driver "docker" against <nil>
I0805 23:47:23.752348 518398 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0805 23:47:23.753003 518398 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0805 23:47:23.817937 518398 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-05 23:47:23.802328069 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0805 23:47:23.818103 518398 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0805 23:47:23.818323 518398 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0805 23:47:23.820469 518398 out.go:177] * Using Docker driver with root privileges
I0805 23:47:23.822565 518398 cni.go:84] Creating CNI manager for ""
I0805 23:47:23.822583 518398 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0805 23:47:23.822595 518398 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0805 23:47:23.822674 518398 start.go:340] cluster config:
{Name:embed-certs-796481 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-796481 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0805 23:47:23.826135 518398 out.go:177] * Starting "embed-certs-796481" primary control-plane node in "embed-certs-796481" cluster
I0805 23:47:23.828858 518398 cache.go:121] Beginning downloading kic base image for docker with containerd
I0805 23:47:23.831079 518398 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0805 23:47:23.832718 518398 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
I0805 23:47:23.832771 518398 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19373-295474/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4
I0805 23:47:23.832782 518398 cache.go:56] Caching tarball of preloaded images
I0805 23:47:23.832801 518398 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
I0805 23:47:23.832882 518398 preload.go:172] Found /home/jenkins/minikube-integration/19373-295474/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0805 23:47:23.832894 518398 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on containerd
I0805 23:47:23.832998 518398 profile.go:143] Saving config to /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/config.json ...
I0805 23:47:23.833015 518398 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/config.json: {Name:mk083052d3e6ce1035971058b0432bf226fccdc1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
W0805 23:47:23.851947 518398 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
I0805 23:47:23.851971 518398 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0805 23:47:23.852074 518398 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0805 23:47:23.852097 518398 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0805 23:47:23.852105 518398 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0805 23:47:23.852114 518398 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0805 23:47:23.852127 518398 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0805 23:47:23.983858 518398 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0805 23:47:23.983894 518398 cache.go:194] Successfully downloaded all kic artifacts
I0805 23:47:23.983924 518398 start.go:360] acquireMachinesLock for embed-certs-796481: {Name:mkd93e84b7dc2f44ce107c58c0f4ca0a72fb0ed9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0805 23:47:23.984450 518398 start.go:364] duration metric: took 501.576µs to acquireMachinesLock for "embed-certs-796481"
I0805 23:47:23.984486 518398 start.go:93] Provisioning new machine with config: &{Name:embed-certs-796481 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-796481 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0805 23:47:23.984592 518398 start.go:125] createHost starting for "" (driver="docker")
I0805 23:47:26.390235 507478 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0805 23:47:26.404620 507478 api_server.go:72] duration metric: took 5m56.169789618s to wait for apiserver process to appear ...
I0805 23:47:26.404646 507478 api_server.go:88] waiting for apiserver healthz status ...
I0805 23:47:26.404680 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0805 23:47:26.404741 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0805 23:47:26.450749 507478 cri.go:89] found id: "fb4412296d907ebe940afee2bcd959a113ae813b5af39f21c4fd257b8dc9eccc"
I0805 23:47:26.450770 507478 cri.go:89] found id: "b1b8743da3a076d6a5f3ed1c16dbf583bd9eb6f2908f11daae833fe8e843cfdf"
I0805 23:47:26.450774 507478 cri.go:89] found id: ""
I0805 23:47:26.450781 507478 logs.go:276] 2 containers: [fb4412296d907ebe940afee2bcd959a113ae813b5af39f21c4fd257b8dc9eccc b1b8743da3a076d6a5f3ed1c16dbf583bd9eb6f2908f11daae833fe8e843cfdf]
I0805 23:47:26.450840 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.454853 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.458431 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0805 23:47:26.458506 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0805 23:47:26.501105 507478 cri.go:89] found id: "e68c71f7afc0dc37539082c1c20c925d963d28664511ac67f8a6c2e7d3db85fc"
I0805 23:47:26.501127 507478 cri.go:89] found id: "9591fcf9ec50f9c0dc47d7cf116b4bc84f0890bf85707a0eaa905012b906f848"
I0805 23:47:26.501132 507478 cri.go:89] found id: ""
I0805 23:47:26.501138 507478 logs.go:276] 2 containers: [e68c71f7afc0dc37539082c1c20c925d963d28664511ac67f8a6c2e7d3db85fc 9591fcf9ec50f9c0dc47d7cf116b4bc84f0890bf85707a0eaa905012b906f848]
I0805 23:47:26.501193 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.505303 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.509562 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0805 23:47:26.509632 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0805 23:47:26.561939 507478 cri.go:89] found id: "2b39caa6f1085047518aeb7a6117b5a3fc78d5496f8ddfe327efd3a89e20b70c"
I0805 23:47:26.561958 507478 cri.go:89] found id: "a6fb77f7718de46e631aaa130f88714ab2e52f578f3fab363700a1a3dd05d055"
I0805 23:47:26.561963 507478 cri.go:89] found id: ""
I0805 23:47:26.561970 507478 logs.go:276] 2 containers: [2b39caa6f1085047518aeb7a6117b5a3fc78d5496f8ddfe327efd3a89e20b70c a6fb77f7718de46e631aaa130f88714ab2e52f578f3fab363700a1a3dd05d055]
I0805 23:47:26.562030 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.566190 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.570104 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0805 23:47:26.570224 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0805 23:47:26.625569 507478 cri.go:89] found id: "239f2943bc1fa036cffa005d7bc59654ed4aa71550999412ce96d16c5ee24c87"
I0805 23:47:26.625588 507478 cri.go:89] found id: "6fde48373a0e71e9ae888db24d7116069eff729936107f8a14b69f87f46ae620"
I0805 23:47:26.625593 507478 cri.go:89] found id: ""
I0805 23:47:26.625600 507478 logs.go:276] 2 containers: [239f2943bc1fa036cffa005d7bc59654ed4aa71550999412ce96d16c5ee24c87 6fde48373a0e71e9ae888db24d7116069eff729936107f8a14b69f87f46ae620]
I0805 23:47:26.625656 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.630618 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.634786 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0805 23:47:26.634862 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0805 23:47:26.691402 507478 cri.go:89] found id: "4533e7c882251f02335ccb9737a3a4302d3a2e79f479d6d0c81c62f137524de7"
I0805 23:47:26.691474 507478 cri.go:89] found id: "f0a58f073f5c7bc4f777cc7a18e11f853b1f72c4bf017997a3961d1d4be66f9a"
I0805 23:47:26.691492 507478 cri.go:89] found id: ""
I0805 23:47:26.691510 507478 logs.go:276] 2 containers: [4533e7c882251f02335ccb9737a3a4302d3a2e79f479d6d0c81c62f137524de7 f0a58f073f5c7bc4f777cc7a18e11f853b1f72c4bf017997a3961d1d4be66f9a]
I0805 23:47:26.691579 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.695402 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.698832 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0805 23:47:26.698902 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0805 23:47:26.764117 507478 cri.go:89] found id: "b2e5dbb97a8bce87cd5b22a5fb4d35f69eb570ca797a284b2a97e1908b4f01b3"
I0805 23:47:26.764253 507478 cri.go:89] found id: "5cf8d64c50fe281293e3e52f57b92667c5e8e2e65e7d3ce6796012a33141f207"
I0805 23:47:26.764275 507478 cri.go:89] found id: ""
I0805 23:47:26.764296 507478 logs.go:276] 2 containers: [b2e5dbb97a8bce87cd5b22a5fb4d35f69eb570ca797a284b2a97e1908b4f01b3 5cf8d64c50fe281293e3e52f57b92667c5e8e2e65e7d3ce6796012a33141f207]
I0805 23:47:26.764385 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.768478 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.773341 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0805 23:47:26.773413 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0805 23:47:26.839288 507478 cri.go:89] found id: "2735e7564bd9c0c6184f71ef1f354aeccbcfa5d6372704cdf34531f23e66f8c2"
I0805 23:47:26.839351 507478 cri.go:89] found id: "41cf79dd5f1310161781ecef777def36b1c177fb874e28de5d8fef142c0487da"
I0805 23:47:26.839368 507478 cri.go:89] found id: ""
I0805 23:47:26.839385 507478 logs.go:276] 2 containers: [2735e7564bd9c0c6184f71ef1f354aeccbcfa5d6372704cdf34531f23e66f8c2 41cf79dd5f1310161781ecef777def36b1c177fb874e28de5d8fef142c0487da]
I0805 23:47:26.839467 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.843332 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.847533 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0805 23:47:26.847650 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0805 23:47:26.895920 507478 cri.go:89] found id: "156ce89ed6d27a90c91eab334249d8a894d2759a3dd64666b519f2334cea4d83"
I0805 23:47:26.895997 507478 cri.go:89] found id: ""
I0805 23:47:26.896017 507478 logs.go:276] 1 containers: [156ce89ed6d27a90c91eab334249d8a894d2759a3dd64666b519f2334cea4d83]
I0805 23:47:26.896109 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.903891 507478 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0805 23:47:26.904019 507478 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0805 23:47:26.950198 507478 cri.go:89] found id: "7d004de9baf7e1f5fe4d38a3eda0e0394f9fe775247b84a622dee9432f9b3d45"
I0805 23:47:26.950273 507478 cri.go:89] found id: "6064aa025609bb6d981e24f1c08cf4fc365902e17c5e558d538e6910a7f12728"
I0805 23:47:26.950291 507478 cri.go:89] found id: ""
I0805 23:47:26.950312 507478 logs.go:276] 2 containers: [7d004de9baf7e1f5fe4d38a3eda0e0394f9fe775247b84a622dee9432f9b3d45 6064aa025609bb6d981e24f1c08cf4fc365902e17c5e558d538e6910a7f12728]
I0805 23:47:26.950397 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.954566 507478 ssh_runner.go:195] Run: which crictl
I0805 23:47:26.958256 507478 logs.go:123] Gathering logs for kube-apiserver [b1b8743da3a076d6a5f3ed1c16dbf583bd9eb6f2908f11daae833fe8e843cfdf] ...
I0805 23:47:26.958283 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b1b8743da3a076d6a5f3ed1c16dbf583bd9eb6f2908f11daae833fe8e843cfdf"
I0805 23:47:23.987441 518398 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0805 23:47:23.987694 518398 start.go:159] libmachine.API.Create for "embed-certs-796481" (driver="docker")
I0805 23:47:23.987741 518398 client.go:168] LocalClient.Create starting
I0805 23:47:23.987831 518398 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca.pem
I0805 23:47:23.987870 518398 main.go:141] libmachine: Decoding PEM data...
I0805 23:47:23.987888 518398 main.go:141] libmachine: Parsing certificate...
I0805 23:47:23.987941 518398 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19373-295474/.minikube/certs/cert.pem
I0805 23:47:23.987966 518398 main.go:141] libmachine: Decoding PEM data...
I0805 23:47:23.987979 518398 main.go:141] libmachine: Parsing certificate...
I0805 23:47:23.988350 518398 cli_runner.go:164] Run: docker network inspect embed-certs-796481 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0805 23:47:24.006418 518398 cli_runner.go:211] docker network inspect embed-certs-796481 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0805 23:47:24.006623 518398 network_create.go:284] running [docker network inspect embed-certs-796481] to gather additional debugging logs...
I0805 23:47:24.006644 518398 cli_runner.go:164] Run: docker network inspect embed-certs-796481
W0805 23:47:24.024252 518398 cli_runner.go:211] docker network inspect embed-certs-796481 returned with exit code 1
I0805 23:47:24.024299 518398 network_create.go:287] error running [docker network inspect embed-certs-796481]: docker network inspect embed-certs-796481: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-796481 not found
I0805 23:47:24.024318 518398 network_create.go:289] output of [docker network inspect embed-certs-796481]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-796481 not found
** /stderr **
I0805 23:47:24.024424 518398 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0805 23:47:24.042793 518398 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-0155281a801b IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:ba:04:ec:42} reservation:<nil>}
I0805 23:47:24.043149 518398 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-3019def93723 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:d5:83:e0:48} reservation:<nil>}
I0805 23:47:24.043683 518398 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-044f2e79848c IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:04:03:7a:cb} reservation:<nil>}
I0805 23:47:24.044202 518398 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001865690}
I0805 23:47:24.044228 518398 network_create.go:124] attempt to create docker network embed-certs-796481 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0805 23:47:24.044300 518398 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-796481 embed-certs-796481
I0805 23:47:24.118940 518398 network_create.go:108] docker network embed-certs-796481 192.168.76.0/24 created
I0805 23:47:24.118975 518398 kic.go:121] calculated static IP "192.168.76.2" for the "embed-certs-796481" container
I0805 23:47:24.119047 518398 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0805 23:47:24.143535 518398 cli_runner.go:164] Run: docker volume create embed-certs-796481 --label name.minikube.sigs.k8s.io=embed-certs-796481 --label created_by.minikube.sigs.k8s.io=true
I0805 23:47:24.161447 518398 oci.go:103] Successfully created a docker volume embed-certs-796481
I0805 23:47:24.161528 518398 cli_runner.go:164] Run: docker run --rm --name embed-certs-796481-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-796481 --entrypoint /usr/bin/test -v embed-certs-796481:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -d /var/lib
I0805 23:47:24.832984 518398 oci.go:107] Successfully prepared a docker volume embed-certs-796481
I0805 23:47:24.833038 518398 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
I0805 23:47:24.833058 518398 kic.go:194] Starting extracting preloaded images to volume ...
I0805 23:47:24.833159 518398 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19373-295474/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-796481:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -I lz4 -xf /preloaded.tar -C /extractDir
I0805 23:47:27.055331 507478 logs.go:123] Gathering logs for etcd [9591fcf9ec50f9c0dc47d7cf116b4bc84f0890bf85707a0eaa905012b906f848] ...
I0805 23:47:27.055367 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9591fcf9ec50f9c0dc47d7cf116b4bc84f0890bf85707a0eaa905012b906f848"
I0805 23:47:27.105647 507478 logs.go:123] Gathering logs for kube-scheduler [239f2943bc1fa036cffa005d7bc59654ed4aa71550999412ce96d16c5ee24c87] ...
I0805 23:47:27.105674 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 239f2943bc1fa036cffa005d7bc59654ed4aa71550999412ce96d16c5ee24c87"
I0805 23:47:27.161669 507478 logs.go:123] Gathering logs for kube-proxy [f0a58f073f5c7bc4f777cc7a18e11f853b1f72c4bf017997a3961d1d4be66f9a] ...
I0805 23:47:27.161698 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f0a58f073f5c7bc4f777cc7a18e11f853b1f72c4bf017997a3961d1d4be66f9a"
I0805 23:47:27.218662 507478 logs.go:123] Gathering logs for kindnet [41cf79dd5f1310161781ecef777def36b1c177fb874e28de5d8fef142c0487da] ...
I0805 23:47:27.218691 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 41cf79dd5f1310161781ecef777def36b1c177fb874e28de5d8fef142c0487da"
I0805 23:47:27.290432 507478 logs.go:123] Gathering logs for kubernetes-dashboard [156ce89ed6d27a90c91eab334249d8a894d2759a3dd64666b519f2334cea4d83] ...
I0805 23:47:27.290466 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 156ce89ed6d27a90c91eab334249d8a894d2759a3dd64666b519f2334cea4d83"
I0805 23:47:27.340422 507478 logs.go:123] Gathering logs for dmesg ...
I0805 23:47:27.340450 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0805 23:47:27.361915 507478 logs.go:123] Gathering logs for kube-apiserver [fb4412296d907ebe940afee2bcd959a113ae813b5af39f21c4fd257b8dc9eccc] ...
I0805 23:47:27.361943 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb4412296d907ebe940afee2bcd959a113ae813b5af39f21c4fd257b8dc9eccc"
I0805 23:47:27.436055 507478 logs.go:123] Gathering logs for etcd [e68c71f7afc0dc37539082c1c20c925d963d28664511ac67f8a6c2e7d3db85fc] ...
I0805 23:47:27.436089 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e68c71f7afc0dc37539082c1c20c925d963d28664511ac67f8a6c2e7d3db85fc"
I0805 23:47:27.483595 507478 logs.go:123] Gathering logs for coredns [2b39caa6f1085047518aeb7a6117b5a3fc78d5496f8ddfe327efd3a89e20b70c] ...
I0805 23:47:27.483625 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2b39caa6f1085047518aeb7a6117b5a3fc78d5496f8ddfe327efd3a89e20b70c"
I0805 23:47:27.551414 507478 logs.go:123] Gathering logs for kube-controller-manager [b2e5dbb97a8bce87cd5b22a5fb4d35f69eb570ca797a284b2a97e1908b4f01b3] ...
I0805 23:47:27.551499 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b2e5dbb97a8bce87cd5b22a5fb4d35f69eb570ca797a284b2a97e1908b4f01b3"
I0805 23:47:27.623177 507478 logs.go:123] Gathering logs for container status ...
I0805 23:47:27.623208 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0805 23:47:27.674618 507478 logs.go:123] Gathering logs for describe nodes ...
I0805 23:47:27.674757 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0805 23:47:27.839936 507478 logs.go:123] Gathering logs for coredns [a6fb77f7718de46e631aaa130f88714ab2e52f578f3fab363700a1a3dd05d055] ...
I0805 23:47:27.840008 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a6fb77f7718de46e631aaa130f88714ab2e52f578f3fab363700a1a3dd05d055"
I0805 23:47:27.888112 507478 logs.go:123] Gathering logs for kube-scheduler [6fde48373a0e71e9ae888db24d7116069eff729936107f8a14b69f87f46ae620] ...
I0805 23:47:27.888188 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6fde48373a0e71e9ae888db24d7116069eff729936107f8a14b69f87f46ae620"
I0805 23:47:27.939586 507478 logs.go:123] Gathering logs for kube-controller-manager [5cf8d64c50fe281293e3e52f57b92667c5e8e2e65e7d3ce6796012a33141f207] ...
I0805 23:47:27.939666 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5cf8d64c50fe281293e3e52f57b92667c5e8e2e65e7d3ce6796012a33141f207"
I0805 23:47:28.025648 507478 logs.go:123] Gathering logs for storage-provisioner [7d004de9baf7e1f5fe4d38a3eda0e0394f9fe775247b84a622dee9432f9b3d45] ...
I0805 23:47:28.025688 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7d004de9baf7e1f5fe4d38a3eda0e0394f9fe775247b84a622dee9432f9b3d45"
I0805 23:47:28.079696 507478 logs.go:123] Gathering logs for kubelet ...
I0805 23:47:28.079725 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0805 23:47:28.136417 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.228962 664 reflector.go:138] object-"kube-system"/"coredns-token-7zgp7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-7zgp7" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.136733 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229084 664 reflector.go:138] object-"kube-system"/"storage-provisioner-token-z4qt7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-z4qt7" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.137031 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229143 664 reflector.go:138] object-"default"/"default-token-7hcnm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-7hcnm" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.137273 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229195 664 reflector.go:138] object-"kube-system"/"metrics-server-token-f2542": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-f2542" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.137536 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229245 664 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.137923 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229289 664 reflector.go:138] object-"kube-system"/"kube-proxy-token-q2xzp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-q2xzp" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.138176 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229333 664 reflector.go:138] object-"kube-system"/"kindnet-token-xzcsg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-xzcsg" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.138471 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:50 old-k8s-version-375611 kubelet[664]: E0805 23:41:50.229373 664 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-375611" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-375611' and this object
W0805 23:47:28.151206 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:54 old-k8s-version-375611 kubelet[664]: E0805 23:41:54.235161 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:28.152025 507478 logs.go:138] Found kubelet problem: Aug 05 23:41:54 old-k8s-version-375611 kubelet[664]: E0805 23:41:54.616631 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.154916 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:08 old-k8s-version-375611 kubelet[664]: E0805 23:42:08.270532 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:28.157230 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:15 old-k8s-version-375611 kubelet[664]: E0805 23:42:15.691034 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.157592 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:16 old-k8s-version-375611 kubelet[664]: E0805 23:42:16.695660 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.157949 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:17 old-k8s-version-375611 kubelet[664]: E0805 23:42:17.701301 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.158501 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:21 old-k8s-version-375611 kubelet[664]: E0805 23:42:21.253942 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.159580 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:31 old-k8s-version-375611 kubelet[664]: E0805 23:42:31.743412 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.162075 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:35 old-k8s-version-375611 kubelet[664]: E0805 23:42:35.262616 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:28.162492 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:36 old-k8s-version-375611 kubelet[664]: E0805 23:42:36.850604 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.162699 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:48 old-k8s-version-375611 kubelet[664]: E0805 23:42:48.259531 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.163050 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:50 old-k8s-version-375611 kubelet[664]: E0805 23:42:50.261178 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.163266 507478 logs.go:138] Found kubelet problem: Aug 05 23:42:59 old-k8s-version-375611 kubelet[664]: E0805 23:42:59.254330 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.163894 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:03 old-k8s-version-375611 kubelet[664]: E0805 23:43:03.836002 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.164248 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:06 old-k8s-version-375611 kubelet[664]: E0805 23:43:06.850605 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.164462 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:11 old-k8s-version-375611 kubelet[664]: E0805 23:43:11.254086 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.164813 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:19 old-k8s-version-375611 kubelet[664]: E0805 23:43:19.253663 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.167423 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:24 old-k8s-version-375611 kubelet[664]: E0805 23:43:24.265875 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:28.167756 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:33 old-k8s-version-375611 kubelet[664]: E0805 23:43:33.253770 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.167944 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:39 old-k8s-version-375611 kubelet[664]: E0805 23:43:39.262796 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.168531 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:47 old-k8s-version-375611 kubelet[664]: E0805 23:43:47.949904 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.168712 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:51 old-k8s-version-375611 kubelet[664]: E0805 23:43:51.254061 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.169043 507478 logs.go:138] Found kubelet problem: Aug 05 23:43:56 old-k8s-version-375611 kubelet[664]: E0805 23:43:56.850999 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.169223 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:06 old-k8s-version-375611 kubelet[664]: E0805 23:44:06.253938 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.169546 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:09 old-k8s-version-375611 kubelet[664]: E0805 23:44:09.253682 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.169734 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:17 old-k8s-version-375611 kubelet[664]: E0805 23:44:17.254002 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.170058 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:22 old-k8s-version-375611 kubelet[664]: E0805 23:44:22.253626 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.170237 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:28 old-k8s-version-375611 kubelet[664]: E0805 23:44:28.254408 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.170559 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:37 old-k8s-version-375611 kubelet[664]: E0805 23:44:37.253654 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.170740 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:40 old-k8s-version-375611 kubelet[664]: E0805 23:44:40.257289 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.171063 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:52 old-k8s-version-375611 kubelet[664]: E0805 23:44:52.254219 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.173553 507478 logs.go:138] Found kubelet problem: Aug 05 23:44:54 old-k8s-version-375611 kubelet[664]: E0805 23:44:54.262392 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0805 23:47:28.173921 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:05 old-k8s-version-375611 kubelet[664]: E0805 23:45:05.253597 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.174124 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:06 old-k8s-version-375611 kubelet[664]: E0805 23:45:06.267947 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.174487 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:18 old-k8s-version-375611 kubelet[664]: E0805 23:45:18.279524 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.175022 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:19 old-k8s-version-375611 kubelet[664]: E0805 23:45:19.232909 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.175390 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:26 old-k8s-version-375611 kubelet[664]: E0805 23:45:26.855630 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.175592 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:33 old-k8s-version-375611 kubelet[664]: E0805 23:45:33.254159 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.175936 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:40 old-k8s-version-375611 kubelet[664]: E0805 23:45:40.254168 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.176139 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:48 old-k8s-version-375611 kubelet[664]: E0805 23:45:48.259557 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.176485 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:52 old-k8s-version-375611 kubelet[664]: E0805 23:45:52.253861 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.176688 507478 logs.go:138] Found kubelet problem: Aug 05 23:45:59 old-k8s-version-375611 kubelet[664]: E0805 23:45:59.253981 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.177039 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:06 old-k8s-version-375611 kubelet[664]: E0805 23:46:06.254418 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.177248 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:10 old-k8s-version-375611 kubelet[664]: E0805 23:46:10.254218 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.177592 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:17 old-k8s-version-375611 kubelet[664]: E0805 23:46:17.253633 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.177795 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:25 old-k8s-version-375611 kubelet[664]: E0805 23:46:25.253988 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.178140 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:28 old-k8s-version-375611 kubelet[664]: E0805 23:46:28.254493 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.178344 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:36 old-k8s-version-375611 kubelet[664]: E0805 23:46:36.255023 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.178691 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:42 old-k8s-version-375611 kubelet[664]: E0805 23:46:42.254426 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.178895 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:47 old-k8s-version-375611 kubelet[664]: E0805 23:46:47.253936 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.179244 507478 logs.go:138] Found kubelet problem: Aug 05 23:46:57 old-k8s-version-375611 kubelet[664]: E0805 23:46:57.255244 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.179472 507478 logs.go:138] Found kubelet problem: Aug 05 23:47:01 old-k8s-version-375611 kubelet[664]: E0805 23:47:01.254026 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.179817 507478 logs.go:138] Found kubelet problem: Aug 05 23:47:10 old-k8s-version-375611 kubelet[664]: E0805 23:47:10.255321 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.180018 507478 logs.go:138] Found kubelet problem: Aug 05 23:47:16 old-k8s-version-375611 kubelet[664]: E0805 23:47:16.254092 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.180364 507478 logs.go:138] Found kubelet problem: Aug 05 23:47:23 old-k8s-version-375611 kubelet[664]: E0805 23:47:23.254370 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
I0805 23:47:28.180392 507478 logs.go:123] Gathering logs for kindnet [2735e7564bd9c0c6184f71ef1f354aeccbcfa5d6372704cdf34531f23e66f8c2] ...
I0805 23:47:28.180422 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2735e7564bd9c0c6184f71ef1f354aeccbcfa5d6372704cdf34531f23e66f8c2"
I0805 23:47:28.245243 507478 logs.go:123] Gathering logs for storage-provisioner [6064aa025609bb6d981e24f1c08cf4fc365902e17c5e558d538e6910a7f12728] ...
I0805 23:47:28.245317 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6064aa025609bb6d981e24f1c08cf4fc365902e17c5e558d538e6910a7f12728"
I0805 23:47:28.317807 507478 logs.go:123] Gathering logs for containerd ...
I0805 23:47:28.317876 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0805 23:47:28.380729 507478 logs.go:123] Gathering logs for kube-proxy [4533e7c882251f02335ccb9737a3a4302d3a2e79f479d6d0c81c62f137524de7] ...
I0805 23:47:28.380807 507478 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4533e7c882251f02335ccb9737a3a4302d3a2e79f479d6d0c81c62f137524de7"
I0805 23:47:28.422971 507478 out.go:304] Setting ErrFile to fd 2...
I0805 23:47:28.422996 507478 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0805 23:47:28.423050 507478 out.go:239] X Problems detected in kubelet:
W0805 23:47:28.423062 507478 out.go:239] Aug 05 23:46:57 old-k8s-version-375611 kubelet[664]: E0805 23:46:57.255244 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.423070 507478 out.go:239] Aug 05 23:47:01 old-k8s-version-375611 kubelet[664]: E0805 23:47:01.254026 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.423084 507478 out.go:239] Aug 05 23:47:10 old-k8s-version-375611 kubelet[664]: E0805 23:47:10.255321 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
W0805 23:47:28.423094 507478 out.go:239] Aug 05 23:47:16 old-k8s-version-375611 kubelet[664]: E0805 23:47:16.254092 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0805 23:47:28.423105 507478 out.go:239] Aug 05 23:47:23 old-k8s-version-375611 kubelet[664]: E0805 23:47:23.254370 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
I0805 23:47:28.423113 507478 out.go:304] Setting ErrFile to fd 2...
I0805 23:47:28.423118 507478 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 23:47:31.176905 518398 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19373-295474/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-796481:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -I lz4 -xf /preloaded.tar -C /extractDir: (6.343706767s)
I0805 23:47:31.176940 518398 kic.go:203] duration metric: took 6.343877539s to extract preloaded images to volume ...
W0805 23:47:31.177078 518398 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0805 23:47:31.177193 518398 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0805 23:47:31.236367 518398 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-796481 --name embed-certs-796481 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-796481 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-796481 --network embed-certs-796481 --ip 192.168.76.2 --volume embed-certs-796481:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7
I0805 23:47:31.547901 518398 cli_runner.go:164] Run: docker container inspect embed-certs-796481 --format={{.State.Running}}
I0805 23:47:31.571946 518398 cli_runner.go:164] Run: docker container inspect embed-certs-796481 --format={{.State.Status}}
I0805 23:47:31.596089 518398 cli_runner.go:164] Run: docker exec embed-certs-796481 stat /var/lib/dpkg/alternatives/iptables
I0805 23:47:31.660844 518398 oci.go:144] the created container "embed-certs-796481" has a running status.
I0805 23:47:31.660875 518398 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19373-295474/.minikube/machines/embed-certs-796481/id_rsa...
I0805 23:47:32.462965 518398 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19373-295474/.minikube/machines/embed-certs-796481/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0805 23:47:32.490109 518398 cli_runner.go:164] Run: docker container inspect embed-certs-796481 --format={{.State.Status}}
I0805 23:47:32.520152 518398 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0805 23:47:32.520176 518398 kic_runner.go:114] Args: [docker exec --privileged embed-certs-796481 chown docker:docker /home/docker/.ssh/authorized_keys]
I0805 23:47:32.611489 518398 cli_runner.go:164] Run: docker container inspect embed-certs-796481 --format={{.State.Status}}
I0805 23:47:32.637732 518398 machine.go:94] provisionDockerMachine start ...
I0805 23:47:32.637838 518398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-796481
I0805 23:47:32.677572 518398 main.go:141] libmachine: Using SSH client type: native
I0805 23:47:32.677852 518398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33443 <nil> <nil>}
I0805 23:47:32.677861 518398 main.go:141] libmachine: About to run SSH command:
hostname
I0805 23:47:32.843196 518398 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-796481
I0805 23:47:32.843218 518398 ubuntu.go:169] provisioning hostname "embed-certs-796481"
I0805 23:47:32.843338 518398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-796481
I0805 23:47:32.862882 518398 main.go:141] libmachine: Using SSH client type: native
I0805 23:47:32.863144 518398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33443 <nil> <nil>}
I0805 23:47:32.863161 518398 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-796481 && echo "embed-certs-796481" | sudo tee /etc/hostname
I0805 23:47:33.020041 518398 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-796481
I0805 23:47:33.020123 518398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-796481
I0805 23:47:33.042718 518398 main.go:141] libmachine: Using SSH client type: native
I0805 23:47:33.042979 518398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33443 <nil> <nil>}
I0805 23:47:33.043000 518398 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-796481' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-796481/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-796481' | sudo tee -a /etc/hosts;
fi
fi
I0805 23:47:33.188554 518398 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0805 23:47:33.188650 518398 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19373-295474/.minikube CaCertPath:/home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19373-295474/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19373-295474/.minikube}
I0805 23:47:33.188712 518398 ubuntu.go:177] setting up certificates
I0805 23:47:33.188738 518398 provision.go:84] configureAuth start
I0805 23:47:33.188839 518398 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-796481
I0805 23:47:33.206696 518398 provision.go:143] copyHostCerts
I0805 23:47:33.206758 518398 exec_runner.go:144] found /home/jenkins/minikube-integration/19373-295474/.minikube/ca.pem, removing ...
I0805 23:47:33.206767 518398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19373-295474/.minikube/ca.pem
I0805 23:47:33.206841 518398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19373-295474/.minikube/ca.pem (1078 bytes)
I0805 23:47:33.206945 518398 exec_runner.go:144] found /home/jenkins/minikube-integration/19373-295474/.minikube/cert.pem, removing ...
I0805 23:47:33.206951 518398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19373-295474/.minikube/cert.pem
I0805 23:47:33.207046 518398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19373-295474/.minikube/cert.pem (1123 bytes)
I0805 23:47:33.207124 518398 exec_runner.go:144] found /home/jenkins/minikube-integration/19373-295474/.minikube/key.pem, removing ...
I0805 23:47:33.207130 518398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19373-295474/.minikube/key.pem
I0805 23:47:33.207162 518398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19373-295474/.minikube/key.pem (1679 bytes)
I0805 23:47:33.207211 518398 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19373-295474/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca-key.pem org=jenkins.embed-certs-796481 san=[127.0.0.1 192.168.76.2 embed-certs-796481 localhost minikube]
I0805 23:47:33.829791 518398 provision.go:177] copyRemoteCerts
I0805 23:47:33.829872 518398 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0805 23:47:33.829923 518398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-796481
I0805 23:47:33.845902 518398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33443 SSHKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/embed-certs-796481/id_rsa Username:docker}
I0805 23:47:33.940834 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0805 23:47:33.968220 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0805 23:47:33.994184 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0805 23:47:34.023076 518398 provision.go:87] duration metric: took 834.310149ms to configureAuth
I0805 23:47:34.023107 518398 ubuntu.go:193] setting minikube options for container-runtime
I0805 23:47:34.023346 518398 config.go:182] Loaded profile config "embed-certs-796481": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0805 23:47:34.023363 518398 machine.go:97] duration metric: took 1.385610314s to provisionDockerMachine
I0805 23:47:34.023372 518398 client.go:171] duration metric: took 10.035621873s to LocalClient.Create
I0805 23:47:34.023393 518398 start.go:167] duration metric: took 10.035698452s to libmachine.API.Create "embed-certs-796481"
I0805 23:47:34.023405 518398 start.go:293] postStartSetup for "embed-certs-796481" (driver="docker")
I0805 23:47:34.023417 518398 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0805 23:47:34.023479 518398 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0805 23:47:34.023529 518398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-796481
I0805 23:47:34.041476 518398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33443 SSHKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/embed-certs-796481/id_rsa Username:docker}
I0805 23:47:34.144403 518398 ssh_runner.go:195] Run: cat /etc/os-release
I0805 23:47:34.148894 518398 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0805 23:47:34.148948 518398 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0805 23:47:34.148964 518398 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0805 23:47:34.148975 518398 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0805 23:47:34.148989 518398 filesync.go:126] Scanning /home/jenkins/minikube-integration/19373-295474/.minikube/addons for local assets ...
I0805 23:47:34.149067 518398 filesync.go:126] Scanning /home/jenkins/minikube-integration/19373-295474/.minikube/files for local assets ...
I0805 23:47:34.149179 518398 filesync.go:149] local asset: /home/jenkins/minikube-integration/19373-295474/.minikube/files/etc/ssl/certs/3008692.pem -> 3008692.pem in /etc/ssl/certs
I0805 23:47:34.149330 518398 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0805 23:47:34.159322 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/files/etc/ssl/certs/3008692.pem --> /etc/ssl/certs/3008692.pem (1708 bytes)
I0805 23:47:34.186244 518398 start.go:296] duration metric: took 162.8236ms for postStartSetup
I0805 23:47:34.186734 518398 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-796481
I0805 23:47:34.203443 518398 profile.go:143] Saving config to /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/config.json ...
I0805 23:47:34.203822 518398 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0805 23:47:34.203888 518398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-796481
I0805 23:47:34.220360 518398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33443 SSHKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/embed-certs-796481/id_rsa Username:docker}
I0805 23:47:34.312238 518398 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0805 23:47:34.317010 518398 start.go:128] duration metric: took 10.332395926s to createHost
I0805 23:47:34.317037 518398 start.go:83] releasing machines lock for "embed-certs-796481", held for 10.33257131s
I0805 23:47:34.317112 518398 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-796481
I0805 23:47:34.333672 518398 ssh_runner.go:195] Run: cat /version.json
I0805 23:47:34.333726 518398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-796481
I0805 23:47:34.333954 518398 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0805 23:47:34.334003 518398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-796481
I0805 23:47:34.361183 518398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33443 SSHKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/embed-certs-796481/id_rsa Username:docker}
I0805 23:47:34.361461 518398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33443 SSHKeyPath:/home/jenkins/minikube-integration/19373-295474/.minikube/machines/embed-certs-796481/id_rsa Username:docker}
I0805 23:47:34.454908 518398 ssh_runner.go:195] Run: systemctl --version
I0805 23:47:34.597267 518398 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0805 23:47:34.601547 518398 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0805 23:47:34.627131 518398 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0805 23:47:34.627234 518398 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0805 23:47:34.658413 518398 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0805 23:47:34.658474 518398 start.go:495] detecting cgroup driver to use...
I0805 23:47:34.658519 518398 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0805 23:47:34.658588 518398 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0805 23:47:34.671561 518398 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0805 23:47:34.683233 518398 docker.go:217] disabling cri-docker service (if available) ...
I0805 23:47:34.683389 518398 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0805 23:47:34.698280 518398 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0805 23:47:34.713829 518398 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0805 23:47:34.808219 518398 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0805 23:47:34.902260 518398 docker.go:233] disabling docker service ...
I0805 23:47:34.902362 518398 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0805 23:47:34.926027 518398 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0805 23:47:34.938142 518398 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0805 23:47:35.036342 518398 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0805 23:47:35.130252 518398 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0805 23:47:35.150176 518398 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0805 23:47:35.169543 518398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0805 23:47:35.181392 518398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0805 23:47:35.191942 518398 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0805 23:47:35.192040 518398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0805 23:47:35.202302 518398 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0805 23:47:35.212287 518398 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0805 23:47:35.222396 518398 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0805 23:47:35.232828 518398 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0805 23:47:35.241881 518398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0805 23:47:35.251771 518398 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0805 23:47:35.262874 518398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0805 23:47:35.273791 518398 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0805 23:47:35.282686 518398 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0805 23:47:35.291615 518398 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0805 23:47:35.373803 518398 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0805 23:47:35.514631 518398 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0805 23:47:35.514750 518398 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0805 23:47:35.518587 518398 start.go:563] Will wait 60s for crictl version
I0805 23:47:35.518700 518398 ssh_runner.go:195] Run: which crictl
I0805 23:47:35.522173 518398 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0805 23:47:35.566362 518398 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.19
RuntimeApiVersion: v1
I0805 23:47:35.566513 518398 ssh_runner.go:195] Run: containerd --version
I0805 23:47:35.589867 518398 ssh_runner.go:195] Run: containerd --version
I0805 23:47:35.617261 518398 out.go:177] * Preparing Kubernetes v1.30.3 on containerd 1.7.19 ...
I0805 23:47:35.619228 518398 cli_runner.go:164] Run: docker network inspect embed-certs-796481 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0805 23:47:35.633556 518398 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0805 23:47:35.637312 518398 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0805 23:47:35.648502 518398 kubeadm.go:883] updating cluster {Name:embed-certs-796481 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-796481 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0805 23:47:35.648622 518398 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
I0805 23:47:35.648687 518398 ssh_runner.go:195] Run: sudo crictl images --output json
I0805 23:47:35.686624 518398 containerd.go:627] all images are preloaded for containerd runtime.
I0805 23:47:35.686653 518398 containerd.go:534] Images already preloaded, skipping extraction
I0805 23:47:35.686720 518398 ssh_runner.go:195] Run: sudo crictl images --output json
I0805 23:47:35.722656 518398 containerd.go:627] all images are preloaded for containerd runtime.
I0805 23:47:35.722682 518398 cache_images.go:84] Images are preloaded, skipping loading
I0805 23:47:35.722690 518398 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.30.3 containerd true true} ...
I0805 23:47:35.722795 518398 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-796481 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.30.3 ClusterName:embed-certs-796481 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0805 23:47:35.722867 518398 ssh_runner.go:195] Run: sudo crictl info
I0805 23:47:35.760332 518398 cni.go:84] Creating CNI manager for ""
I0805 23:47:35.760363 518398 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0805 23:47:35.760374 518398 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0805 23:47:35.760434 518398 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-796481 NodeName:embed-certs-796481 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0805 23:47:35.760584 518398 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "embed-certs-796481"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.3
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0805 23:47:35.760653 518398 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3
I0805 23:47:35.769803 518398 binaries.go:44] Found k8s binaries, skipping transfer
I0805 23:47:35.769875 518398 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0805 23:47:35.783751 518398 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
I0805 23:47:35.805179 518398 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0805 23:47:35.823984 518398 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes)
I0805 23:47:35.843483 518398 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0805 23:47:35.846737 518398 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0805 23:47:35.857713 518398 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0805 23:47:35.942461 518398 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0805 23:47:35.961611 518398 certs.go:68] Setting up /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481 for IP: 192.168.76.2
I0805 23:47:35.961634 518398 certs.go:194] generating shared ca certs ...
I0805 23:47:35.961650 518398 certs.go:226] acquiring lock for ca certs: {Name:mk408d7b8fa372609a5c7cd4ef69cc7a591c2d2a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 23:47:35.961787 518398 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19373-295474/.minikube/ca.key
I0805 23:47:35.961837 518398 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19373-295474/.minikube/proxy-client-ca.key
I0805 23:47:35.961848 518398 certs.go:256] generating profile certs ...
I0805 23:47:35.961913 518398 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/client.key
I0805 23:47:35.961930 518398 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/client.crt with IP's: []
I0805 23:47:36.262675 518398 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/client.crt ...
I0805 23:47:36.262710 518398 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/client.crt: {Name:mka924553d39d5ec8d8e1c4a5e661c5650133171 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 23:47:36.263392 518398 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/client.key ...
I0805 23:47:36.263412 518398 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/client.key: {Name:mkddeb174b616aa3261b6369f57a69643929fec8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 23:47:36.264059 518398 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/apiserver.key.96e66266
I0805 23:47:36.264083 518398 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/apiserver.crt.96e66266 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.76.2]
I0805 23:47:36.809146 518398 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/apiserver.crt.96e66266 ...
I0805 23:47:36.809181 518398 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/apiserver.crt.96e66266: {Name:mk09d7236a7c89a3de4fe295a9c004d5fdc7b8d7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 23:47:36.809846 518398 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/apiserver.key.96e66266 ...
I0805 23:47:36.809869 518398 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/apiserver.key.96e66266: {Name:mk94035f3a52f9e6edf6ba66d7af4e46c01f5a53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 23:47:36.810549 518398 certs.go:381] copying /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/apiserver.crt.96e66266 -> /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/apiserver.crt
I0805 23:47:36.810646 518398 certs.go:385] copying /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/apiserver.key.96e66266 -> /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/apiserver.key
I0805 23:47:36.810708 518398 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/proxy-client.key
I0805 23:47:36.810727 518398 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/proxy-client.crt with IP's: []
I0805 23:47:37.231107 518398 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/proxy-client.crt ...
I0805 23:47:37.231197 518398 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/proxy-client.crt: {Name:mka09683dead00d953017bfa3142e7217643578a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 23:47:37.231787 518398 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/proxy-client.key ...
I0805 23:47:37.231840 518398 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/proxy-client.key: {Name:mkf9c27e0c794b4023d444856c0fd007bf06d9b2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 23:47:37.232537 518398 certs.go:484] found cert: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/300869.pem (1338 bytes)
W0805 23:47:37.232629 518398 certs.go:480] ignoring /home/jenkins/minikube-integration/19373-295474/.minikube/certs/300869_empty.pem, impossibly tiny 0 bytes
I0805 23:47:37.232656 518398 certs.go:484] found cert: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca-key.pem (1679 bytes)
I0805 23:47:37.232705 518398 certs.go:484] found cert: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/ca.pem (1078 bytes)
I0805 23:47:37.232757 518398 certs.go:484] found cert: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/cert.pem (1123 bytes)
I0805 23:47:37.232864 518398 certs.go:484] found cert: /home/jenkins/minikube-integration/19373-295474/.minikube/certs/key.pem (1679 bytes)
I0805 23:47:37.232938 518398 certs.go:484] found cert: /home/jenkins/minikube-integration/19373-295474/.minikube/files/etc/ssl/certs/3008692.pem (1708 bytes)
I0805 23:47:37.233598 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0805 23:47:37.261860 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0805 23:47:37.287556 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0805 23:47:37.313191 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0805 23:47:37.339702 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0805 23:47:37.365794 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0805 23:47:37.390641 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0805 23:47:37.416295 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/profiles/embed-certs-796481/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0805 23:47:37.443402 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/certs/300869.pem --> /usr/share/ca-certificates/300869.pem (1338 bytes)
I0805 23:47:37.469366 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/files/etc/ssl/certs/3008692.pem --> /usr/share/ca-certificates/3008692.pem (1708 bytes)
I0805 23:47:37.499220 518398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19373-295474/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0805 23:47:37.530508 518398 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0805 23:47:37.550965 518398 ssh_runner.go:195] Run: openssl version
I0805 23:47:37.556875 518398 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0805 23:47:37.570942 518398 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0805 23:47:37.574807 518398 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 5 22:49 /usr/share/ca-certificates/minikubeCA.pem
I0805 23:47:37.574876 518398 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0805 23:47:37.581997 518398 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0805 23:47:37.592011 518398 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/300869.pem && ln -fs /usr/share/ca-certificates/300869.pem /etc/ssl/certs/300869.pem"
I0805 23:47:37.602414 518398 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/300869.pem
I0805 23:47:37.606162 518398 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 5 23:00 /usr/share/ca-certificates/300869.pem
I0805 23:47:37.606231 518398 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/300869.pem
I0805 23:47:37.614034 518398 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/300869.pem /etc/ssl/certs/51391683.0"
I0805 23:47:37.624279 518398 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3008692.pem && ln -fs /usr/share/ca-certificates/3008692.pem /etc/ssl/certs/3008692.pem"
I0805 23:47:37.635096 518398 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3008692.pem
I0805 23:47:37.638674 518398 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 5 23:00 /usr/share/ca-certificates/3008692.pem
I0805 23:47:37.638756 518398 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3008692.pem
I0805 23:47:37.646092 518398 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3008692.pem /etc/ssl/certs/3ec20f2e.0"
I0805 23:47:37.655894 518398 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0805 23:47:37.659565 518398 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0805 23:47:37.659657 518398 kubeadm.go:392] StartCluster: {Name:embed-certs-796481 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-796481 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fal
se CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0805 23:47:37.659755 518398 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0805 23:47:37.659828 518398 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0805 23:47:37.698081 518398 cri.go:89] found id: ""
I0805 23:47:37.698196 518398 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0805 23:47:37.708074 518398 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0805 23:47:37.717438 518398 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0805 23:47:37.717563 518398 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0805 23:47:37.726777 518398 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0805 23:47:37.726836 518398 kubeadm.go:157] found existing configuration files:
I0805 23:47:37.726909 518398 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0805 23:47:37.736357 518398 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0805 23:47:37.736487 518398 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0805 23:47:37.745444 518398 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0805 23:47:37.754641 518398 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0805 23:47:37.754718 518398 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0805 23:47:37.763641 518398 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0805 23:47:37.773179 518398 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0805 23:47:37.773303 518398 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0805 23:47:37.782839 518398 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0805 23:47:37.791713 518398 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0805 23:47:37.791786 518398 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0805 23:47:37.800986 518398 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0805 23:47:37.848043 518398 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3
I0805 23:47:37.848333 518398 kubeadm.go:310] [preflight] Running pre-flight checks
I0805 23:47:37.894954 518398 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0805 23:47:37.895028 518398 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1066-aws[0m
I0805 23:47:37.895070 518398 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0805 23:47:37.895118 518398 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0805 23:47:37.895169 518398 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0805 23:47:37.895217 518398 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0805 23:47:37.895297 518398 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0805 23:47:37.895348 518398 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0805 23:47:37.895400 518398 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0805 23:47:37.895448 518398 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0805 23:47:37.895497 518398 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0805 23:47:37.895545 518398 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0805 23:47:37.975965 518398 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0805 23:47:37.976076 518398 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0805 23:47:37.976171 518398 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0805 23:47:38.247762 518398 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0805 23:47:38.424611 507478 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0805 23:47:38.435595 507478 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0805 23:47:38.437814 507478 out.go:177]
W0805 23:47:38.439587 507478 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0805 23:47:38.439790 507478 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0805 23:47:38.439873 507478 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0805 23:47:38.439917 507478 out.go:239] *
W0805 23:47:38.441220 507478 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0805 23:47:38.443895 507478 out.go:177]
I0805 23:47:38.250645 518398 out.go:204] - Generating certificates and keys ...
I0805 23:47:38.250747 518398 kubeadm.go:310] [certs] Using existing ca certificate authority
I0805 23:47:38.250822 518398 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0805 23:47:38.607544 518398 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
86f5ef99854ba 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 02cfa29d7cf69 dashboard-metrics-scraper-8d5bb5db8-v8rwj
156ce89ed6d27 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 cdf283c610430 kubernetes-dashboard-cd95d586-lxs2p
7d004de9baf7e ba04bb24b9575 5 minutes ago Running storage-provisioner 2 7f630545b8bb4 storage-provisioner
e97a1b8e27d74 1611cd07b61d5 5 minutes ago Running busybox 1 0ef97519417ca busybox
4533e7c882251 25a5233254979 5 minutes ago Running kube-proxy 1 4296256326e83 kube-proxy-q4vrh
2b39caa6f1085 db91994f4ee8f 5 minutes ago Running coredns 1 e01b8476c1a15 coredns-74ff55c5b-z2bp2
2735e7564bd9c d5e283bc63d43 5 minutes ago Running kindnet-cni 1 cd0d6e9196ebd kindnet-k6fd6
b2e5dbb97a8bc 1df8a2b116bd1 6 minutes ago Running kube-controller-manager 1 af9d05e94272f kube-controller-manager-old-k8s-version-375611
239f2943bc1fa e7605f88f17d6 6 minutes ago Running kube-scheduler 1 eed6f4c852b40 kube-scheduler-old-k8s-version-375611
e68c71f7afc0d 05b738aa1bc63 6 minutes ago Running etcd 1 8c9d3d02152f3 etcd-old-k8s-version-375611
fb4412296d907 2c08bbbc02d3a 6 minutes ago Running kube-apiserver 1 e2a6e2a863af9 kube-apiserver-old-k8s-version-375611
f45360b811124 1611cd07b61d5 6 minutes ago Exited busybox 0 914a5e79e3401 busybox
6064aa025609b ba04bb24b9575 8 minutes ago Exited storage-provisioner 1 067ba0c15bf47 storage-provisioner
a6fb77f7718de db91994f4ee8f 8 minutes ago Exited coredns 0 5add5db96860b coredns-74ff55c5b-z2bp2
41cf79dd5f131 d5e283bc63d43 8 minutes ago Exited kindnet-cni 0 93ad82d60eae1 kindnet-k6fd6
f0a58f073f5c7 25a5233254979 8 minutes ago Exited kube-proxy 0 9468dbbf41324 kube-proxy-q4vrh
6fde48373a0e7 e7605f88f17d6 9 minutes ago Exited kube-scheduler 0 1ec96e58ae343 kube-scheduler-old-k8s-version-375611
5cf8d64c50fe2 1df8a2b116bd1 9 minutes ago Exited kube-controller-manager 0 75cfd724d7b65 kube-controller-manager-old-k8s-version-375611
9591fcf9ec50f 05b738aa1bc63 9 minutes ago Exited etcd 0 ca4fbbe57c7e2 etcd-old-k8s-version-375611
b1b8743da3a07 2c08bbbc02d3a 9 minutes ago Exited kube-apiserver 0 e7d3a03d7592a kube-apiserver-old-k8s-version-375611
==> containerd <==
Aug 05 23:43:24 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:43:24.263423651Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Aug 05 23:43:24 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:43:24.265135133Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Aug 05 23:43:24 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:43:24.265184716Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Aug 05 23:43:47 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:43:47.256212154Z" level=info msg="CreateContainer within sandbox \"02cfa29d7cf691ec2c0fef684d14819f60cfebd5f15f3d8898a15405399a6398\" for container name:\"dashboard-metrics-scraper\" attempt:4"
Aug 05 23:43:47 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:43:47.277260631Z" level=info msg="CreateContainer within sandbox \"02cfa29d7cf691ec2c0fef684d14819f60cfebd5f15f3d8898a15405399a6398\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"5efd7e3f2c82fd3c84548f02c5e13532a23fbf7425a77e169ec5d3ef5b87dfbf\""
Aug 05 23:43:47 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:43:47.278694364Z" level=info msg="StartContainer for \"5efd7e3f2c82fd3c84548f02c5e13532a23fbf7425a77e169ec5d3ef5b87dfbf\""
Aug 05 23:43:47 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:43:47.345681553Z" level=info msg="StartContainer for \"5efd7e3f2c82fd3c84548f02c5e13532a23fbf7425a77e169ec5d3ef5b87dfbf\" returns successfully"
Aug 05 23:43:47 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:43:47.376414883Z" level=info msg="shim disconnected" id=5efd7e3f2c82fd3c84548f02c5e13532a23fbf7425a77e169ec5d3ef5b87dfbf namespace=k8s.io
Aug 05 23:43:47 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:43:47.376496293Z" level=warning msg="cleaning up after shim disconnected" id=5efd7e3f2c82fd3c84548f02c5e13532a23fbf7425a77e169ec5d3ef5b87dfbf namespace=k8s.io
Aug 05 23:43:47 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:43:47.376526077Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 05 23:43:47 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:43:47.951293647Z" level=info msg="RemoveContainer for \"7724e50f634501cf6a241e3e39f1597aab3e82747e158c50e34095ac0cdc4f9d\""
Aug 05 23:43:47 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:43:47.958029056Z" level=info msg="RemoveContainer for \"7724e50f634501cf6a241e3e39f1597aab3e82747e158c50e34095ac0cdc4f9d\" returns successfully"
Aug 05 23:44:54 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:44:54.254667570Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 23:44:54 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:44:54.259867104Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Aug 05 23:44:54 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:44:54.262008771Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Aug 05 23:44:54 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:44:54.262097098Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Aug 05 23:45:18 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:45:18.271074911Z" level=info msg="CreateContainer within sandbox \"02cfa29d7cf691ec2c0fef684d14819f60cfebd5f15f3d8898a15405399a6398\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Aug 05 23:45:18 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:45:18.291126935Z" level=info msg="CreateContainer within sandbox \"02cfa29d7cf691ec2c0fef684d14819f60cfebd5f15f3d8898a15405399a6398\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"86f5ef99854ba22d914633bacb589b62d961bdb7dc0538790b9297ab2d84bcc2\""
Aug 05 23:45:18 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:45:18.291781427Z" level=info msg="StartContainer for \"86f5ef99854ba22d914633bacb589b62d961bdb7dc0538790b9297ab2d84bcc2\""
Aug 05 23:45:18 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:45:18.369773108Z" level=info msg="StartContainer for \"86f5ef99854ba22d914633bacb589b62d961bdb7dc0538790b9297ab2d84bcc2\" returns successfully"
Aug 05 23:45:18 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:45:18.398618351Z" level=info msg="shim disconnected" id=86f5ef99854ba22d914633bacb589b62d961bdb7dc0538790b9297ab2d84bcc2 namespace=k8s.io
Aug 05 23:45:18 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:45:18.398689628Z" level=warning msg="cleaning up after shim disconnected" id=86f5ef99854ba22d914633bacb589b62d961bdb7dc0538790b9297ab2d84bcc2 namespace=k8s.io
Aug 05 23:45:18 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:45:18.398701230Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 05 23:45:19 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:45:19.234018182Z" level=info msg="RemoveContainer for \"5efd7e3f2c82fd3c84548f02c5e13532a23fbf7425a77e169ec5d3ef5b87dfbf\""
Aug 05 23:45:19 old-k8s-version-375611 containerd[568]: time="2024-08-05T23:45:19.238950110Z" level=info msg="RemoveContainer for \"5efd7e3f2c82fd3c84548f02c5e13532a23fbf7425a77e169ec5d3ef5b87dfbf\" returns successfully"
==> coredns [2b39caa6f1085047518aeb7a6117b5a3fc78d5496f8ddfe327efd3a89e20b70c] <==
[INFO] plugin/ready: Still waiting on: "kubernetes"
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:40470 - 37715 "HINFO IN 7788213044086810245.8750545682542848471. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.021265277s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0805 23:42:22.836139 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-05 23:41:52.835662043 +0000 UTC m=+0.020785288) (total time: 30.00037594s):
Trace[2019727887]: [30.00037594s] [30.00037594s] END
E0805 23:42:22.836172 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0805 23:42:22.836427 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-05 23:41:52.836060286 +0000 UTC m=+0.021183539) (total time: 30.000352957s):
Trace[939984059]: [30.000352957s] [30.000352957s] END
E0805 23:42:22.836447 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0805 23:42:22.836584 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-05 23:41:52.83622877 +0000 UTC m=+0.021352014) (total time: 30.000324059s):
Trace[911902081]: [30.000324059s] [30.000324059s] END
E0805 23:42:22.836623 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> coredns [a6fb77f7718de46e631aaa130f88714ab2e52f578f3fab363700a1a3dd05d055] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:45585 - 59657 "HINFO IN 5199116672282605800.6800961201085609954. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.032786601s
==> describe nodes <==
Name: old-k8s-version-375611
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-375611
kubernetes.io/os=linux
minikube.k8s.io/commit=a179f531dd2dbe55e0d6074abcbc378280f91bb4
minikube.k8s.io/name=old-k8s-version-375611
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_08_05T23_38_48_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 05 Aug 2024 23:38:44 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-375611
AcquireTime: <unset>
RenewTime: Mon, 05 Aug 2024 23:47:32 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 05 Aug 2024 23:42:43 +0000 Mon, 05 Aug 2024 23:38:38 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 05 Aug 2024 23:42:43 +0000 Mon, 05 Aug 2024 23:38:38 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 05 Aug 2024 23:42:43 +0000 Mon, 05 Aug 2024 23:38:38 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 05 Aug 2024 23:42:43 +0000 Mon, 05 Aug 2024 23:39:03 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-375611
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
System Info:
Machine ID: a23eee05b29f4decb28932966fde046f
System UUID: 2f4c3000-3648-4e26-84e8-e28a2160594a
Boot ID: 5b117d1c-02d3-4843-b80b-b52a243aaa59
Kernel Version: 5.15.0-1066-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.19
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m42s
kube-system coredns-74ff55c5b-z2bp2 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m38s
kube-system etcd-old-k8s-version-375611 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m45s
kube-system kindnet-k6fd6 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m38s
kube-system kube-apiserver-old-k8s-version-375611 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m45s
kube-system kube-controller-manager-old-k8s-version-375611 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m45s
kube-system kube-proxy-q4vrh 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m38s
kube-system kube-scheduler-old-k8s-version-375611 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m45s
kube-system metrics-server-9975d5f86-jpdq8 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m31s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m37s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-v8rwj 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m33s
kubernetes-dashboard kubernetes-dashboard-cd95d586-lxs2p 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m33s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 9m5s (x5 over 9m5s) kubelet Node old-k8s-version-375611 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m5s (x5 over 9m5s) kubelet Node old-k8s-version-375611 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m5s (x5 over 9m5s) kubelet Node old-k8s-version-375611 status is now: NodeHasSufficientPID
Normal Starting 8m45s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m45s kubelet Node old-k8s-version-375611 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m45s kubelet Node old-k8s-version-375611 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m45s kubelet Node old-k8s-version-375611 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m45s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m38s kubelet Node old-k8s-version-375611 status is now: NodeReady
Normal Starting 8m36s kube-proxy Starting kube-proxy.
Normal Starting 6m3s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m3s (x8 over 6m3s) kubelet Node old-k8s-version-375611 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m3s (x8 over 6m3s) kubelet Node old-k8s-version-375611 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m3s (x7 over 6m3s) kubelet Node old-k8s-version-375611 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m3s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m48s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000988] FS-Cache: O-key=[8] 'e03a5c0100000000'
[ +0.000631] FS-Cache: N-cookie c=0000001e [p=00000015 fl=2 nc=0 na=1]
[ +0.000831] FS-Cache: N-cookie d=00000000f2702d83{9p.inode} n=000000009254a5b5
[ +0.000922] FS-Cache: N-key=[8] 'e03a5c0100000000'
[ +0.002886] FS-Cache: Duplicate cookie detected
[ +0.000621] FS-Cache: O-cookie c=00000018 [p=00000015 fl=226 nc=0 na=1]
[ +0.000904] FS-Cache: O-cookie d=00000000f2702d83{9p.inode} n=00000000995f21e6
[ +0.000939] FS-Cache: O-key=[8] 'e03a5c0100000000'
[ +0.000629] FS-Cache: N-cookie c=0000001f [p=00000015 fl=2 nc=0 na=1]
[ +0.000838] FS-Cache: N-cookie d=00000000f2702d83{9p.inode} n=00000000849cc873
[ +0.000940] FS-Cache: N-key=[8] 'e03a5c0100000000'
[ +2.494381] FS-Cache: Duplicate cookie detected
[ +0.000699] FS-Cache: O-cookie c=00000016 [p=00000015 fl=226 nc=0 na=1]
[ +0.000866] FS-Cache: O-cookie d=00000000f2702d83{9p.inode} n=000000006c0205ea
[ +0.001087] FS-Cache: O-key=[8] 'df3a5c0100000000'
[ +0.000646] FS-Cache: N-cookie c=00000021 [p=00000015 fl=2 nc=0 na=1]
[ +0.000907] FS-Cache: N-cookie d=00000000f2702d83{9p.inode} n=00000000c2a00841
[ +0.000957] FS-Cache: N-key=[8] 'df3a5c0100000000'
[ +0.417708] FS-Cache: Duplicate cookie detected
[ +0.000644] FS-Cache: O-cookie c=0000001b [p=00000015 fl=226 nc=0 na=1]
[ +0.000895] FS-Cache: O-cookie d=00000000f2702d83{9p.inode} n=00000000aa372904
[ +0.000957] FS-Cache: O-key=[8] 'e53a5c0100000000'
[ +0.000643] FS-Cache: N-cookie c=00000022 [p=00000015 fl=2 nc=0 na=1]
[ +0.000885] FS-Cache: N-cookie d=00000000f2702d83{9p.inode} n=000000003bc302a4
[ +0.000956] FS-Cache: N-key=[8] 'e53a5c0100000000'
==> etcd [9591fcf9ec50f9c0dc47d7cf116b4bc84f0890bf85707a0eaa905012b906f848] <==
raft2024/08/05 23:38:38 INFO: 9f0758e1c58a86ed became leader at term 2
raft2024/08/05 23:38:38 INFO: raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2
2024-08-05 23:38:38.356305 I | etcdserver: setting up the initial cluster version to 3.4
2024-08-05 23:38:38.357301 N | etcdserver/membership: set the initial cluster version to 3.4
2024-08-05 23:38:38.357415 I | etcdserver/api: enabled capabilities for version 3.4
2024-08-05 23:38:38.357521 I | etcdserver: published {Name:old-k8s-version-375611 ClientURLs:[https://192.168.85.2:2379]} to cluster 68eaea490fab4e05
2024-08-05 23:38:38.357649 I | embed: ready to serve client requests
2024-08-05 23:38:38.358177 I | embed: ready to serve client requests
2024-08-05 23:38:38.359208 I | embed: serving client requests on 127.0.0.1:2379
2024-08-05 23:38:38.368886 I | embed: serving client requests on 192.168.85.2:2379
2024-08-05 23:38:58.765841 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:38:59.508765 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:39:09.508955 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:39:19.508891 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:39:29.508790 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:39:39.508793 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:39:49.508756 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:39:59.508874 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:40:09.508878 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:40:19.508770 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:40:29.508812 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:40:39.508880 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:40:49.508824 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:40:59.515228 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:41:09.509125 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [e68c71f7afc0dc37539082c1c20c925d963d28664511ac67f8a6c2e7d3db85fc] <==
2024-08-05 23:43:37.431073 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:43:47.431123 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:43:57.430836 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:44:07.431086 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:44:17.431059 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:44:27.431000 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:44:37.431027 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:44:47.430836 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:44:57.430966 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:45:07.431071 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:45:17.430985 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:45:27.431002 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:45:37.431460 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:45:47.430923 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:45:57.430908 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:46:07.430942 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:46:17.431066 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:46:27.430978 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:46:37.431104 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:46:47.430929 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:46:57.431070 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:47:07.430981 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:47:17.431059 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:47:27.431172 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-05 23:47:37.430971 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
23:47:41 up 3:30, 0 users, load average: 2.03, 2.08, 2.57
Linux old-k8s-version-375611 5.15.0-1066-aws #72~20.04.1-Ubuntu SMP Sat Jul 20 07:44:07 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [2735e7564bd9c0c6184f71ef1f354aeccbcfa5d6372704cdf34531f23e66f8c2] <==
I0805 23:46:13.068298 1 main.go:299] handling current node
I0805 23:46:23.069002 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:46:23.069046 1 main.go:299] handling current node
I0805 23:46:33.068114 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:46:33.068166 1 main.go:299] handling current node
W0805 23:46:40.974106 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0805 23:46:40.974145 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0805 23:46:43.068462 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:46:43.068604 1 main.go:299] handling current node
W0805 23:46:52.475407 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0805 23:46:52.475535 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0805 23:46:53.068472 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:46:53.068595 1 main.go:299] handling current node
W0805 23:46:55.341852 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0805 23:46:55.341888 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0805 23:47:03.068263 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:47:03.068304 1 main.go:299] handling current node
I0805 23:47:13.069058 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:47:13.069297 1 main.go:299] handling current node
I0805 23:47:23.068653 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:47:23.068886 1 main.go:299] handling current node
I0805 23:47:33.069015 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:47:33.069229 1 main.go:299] handling current node
W0805 23:47:39.649267 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0805 23:47:39.649529 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
==> kindnet [41cf79dd5f1310161781ecef777def36b1c177fb874e28de5d8fef142c0487da] <==
I0805 23:39:57.144437 1 main.go:299] handling current node
I0805 23:40:07.144424 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:40:07.144467 1 main.go:299] handling current node
I0805 23:40:17.144870 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:40:17.144912 1 main.go:299] handling current node
W0805 23:40:20.370084 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0805 23:40:20.370120 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
W0805 23:40:26.403111 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0805 23:40:26.403153 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0805 23:40:27.145097 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:40:27.145138 1 main.go:299] handling current node
W0805 23:40:27.783484 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0805 23:40:27.783557 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0805 23:40:37.144853 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:40:37.144888 1 main.go:299] handling current node
I0805 23:40:47.145041 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:40:47.145081 1 main.go:299] handling current node
I0805 23:40:57.144263 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:40:57.144304 1 main.go:299] handling current node
W0805 23:41:00.109013 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0805 23:41:00.109191 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
W0805 23:41:01.483241 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0805 23:41:01.483590 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0805 23:41:07.144404 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0805 23:41:07.144440 1 main.go:299] handling current node
==> kube-apiserver [b1b8743da3a076d6a5f3ed1c16dbf583bd9eb6f2908f11daae833fe8e843cfdf] <==
I0805 23:38:45.422849 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0805 23:38:45.422993 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0805 23:38:45.431891 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0805 23:38:45.436550 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0805 23:38:45.436751 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0805 23:38:45.960540 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0805 23:38:46.002047 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0805 23:38:46.115144 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
I0805 23:38:46.116482 1 controller.go:606] quota admission added evaluator for: endpoints
I0805 23:38:46.120978 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0805 23:38:47.053622 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0805 23:38:47.916538 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0805 23:38:47.999839 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0805 23:38:56.419121 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0805 23:39:03.472966 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0805 23:39:03.510538 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0805 23:39:18.498062 1 client.go:360] parsed scheme: "passthrough"
I0805 23:39:18.498115 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 23:39:18.498124 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0805 23:39:56.826962 1 client.go:360] parsed scheme: "passthrough"
I0805 23:39:56.827009 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 23:39:56.827019 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0805 23:40:36.809114 1 client.go:360] parsed scheme: "passthrough"
I0805 23:40:36.809162 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 23:40:36.809170 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [fb4412296d907ebe940afee2bcd959a113ae813b5af39f21c4fd257b8dc9eccc] <==
I0805 23:44:12.743681 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 23:44:12.743690 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0805 23:44:52.613059 1 handler_proxy.go:102] no RequestInfo found in the context
E0805 23:44:52.613274 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0805 23:44:52.613292 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0805 23:44:57.269014 1 client.go:360] parsed scheme: "passthrough"
I0805 23:44:57.269057 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 23:44:57.269093 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0805 23:45:40.535180 1 client.go:360] parsed scheme: "passthrough"
I0805 23:45:40.535221 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 23:45:40.535426 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0805 23:46:14.995427 1 client.go:360] parsed scheme: "passthrough"
I0805 23:46:14.995511 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 23:46:14.995543 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0805 23:46:47.176337 1 client.go:360] parsed scheme: "passthrough"
I0805 23:46:47.176382 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 23:46:47.176391 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0805 23:46:51.191793 1 handler_proxy.go:102] no RequestInfo found in the context
E0805 23:46:51.191908 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0805 23:46:51.191922 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0805 23:47:26.821723 1 client.go:360] parsed scheme: "passthrough"
I0805 23:47:26.821769 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0805 23:47:26.821777 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [5cf8d64c50fe281293e3e52f57b92667c5e8e2e65e7d3ce6796012a33141f207] <==
I0805 23:39:03.532781 1 shared_informer.go:247] Caches are synced for bootstrap_signer
I0805 23:39:03.533106 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-serving
I0805 23:39:03.533969 1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-old-k8s-version-375611" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0805 23:39:03.537766 1 shared_informer.go:247] Caches are synced for TTL
I0805 23:39:03.537974 1 shared_informer.go:247] Caches are synced for certificate-csrapproving
I0805 23:39:03.542561 1 shared_informer.go:247] Caches are synced for crt configmap
I0805 23:39:03.543515 1 shared_informer.go:247] Caches are synced for namespace
I0805 23:39:03.547340 1 shared_informer.go:247] Caches are synced for PVC protection
I0805 23:39:03.577349 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-q4vrh"
I0805 23:39:03.580331 1 shared_informer.go:247] Caches are synced for stateful set
I0805 23:39:03.608437 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-z2bp2"
I0805 23:39:03.608475 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-k6fd6"
I0805 23:39:03.629839 1 shared_informer.go:247] Caches are synced for HPA
I0805 23:39:03.670891 1 shared_informer.go:247] Caches are synced for resource quota
I0805 23:39:03.718772 1 shared_informer.go:247] Caches are synced for resource quota
I0805 23:39:03.905011 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0805 23:39:04.129941 1 shared_informer.go:247] Caches are synced for garbage collector
I0805 23:39:04.130004 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0805 23:39:04.205232 1 shared_informer.go:247] Caches are synced for garbage collector
I0805 23:39:05.076271 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0805 23:39:05.108800 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-689fc"
I0805 23:39:08.484963 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0805 23:41:09.003837 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
E0805 23:41:09.094113 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
E0805 23:41:09.097798 1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
==> kube-controller-manager [b2e5dbb97a8bce87cd5b22a5fb4d35f69eb570ca797a284b2a97e1908b4f01b3] <==
W0805 23:43:14.466323 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 23:43:40.502110 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 23:43:46.116921 1 request.go:655] Throttling request took 1.046436609s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0805 23:43:46.968513 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 23:44:11.006390 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 23:44:18.618990 1 request.go:655] Throttling request took 1.048466764s, request: GET:https://192.168.85.2:8443/apis/networking.k8s.io/v1?timeout=32s
W0805 23:44:19.470474 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 23:44:41.508940 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 23:44:51.120871 1 request.go:655] Throttling request took 1.048246794s, request: GET:https://192.168.85.2:8443/apis/apiregistration.k8s.io/v1beta1?timeout=32s
W0805 23:44:51.972453 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 23:45:12.012679 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 23:45:23.622970 1 request.go:655] Throttling request took 1.048374353s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0805 23:45:24.474375 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 23:45:42.514716 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 23:45:56.124849 1 request.go:655] Throttling request took 1.048238634s, request: GET:https://192.168.85.2:8443/apis/authentication.k8s.io/v1?timeout=32s
W0805 23:45:56.976338 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 23:46:13.016922 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 23:46:28.627110 1 request.go:655] Throttling request took 1.048398458s, request: GET:https://192.168.85.2:8443/apis/apps/v1?timeout=32s
W0805 23:46:29.478606 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 23:46:43.518676 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 23:47:01.129072 1 request.go:655] Throttling request took 1.029630565s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0805 23:47:01.981412 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0805 23:47:14.020657 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0805 23:47:33.633467 1 request.go:655] Throttling request took 1.041117658s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0805 23:47:34.485430 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [4533e7c882251f02335ccb9737a3a4302d3a2e79f479d6d0c81c62f137524de7] <==
I0805 23:41:53.087726 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0805 23:41:53.087804 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0805 23:41:53.106822 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0805 23:41:53.106921 1 server_others.go:185] Using iptables Proxier.
I0805 23:41:53.107341 1 server.go:650] Version: v1.20.0
I0805 23:41:53.107831 1 config.go:224] Starting endpoint slice config controller
I0805 23:41:53.107966 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0805 23:41:53.108133 1 config.go:315] Starting service config controller
I0805 23:41:53.108219 1 shared_informer.go:240] Waiting for caches to sync for service config
I0805 23:41:53.208385 1 shared_informer.go:247] Caches are synced for service config
I0805 23:41:53.208438 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-proxy [f0a58f073f5c7bc4f777cc7a18e11f853b1f72c4bf017997a3961d1d4be66f9a] <==
I0805 23:39:05.940791 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0805 23:39:05.940878 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0805 23:39:05.963570 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0805 23:39:05.963658 1 server_others.go:185] Using iptables Proxier.
I0805 23:39:05.963890 1 server.go:650] Version: v1.20.0
I0805 23:39:05.973519 1 config.go:315] Starting service config controller
I0805 23:39:05.973551 1 shared_informer.go:240] Waiting for caches to sync for service config
I0805 23:39:05.973582 1 config.go:224] Starting endpoint slice config controller
I0805 23:39:05.973587 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0805 23:39:06.073696 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0805 23:39:06.073773 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [239f2943bc1fa036cffa005d7bc59654ed4aa71550999412ce96d16c5ee24c87] <==
I0805 23:41:43.117629 1 serving.go:331] Generated self-signed cert in-memory
W0805 23:41:49.951374 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0805 23:41:49.959305 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0805 23:41:49.959355 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0805 23:41:49.959362 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0805 23:41:50.355964 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0805 23:41:50.356200 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0805 23:41:50.359732 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0805 23:41:50.360156 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0805 23:41:50.460101 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [6fde48373a0e71e9ae888db24d7116069eff729936107f8a14b69f87f46ae620] <==
W0805 23:38:44.559552 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0805 23:38:44.640433 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0805 23:38:44.640717 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0805 23:38:44.645052 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0805 23:38:44.654931 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
E0805 23:38:44.655846 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0805 23:38:44.658641 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0805 23:38:44.659337 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0805 23:38:44.659471 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0805 23:38:44.659974 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0805 23:38:44.664203 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0805 23:38:44.664442 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0805 23:38:44.664682 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0805 23:38:44.664861 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0805 23:38:44.665029 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0805 23:38:44.666721 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0805 23:38:44.669461 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0805 23:38:45.546268 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0805 23:38:45.577494 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0805 23:38:45.629421 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0805 23:38:45.635505 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0805 23:38:45.642065 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0805 23:38:45.669555 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0805 23:38:45.783342 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
I0805 23:38:46.155157 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Aug 05 23:45:52 old-k8s-version-375611 kubelet[664]: E0805 23:45:52.253861 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
Aug 05 23:45:59 old-k8s-version-375611 kubelet[664]: E0805 23:45:59.253981 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 23:46:06 old-k8s-version-375611 kubelet[664]: I0805 23:46:06.253674 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 86f5ef99854ba22d914633bacb589b62d961bdb7dc0538790b9297ab2d84bcc2
Aug 05 23:46:06 old-k8s-version-375611 kubelet[664]: E0805 23:46:06.254418 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
Aug 05 23:46:10 old-k8s-version-375611 kubelet[664]: E0805 23:46:10.254218 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 23:46:17 old-k8s-version-375611 kubelet[664]: I0805 23:46:17.253295 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 86f5ef99854ba22d914633bacb589b62d961bdb7dc0538790b9297ab2d84bcc2
Aug 05 23:46:17 old-k8s-version-375611 kubelet[664]: E0805 23:46:17.253633 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
Aug 05 23:46:25 old-k8s-version-375611 kubelet[664]: E0805 23:46:25.253988 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 23:46:28 old-k8s-version-375611 kubelet[664]: I0805 23:46:28.253711 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 86f5ef99854ba22d914633bacb589b62d961bdb7dc0538790b9297ab2d84bcc2
Aug 05 23:46:28 old-k8s-version-375611 kubelet[664]: E0805 23:46:28.254493 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
Aug 05 23:46:36 old-k8s-version-375611 kubelet[664]: E0805 23:46:36.255023 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 23:46:42 old-k8s-version-375611 kubelet[664]: I0805 23:46:42.253562 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 86f5ef99854ba22d914633bacb589b62d961bdb7dc0538790b9297ab2d84bcc2
Aug 05 23:46:42 old-k8s-version-375611 kubelet[664]: E0805 23:46:42.254426 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
Aug 05 23:46:47 old-k8s-version-375611 kubelet[664]: E0805 23:46:47.253936 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 23:46:57 old-k8s-version-375611 kubelet[664]: I0805 23:46:57.253653 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 86f5ef99854ba22d914633bacb589b62d961bdb7dc0538790b9297ab2d84bcc2
Aug 05 23:46:57 old-k8s-version-375611 kubelet[664]: E0805 23:46:57.255244 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
Aug 05 23:47:01 old-k8s-version-375611 kubelet[664]: E0805 23:47:01.254026 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 23:47:10 old-k8s-version-375611 kubelet[664]: I0805 23:47:10.253418 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 86f5ef99854ba22d914633bacb589b62d961bdb7dc0538790b9297ab2d84bcc2
Aug 05 23:47:10 old-k8s-version-375611 kubelet[664]: E0805 23:47:10.255321 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
Aug 05 23:47:16 old-k8s-version-375611 kubelet[664]: E0805 23:47:16.254092 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 23:47:23 old-k8s-version-375611 kubelet[664]: I0805 23:47:23.254040 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 86f5ef99854ba22d914633bacb589b62d961bdb7dc0538790b9297ab2d84bcc2
Aug 05 23:47:23 old-k8s-version-375611 kubelet[664]: E0805 23:47:23.254370 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
Aug 05 23:47:29 old-k8s-version-375611 kubelet[664]: E0805 23:47:29.259492 664 pod_workers.go:191] Error syncing pod fbd9b88d-ea4b-47a0-8075-96208c1acec9 ("metrics-server-9975d5f86-jpdq8_kube-system(fbd9b88d-ea4b-47a0-8075-96208c1acec9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 05 23:47:37 old-k8s-version-375611 kubelet[664]: I0805 23:47:37.253393 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 86f5ef99854ba22d914633bacb589b62d961bdb7dc0538790b9297ab2d84bcc2
Aug 05 23:47:37 old-k8s-version-375611 kubelet[664]: E0805 23:47:37.254008 664 pod_workers.go:191] Error syncing pod 8badf454-c170-4f03-a63e-ec751723377e ("dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-v8rwj_kubernetes-dashboard(8badf454-c170-4f03-a63e-ec751723377e)"
==> kubernetes-dashboard [156ce89ed6d27a90c91eab334249d8a894d2759a3dd64666b519f2334cea4d83] <==
2024/08/05 23:42:17 Using namespace: kubernetes-dashboard
2024/08/05 23:42:17 Using in-cluster config to connect to apiserver
2024/08/05 23:42:17 Using secret token for csrf signing
2024/08/05 23:42:17 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/08/05 23:42:17 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/08/05 23:42:17 Successful initial request to the apiserver, version: v1.20.0
2024/08/05 23:42:17 Generating JWE encryption key
2024/08/05 23:42:17 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/08/05 23:42:18 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/08/05 23:42:18 Initializing JWE encryption key from synchronized object
2024/08/05 23:42:18 Creating in-cluster Sidecar client
2024/08/05 23:42:18 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 23:42:18 Serving insecurely on HTTP port: 9090
2024/08/05 23:42:48 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 23:43:18 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 23:43:48 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 23:44:18 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 23:44:48 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 23:45:18 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 23:45:48 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 23:46:18 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 23:46:48 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 23:47:18 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/05 23:42:17 Starting overwatch
==> storage-provisioner [6064aa025609bb6d981e24f1c08cf4fc365902e17c5e558d538e6910a7f12728] <==
I0805 23:39:36.741430 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0805 23:39:36.764118 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0805 23:39:36.764247 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0805 23:39:36.776882 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0805 23:39:36.777277 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-375611_3ed16dc4-55da-4028-875b-24cfe13acd21!
I0805 23:39:36.781866 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"62cdd2ec-caa5-48e3-84c5-6a09ee2812dd", APIVersion:"v1", ResourceVersion:"504", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-375611_3ed16dc4-55da-4028-875b-24cfe13acd21 became leader
I0805 23:39:36.878287 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-375611_3ed16dc4-55da-4028-875b-24cfe13acd21!
==> storage-provisioner [7d004de9baf7e1f5fe4d38a3eda0e0394f9fe775247b84a622dee9432f9b3d45] <==
I0805 23:41:54.249088 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0805 23:41:54.264469 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0805 23:41:54.264668 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0805 23:42:11.739684 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0805 23:42:11.741317 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"62cdd2ec-caa5-48e3-84c5-6a09ee2812dd", APIVersion:"v1", ResourceVersion:"784", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-375611_3919a0e3-6e47-4b30-bb3b-86136ec16c68 became leader
I0805 23:42:11.741483 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-375611_3919a0e3-6e47-4b30-bb3b-86136ec16c68!
I0805 23:42:11.842365 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-375611_3919a0e3-6e47-4b30-bb3b-86136ec16c68!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-375611 -n old-k8s-version-375611
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-375611 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-jpdq8
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-375611 describe pod metrics-server-9975d5f86-jpdq8
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-375611 describe pod metrics-server-9975d5f86-jpdq8: exit status 1 (111.326184ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-jpdq8" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-375611 describe pod metrics-server-9975d5f86-jpdq8: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (381.19s)