=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-445570 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E1004 03:39:46.461201 1154813 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19546-1149434/.minikube/profiles/functional-421253/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-445570 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m8.878031427s)
-- stdout --
* [old-k8s-version-445570] minikube v1.34.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19546
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19546-1149434/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19546-1149434/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.31.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.1
* Using the docker driver based on existing profile
* Starting "old-k8s-version-445570" primary control-plane node in "old-k8s-version-445570" cluster
* Pulling base image v0.0.45-1727731891-master ...
* Restarting existing docker container for "old-k8s-version-445570" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.22 ...
* Verifying Kubernetes components...
- Using image registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-445570 addons enable metrics-server
* Enabled addons: storage-provisioner, dashboard, default-storageclass, metrics-server
-- /stdout --
** stderr **
I1004 03:39:39.059875 1364533 out.go:345] Setting OutFile to fd 1 ...
I1004 03:39:39.060145 1364533 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1004 03:39:39.060201 1364533 out.go:358] Setting ErrFile to fd 2...
I1004 03:39:39.060221 1364533 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1004 03:39:39.060600 1364533 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19546-1149434/.minikube/bin
I1004 03:39:39.061097 1364533 out.go:352] Setting JSON to false
I1004 03:39:39.062826 1364533 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":26527,"bootTime":1727986652,"procs":209,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I1004 03:39:39.062944 1364533 start.go:139] virtualization:
I1004 03:39:39.066781 1364533 out.go:177] * [old-k8s-version-445570] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I1004 03:39:39.068865 1364533 out.go:177] - MINIKUBE_LOCATION=19546
I1004 03:39:39.068966 1364533 notify.go:220] Checking for updates...
I1004 03:39:39.071907 1364533 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1004 03:39:39.073999 1364533 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19546-1149434/kubeconfig
I1004 03:39:39.075878 1364533 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19546-1149434/.minikube
I1004 03:39:39.078366 1364533 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I1004 03:39:39.080417 1364533 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1004 03:39:39.082896 1364533 config.go:182] Loaded profile config "old-k8s-version-445570": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I1004 03:39:39.085291 1364533 out.go:177] * Kubernetes 1.31.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.1
I1004 03:39:39.087146 1364533 driver.go:394] Setting default libvirt URI to qemu:///system
I1004 03:39:39.137410 1364533 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I1004 03:39:39.137543 1364533 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1004 03:39:39.226936 1364533 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:55 OomKillDisable:true NGoroutines:67 SystemTime:2024-10-04 03:39:39.211232422 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I1004 03:39:39.227088 1364533 docker.go:318] overlay module found
I1004 03:39:39.229593 1364533 out.go:177] * Using the docker driver based on existing profile
I1004 03:39:39.231556 1364533 start.go:297] selected driver: docker
I1004 03:39:39.231574 1364533 start.go:901] validating driver "docker" against &{Name:old-k8s-version-445570 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-445570 Namespace:default APIServerHAVIP: A
PIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:f
alse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1004 03:39:39.231687 1364533 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1004 03:39:39.232485 1364533 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1004 03:39:39.314752 1364533 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:55 OomKillDisable:true NGoroutines:67 SystemTime:2024-10-04 03:39:39.30114615 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aa
rch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridg
e-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I1004 03:39:39.315257 1364533 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1004 03:39:39.315286 1364533 cni.go:84] Creating CNI manager for ""
I1004 03:39:39.315360 1364533 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1004 03:39:39.315441 1364533 start.go:340] cluster config:
{Name:old-k8s-version-445570 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-445570 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loca
l ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:d
ocker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1004 03:39:39.317531 1364533 out.go:177] * Starting "old-k8s-version-445570" primary control-plane node in "old-k8s-version-445570" cluster
I1004 03:39:39.319168 1364533 cache.go:121] Beginning downloading kic base image for docker with containerd
I1004 03:39:39.320942 1364533 out.go:177] * Pulling base image v0.0.45-1727731891-master ...
I1004 03:39:39.325154 1364533 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I1004 03:39:39.325213 1364533 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19546-1149434/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I1004 03:39:39.325224 1364533 cache.go:56] Caching tarball of preloaded images
I1004 03:39:39.325303 1364533 preload.go:172] Found /home/jenkins/minikube-integration/19546-1149434/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I1004 03:39:39.325312 1364533 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I1004 03:39:39.325431 1364533 profile.go:143] Saving config to /home/jenkins/minikube-integration/19546-1149434/.minikube/profiles/old-k8s-version-445570/config.json ...
I1004 03:39:39.325661 1364533 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 in local docker daemon
I1004 03:39:39.356504 1364533 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 in local docker daemon, skipping pull
I1004 03:39:39.356523 1364533 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 exists in daemon, skipping load
I1004 03:39:39.356537 1364533 cache.go:194] Successfully downloaded all kic artifacts
I1004 03:39:39.356564 1364533 start.go:360] acquireMachinesLock for old-k8s-version-445570: {Name:mkdd704622089ee663daae5187f69a0613c5aa4f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1004 03:39:39.356615 1364533 start.go:364] duration metric: took 33.148µs to acquireMachinesLock for "old-k8s-version-445570"
I1004 03:39:39.356635 1364533 start.go:96] Skipping create...Using existing machine configuration
I1004 03:39:39.356640 1364533 fix.go:54] fixHost starting:
I1004 03:39:39.356898 1364533 cli_runner.go:164] Run: docker container inspect old-k8s-version-445570 --format={{.State.Status}}
I1004 03:39:39.378912 1364533 fix.go:112] recreateIfNeeded on old-k8s-version-445570: state=Stopped err=<nil>
W1004 03:39:39.378946 1364533 fix.go:138] unexpected machine state, will restart: <nil>
I1004 03:39:39.381302 1364533 out.go:177] * Restarting existing docker container for "old-k8s-version-445570" ...
I1004 03:39:39.383202 1364533 cli_runner.go:164] Run: docker start old-k8s-version-445570
I1004 03:39:39.756138 1364533 cli_runner.go:164] Run: docker container inspect old-k8s-version-445570 --format={{.State.Status}}
I1004 03:39:39.798468 1364533 kic.go:430] container "old-k8s-version-445570" state is running.
I1004 03:39:39.798994 1364533 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-445570
I1004 03:39:39.824952 1364533 profile.go:143] Saving config to /home/jenkins/minikube-integration/19546-1149434/.minikube/profiles/old-k8s-version-445570/config.json ...
I1004 03:39:39.825193 1364533 machine.go:93] provisionDockerMachine start ...
I1004 03:39:39.825252 1364533 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-445570
I1004 03:39:39.848502 1364533 main.go:141] libmachine: Using SSH client type: native
I1004 03:39:39.848913 1364533 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 34547 <nil> <nil>}
I1004 03:39:39.848929 1364533 main.go:141] libmachine: About to run SSH command:
hostname
I1004 03:39:39.849725 1364533 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59636->127.0.0.1:34547: read: connection reset by peer
I1004 03:39:42.992408 1364533 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-445570
I1004 03:39:42.992480 1364533 ubuntu.go:169] provisioning hostname "old-k8s-version-445570"
I1004 03:39:42.992593 1364533 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-445570
I1004 03:39:43.022009 1364533 main.go:141] libmachine: Using SSH client type: native
I1004 03:39:43.022321 1364533 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 34547 <nil> <nil>}
I1004 03:39:43.022334 1364533 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-445570 && echo "old-k8s-version-445570" | sudo tee /etc/hostname
I1004 03:39:43.193388 1364533 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-445570
I1004 03:39:43.193481 1364533 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-445570
I1004 03:39:43.215372 1364533 main.go:141] libmachine: Using SSH client type: native
I1004 03:39:43.215629 1364533 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 34547 <nil> <nil>}
I1004 03:39:43.215655 1364533 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-445570' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-445570/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-445570' | sudo tee -a /etc/hosts;
fi
fi
I1004 03:39:43.352718 1364533 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1004 03:39:43.352749 1364533 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19546-1149434/.minikube CaCertPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19546-1149434/.minikube}
I1004 03:39:43.352794 1364533 ubuntu.go:177] setting up certificates
I1004 03:39:43.352813 1364533 provision.go:84] configureAuth start
I1004 03:39:43.352895 1364533 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-445570
I1004 03:39:43.372168 1364533 provision.go:143] copyHostCerts
I1004 03:39:43.372236 1364533 exec_runner.go:144] found /home/jenkins/minikube-integration/19546-1149434/.minikube/ca.pem, removing ...
I1004 03:39:43.372258 1364533 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19546-1149434/.minikube/ca.pem
I1004 03:39:43.372352 1364533 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19546-1149434/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19546-1149434/.minikube/ca.pem (1078 bytes)
I1004 03:39:43.372464 1364533 exec_runner.go:144] found /home/jenkins/minikube-integration/19546-1149434/.minikube/cert.pem, removing ...
I1004 03:39:43.372475 1364533 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19546-1149434/.minikube/cert.pem
I1004 03:39:43.372506 1364533 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19546-1149434/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19546-1149434/.minikube/cert.pem (1123 bytes)
I1004 03:39:43.372578 1364533 exec_runner.go:144] found /home/jenkins/minikube-integration/19546-1149434/.minikube/key.pem, removing ...
I1004 03:39:43.372590 1364533 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19546-1149434/.minikube/key.pem
I1004 03:39:43.372616 1364533 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19546-1149434/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19546-1149434/.minikube/key.pem (1679 bytes)
I1004 03:39:43.372676 1364533 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19546-1149434/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19546-1149434/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19546-1149434/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-445570 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-445570]
I1004 03:39:44.255796 1364533 provision.go:177] copyRemoteCerts
I1004 03:39:44.255897 1364533 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1004 03:39:44.255950 1364533 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-445570
I1004 03:39:44.274513 1364533 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/machines/old-k8s-version-445570/id_rsa Username:docker}
I1004 03:39:44.376749 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1004 03:39:44.405454 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1004 03:39:44.431203 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I1004 03:39:44.457164 1364533 provision.go:87] duration metric: took 1.104336663s to configureAuth
I1004 03:39:44.457189 1364533 ubuntu.go:193] setting minikube options for container-runtime
I1004 03:39:44.457404 1364533 config.go:182] Loaded profile config "old-k8s-version-445570": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I1004 03:39:44.457412 1364533 machine.go:96] duration metric: took 4.632210919s to provisionDockerMachine
I1004 03:39:44.457420 1364533 start.go:293] postStartSetup for "old-k8s-version-445570" (driver="docker")
I1004 03:39:44.457467 1364533 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1004 03:39:44.457515 1364533 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1004 03:39:44.457561 1364533 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-445570
I1004 03:39:44.476967 1364533 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/machines/old-k8s-version-445570/id_rsa Username:docker}
I1004 03:39:44.574005 1364533 ssh_runner.go:195] Run: cat /etc/os-release
I1004 03:39:44.577521 1364533 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1004 03:39:44.577559 1364533 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I1004 03:39:44.577577 1364533 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I1004 03:39:44.577586 1364533 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I1004 03:39:44.577596 1364533 filesync.go:126] Scanning /home/jenkins/minikube-integration/19546-1149434/.minikube/addons for local assets ...
I1004 03:39:44.577656 1364533 filesync.go:126] Scanning /home/jenkins/minikube-integration/19546-1149434/.minikube/files for local assets ...
I1004 03:39:44.577746 1364533 filesync.go:149] local asset: /home/jenkins/minikube-integration/19546-1149434/.minikube/files/etc/ssl/certs/11548132.pem -> 11548132.pem in /etc/ssl/certs
I1004 03:39:44.577858 1364533 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1004 03:39:44.586763 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/files/etc/ssl/certs/11548132.pem --> /etc/ssl/certs/11548132.pem (1708 bytes)
I1004 03:39:44.613287 1364533 start.go:296] duration metric: took 155.851037ms for postStartSetup
I1004 03:39:44.613394 1364533 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1004 03:39:44.613457 1364533 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-445570
I1004 03:39:44.630936 1364533 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/machines/old-k8s-version-445570/id_rsa Username:docker}
I1004 03:39:44.725761 1364533 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1004 03:39:44.730917 1364533 fix.go:56] duration metric: took 5.374268178s for fixHost
I1004 03:39:44.730943 1364533 start.go:83] releasing machines lock for "old-k8s-version-445570", held for 5.374320272s
I1004 03:39:44.731013 1364533 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-445570
I1004 03:39:44.758053 1364533 ssh_runner.go:195] Run: cat /version.json
I1004 03:39:44.758135 1364533 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-445570
I1004 03:39:44.758427 1364533 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1004 03:39:44.758483 1364533 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-445570
I1004 03:39:44.794066 1364533 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/machines/old-k8s-version-445570/id_rsa Username:docker}
I1004 03:39:44.808970 1364533 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/machines/old-k8s-version-445570/id_rsa Username:docker}
I1004 03:39:44.892034 1364533 ssh_runner.go:195] Run: systemctl --version
I1004 03:39:45.064754 1364533 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1004 03:39:45.071238 1364533 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I1004 03:39:45.111215 1364533 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I1004 03:39:45.111325 1364533 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1004 03:39:45.128659 1364533 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1004 03:39:45.128750 1364533 start.go:495] detecting cgroup driver to use...
I1004 03:39:45.128821 1364533 detect.go:187] detected "cgroupfs" cgroup driver on host os
I1004 03:39:45.128914 1364533 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1004 03:39:45.151235 1364533 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1004 03:39:45.184040 1364533 docker.go:217] disabling cri-docker service (if available) ...
I1004 03:39:45.184138 1364533 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1004 03:39:45.201870 1364533 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1004 03:39:45.217441 1364533 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1004 03:39:45.386558 1364533 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1004 03:39:45.511002 1364533 docker.go:233] disabling docker service ...
I1004 03:39:45.511098 1364533 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1004 03:39:45.530559 1364533 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1004 03:39:45.545691 1364533 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1004 03:39:45.660120 1364533 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1004 03:39:45.770124 1364533 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1004 03:39:45.783352 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1004 03:39:45.801815 1364533 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I1004 03:39:45.811911 1364533 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1004 03:39:45.821716 1364533 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I1004 03:39:45.821799 1364533 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I1004 03:39:45.831560 1364533 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1004 03:39:45.841311 1364533 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1004 03:39:45.850849 1364533 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1004 03:39:45.860341 1364533 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1004 03:39:45.869289 1364533 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1004 03:39:45.878908 1364533 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1004 03:39:45.887771 1364533 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1004 03:39:45.897063 1364533 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1004 03:39:46.001490 1364533 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1004 03:39:46.203882 1364533 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I1004 03:39:46.203972 1364533 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I1004 03:39:46.213619 1364533 start.go:563] Will wait 60s for crictl version
I1004 03:39:46.213714 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:39:46.217374 1364533 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1004 03:39:46.276650 1364533 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I1004 03:39:46.276728 1364533 ssh_runner.go:195] Run: containerd --version
I1004 03:39:46.304299 1364533 ssh_runner.go:195] Run: containerd --version
I1004 03:39:46.328314 1364533 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.22 ...
I1004 03:39:46.330104 1364533 cli_runner.go:164] Run: docker network inspect old-k8s-version-445570 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1004 03:39:46.344439 1364533 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I1004 03:39:46.348311 1364533 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1004 03:39:46.359659 1364533 kubeadm.go:883] updating cluster {Name:old-k8s-version-445570 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-445570 Namespace:default APIServerHAVIP: APIServerName:mini
kubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:
/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1004 03:39:46.359790 1364533 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I1004 03:39:46.359856 1364533 ssh_runner.go:195] Run: sudo crictl images --output json
I1004 03:39:46.409386 1364533 containerd.go:627] all images are preloaded for containerd runtime.
I1004 03:39:46.409410 1364533 containerd.go:534] Images already preloaded, skipping extraction
I1004 03:39:46.409474 1364533 ssh_runner.go:195] Run: sudo crictl images --output json
I1004 03:39:46.455757 1364533 containerd.go:627] all images are preloaded for containerd runtime.
I1004 03:39:46.455780 1364533 cache_images.go:84] Images are preloaded, skipping loading
I1004 03:39:46.455787 1364533 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I1004 03:39:46.455894 1364533 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-445570 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-445570 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1004 03:39:46.455961 1364533 ssh_runner.go:195] Run: sudo crictl info
I1004 03:39:46.506603 1364533 cni.go:84] Creating CNI manager for ""
I1004 03:39:46.506628 1364533 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1004 03:39:46.506654 1364533 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I1004 03:39:46.506705 1364533 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-445570 NodeName:old-k8s-version-445570 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I1004 03:39:46.506852 1364533 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-445570"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1004 03:39:46.506929 1364533 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I1004 03:39:46.521788 1364533 binaries.go:44] Found k8s binaries, skipping transfer
I1004 03:39:46.521912 1364533 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1004 03:39:46.534729 1364533 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I1004 03:39:46.554922 1364533 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1004 03:39:46.575343 1364533 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I1004 03:39:46.595798 1364533 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I1004 03:39:46.599238 1364533 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1004 03:39:46.610170 1364533 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1004 03:39:46.703369 1364533 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1004 03:39:46.724817 1364533 certs.go:68] Setting up /home/jenkins/minikube-integration/19546-1149434/.minikube/profiles/old-k8s-version-445570 for IP: 192.168.76.2
I1004 03:39:46.724840 1364533 certs.go:194] generating shared ca certs ...
I1004 03:39:46.724856 1364533 certs.go:226] acquiring lock for ca certs: {Name:mkbb55aef12d0dc8daa9e4b13628be072878b5e3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1004 03:39:46.725037 1364533 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19546-1149434/.minikube/ca.key
I1004 03:39:46.725096 1364533 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19546-1149434/.minikube/proxy-client-ca.key
I1004 03:39:46.725108 1364533 certs.go:256] generating profile certs ...
I1004 03:39:46.725199 1364533 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19546-1149434/.minikube/profiles/old-k8s-version-445570/client.key
I1004 03:39:46.725284 1364533 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19546-1149434/.minikube/profiles/old-k8s-version-445570/apiserver.key.37c5016b
I1004 03:39:46.725341 1364533 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19546-1149434/.minikube/profiles/old-k8s-version-445570/proxy-client.key
I1004 03:39:46.725471 1364533 certs.go:484] found cert: /home/jenkins/minikube-integration/19546-1149434/.minikube/certs/1154813.pem (1338 bytes)
W1004 03:39:46.725515 1364533 certs.go:480] ignoring /home/jenkins/minikube-integration/19546-1149434/.minikube/certs/1154813_empty.pem, impossibly tiny 0 bytes
I1004 03:39:46.725528 1364533 certs.go:484] found cert: /home/jenkins/minikube-integration/19546-1149434/.minikube/certs/ca-key.pem (1675 bytes)
I1004 03:39:46.725557 1364533 certs.go:484] found cert: /home/jenkins/minikube-integration/19546-1149434/.minikube/certs/ca.pem (1078 bytes)
I1004 03:39:46.725588 1364533 certs.go:484] found cert: /home/jenkins/minikube-integration/19546-1149434/.minikube/certs/cert.pem (1123 bytes)
I1004 03:39:46.725612 1364533 certs.go:484] found cert: /home/jenkins/minikube-integration/19546-1149434/.minikube/certs/key.pem (1679 bytes)
I1004 03:39:46.725659 1364533 certs.go:484] found cert: /home/jenkins/minikube-integration/19546-1149434/.minikube/files/etc/ssl/certs/11548132.pem (1708 bytes)
I1004 03:39:46.726354 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1004 03:39:46.751426 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1004 03:39:46.775153 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1004 03:39:46.800706 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I1004 03:39:46.825837 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/profiles/old-k8s-version-445570/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I1004 03:39:46.849707 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/profiles/old-k8s-version-445570/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1004 03:39:46.873203 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/profiles/old-k8s-version-445570/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1004 03:39:46.902706 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/profiles/old-k8s-version-445570/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1004 03:39:46.928995 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/certs/1154813.pem --> /usr/share/ca-certificates/1154813.pem (1338 bytes)
I1004 03:39:46.957252 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/files/etc/ssl/certs/11548132.pem --> /usr/share/ca-certificates/11548132.pem (1708 bytes)
I1004 03:39:46.989120 1364533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19546-1149434/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1004 03:39:47.018695 1364533 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1004 03:39:47.056586 1364533 ssh_runner.go:195] Run: openssl version
I1004 03:39:47.065628 1364533 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11548132.pem && ln -fs /usr/share/ca-certificates/11548132.pem /etc/ssl/certs/11548132.pem"
I1004 03:39:47.076994 1364533 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11548132.pem
I1004 03:39:47.082753 1364533 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 4 02:59 /usr/share/ca-certificates/11548132.pem
I1004 03:39:47.082870 1364533 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11548132.pem
I1004 03:39:47.090077 1364533 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/11548132.pem /etc/ssl/certs/3ec20f2e.0"
I1004 03:39:47.102977 1364533 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1004 03:39:47.113652 1364533 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1004 03:39:47.117748 1364533 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 4 02:48 /usr/share/ca-certificates/minikubeCA.pem
I1004 03:39:47.117863 1364533 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1004 03:39:47.125262 1364533 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1004 03:39:47.140154 1364533 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1154813.pem && ln -fs /usr/share/ca-certificates/1154813.pem /etc/ssl/certs/1154813.pem"
I1004 03:39:47.153756 1364533 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1154813.pem
I1004 03:39:47.158005 1364533 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 4 02:59 /usr/share/ca-certificates/1154813.pem
I1004 03:39:47.158142 1364533 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1154813.pem
I1004 03:39:47.166553 1364533 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1154813.pem /etc/ssl/certs/51391683.0"
I1004 03:39:47.179092 1364533 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1004 03:39:47.183338 1364533 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1004 03:39:47.190565 1364533 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1004 03:39:47.200658 1364533 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1004 03:39:47.207827 1364533 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1004 03:39:47.215004 1364533 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1004 03:39:47.223436 1364533 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1004 03:39:47.232729 1364533 kubeadm.go:392] StartCluster: {Name:old-k8s-version-445570 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-445570 Namespace:default APIServerHAVIP: APIServerName:minikub
eCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/ho
me/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1004 03:39:47.232885 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I1004 03:39:47.232974 1364533 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1004 03:39:47.295168 1364533 cri.go:89] found id: "5b535bea1bc5353fd89eb2f07b641c965bcf0920d107f3e61183ce2e39af4160"
I1004 03:39:47.295230 1364533 cri.go:89] found id: "9b85407f811920c6bd4bf65c40d73c3828a80edb440329a260629dadac6c325b"
I1004 03:39:47.295250 1364533 cri.go:89] found id: "b199a132a65232987bd2f9d36ca0edafd86724a43cd8b1d00bcce04f1b95be77"
I1004 03:39:47.295270 1364533 cri.go:89] found id: "db56e60ccb26a4841473896cf63de198a919c74df5b3e1845b2a4f73cce7d321"
I1004 03:39:47.295290 1364533 cri.go:89] found id: "f0343958cd2a62f0bc9fa707bef4553a3c44375d07b13d0c06f7728977fda287"
I1004 03:39:47.295319 1364533 cri.go:89] found id: "1f76481f61cbe7daf82f893f0b6981b679e5a69b4198f0649d9874f825189c23"
I1004 03:39:47.295343 1364533 cri.go:89] found id: "2ca331c9606d2e3fdf73e195154882978124a0238ea8e8961401d22f0b7cd51f"
I1004 03:39:47.295362 1364533 cri.go:89] found id: "cf53ebe3031ec2133d6246e747d96d7f552d2736d7e6cd96300f5a2ac21352ec"
I1004 03:39:47.295381 1364533 cri.go:89] found id: ""
I1004 03:39:47.295458 1364533 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I1004 03:39:47.312390 1364533 cri.go:116] JSON = null
W1004 03:39:47.312506 1364533 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I1004 03:39:47.312599 1364533 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1004 03:39:47.325143 1364533 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I1004 03:39:47.325204 1364533 kubeadm.go:593] restartPrimaryControlPlane start ...
I1004 03:39:47.325283 1364533 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1004 03:39:47.336035 1364533 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1004 03:39:47.336551 1364533 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-445570" does not appear in /home/jenkins/minikube-integration/19546-1149434/kubeconfig
I1004 03:39:47.336714 1364533 kubeconfig.go:62] /home/jenkins/minikube-integration/19546-1149434/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-445570" cluster setting kubeconfig missing "old-k8s-version-445570" context setting]
I1004 03:39:47.337017 1364533 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19546-1149434/kubeconfig: {Name:mkbb0a06a5c0d16e5af194939942d8ac82543668 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1004 03:39:47.338472 1364533 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1004 03:39:47.354807 1364533 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I1004 03:39:47.354881 1364533 kubeadm.go:597] duration metric: took 29.656449ms to restartPrimaryControlPlane
I1004 03:39:47.354905 1364533 kubeadm.go:394] duration metric: took 122.185841ms to StartCluster
I1004 03:39:47.354948 1364533 settings.go:142] acquiring lock: {Name:mk1a349894ce66bafe43f883e774857dde6892e7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1004 03:39:47.355027 1364533 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19546-1149434/kubeconfig
I1004 03:39:47.356205 1364533 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19546-1149434/kubeconfig: {Name:mkbb0a06a5c0d16e5af194939942d8ac82543668 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1004 03:39:47.356773 1364533 config.go:182] Loaded profile config "old-k8s-version-445570": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I1004 03:39:47.356842 1364533 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I1004 03:39:47.356886 1364533 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1004 03:39:47.357245 1364533 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-445570"
I1004 03:39:47.357262 1364533 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-445570"
I1004 03:39:47.357261 1364533 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-445570"
I1004 03:39:47.357273 1364533 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-445570"
I1004 03:39:47.357281 1364533 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-445570"
I1004 03:39:47.357284 1364533 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-445570"
I1004 03:39:47.357292 1364533 addons.go:69] Setting dashboard=true in profile "old-k8s-version-445570"
I1004 03:39:47.357303 1364533 addons.go:234] Setting addon dashboard=true in "old-k8s-version-445570"
W1004 03:39:47.357308 1364533 addons.go:243] addon dashboard should already be in state true
I1004 03:39:47.357332 1364533 host.go:66] Checking if "old-k8s-version-445570" exists ...
I1004 03:39:47.357654 1364533 cli_runner.go:164] Run: docker container inspect old-k8s-version-445570 --format={{.State.Status}}
I1004 03:39:47.357907 1364533 cli_runner.go:164] Run: docker container inspect old-k8s-version-445570 --format={{.State.Status}}
W1004 03:39:47.357285 1364533 addons.go:243] addon metrics-server should already be in state true
I1004 03:39:47.358429 1364533 host.go:66] Checking if "old-k8s-version-445570" exists ...
W1004 03:39:47.357268 1364533 addons.go:243] addon storage-provisioner should already be in state true
I1004 03:39:47.358574 1364533 host.go:66] Checking if "old-k8s-version-445570" exists ...
I1004 03:39:47.358926 1364533 cli_runner.go:164] Run: docker container inspect old-k8s-version-445570 --format={{.State.Status}}
I1004 03:39:47.359054 1364533 cli_runner.go:164] Run: docker container inspect old-k8s-version-445570 --format={{.State.Status}}
I1004 03:39:47.359425 1364533 out.go:177] * Verifying Kubernetes components...
I1004 03:39:47.361350 1364533 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1004 03:39:47.420430 1364533 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I1004 03:39:47.421999 1364533 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1004 03:39:47.423778 1364533 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1004 03:39:47.423806 1364533 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1004 03:39:47.423881 1364533 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-445570
I1004 03:39:47.428821 1364533 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-445570"
W1004 03:39:47.428842 1364533 addons.go:243] addon default-storageclass should already be in state true
I1004 03:39:47.428869 1364533 host.go:66] Checking if "old-k8s-version-445570" exists ...
I1004 03:39:47.429439 1364533 cli_runner.go:164] Run: docker container inspect old-k8s-version-445570 --format={{.State.Status}}
I1004 03:39:47.432787 1364533 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I1004 03:39:47.432985 1364533 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1004 03:39:47.436596 1364533 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1004 03:39:47.436618 1364533 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1004 03:39:47.436683 1364533 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-445570
I1004 03:39:47.439598 1364533 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I1004 03:39:47.439633 1364533 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I1004 03:39:47.439705 1364533 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-445570
I1004 03:39:47.504923 1364533 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/machines/old-k8s-version-445570/id_rsa Username:docker}
I1004 03:39:47.508484 1364533 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I1004 03:39:47.508508 1364533 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1004 03:39:47.508565 1364533 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-445570
I1004 03:39:47.512114 1364533 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/machines/old-k8s-version-445570/id_rsa Username:docker}
I1004 03:39:47.522005 1364533 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/machines/old-k8s-version-445570/id_rsa Username:docker}
I1004 03:39:47.552449 1364533 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19546-1149434/.minikube/machines/old-k8s-version-445570/id_rsa Username:docker}
I1004 03:39:47.616531 1364533 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1004 03:39:47.675789 1364533 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-445570" to be "Ready" ...
I1004 03:39:47.714791 1364533 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1004 03:39:47.714817 1364533 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1004 03:39:47.755842 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1004 03:39:47.790539 1364533 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1004 03:39:47.790566 1364533 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1004 03:39:47.815479 1364533 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I1004 03:39:47.815502 1364533 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I1004 03:39:47.875084 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1004 03:39:47.902477 1364533 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1004 03:39:47.902504 1364533 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1004 03:39:47.912666 1364533 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I1004 03:39:47.912697 1364533 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I1004 03:39:48.040119 1364533 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1004 03:39:48.040145 1364533 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1004 03:39:48.054001 1364533 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I1004 03:39:48.054029 1364533 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I1004 03:39:48.142665 1364533 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I1004 03:39:48.142692 1364533 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1004 03:39:48.168684 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1004 03:39:48.244880 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:48.244915 1364533 retry.go:31] will retry after 240.98911ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:48.296644 1364533 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1004 03:39:48.296673 1364533 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W1004 03:39:48.322313 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:48.322345 1364533 retry.go:31] will retry after 335.580997ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:48.349106 1364533 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1004 03:39:48.349133 1364533 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1004 03:39:48.422869 1364533 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1004 03:39:48.422896 1364533 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
W1004 03:39:48.453642 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:48.453676 1364533 retry.go:31] will retry after 216.846079ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:48.475205 1364533 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1004 03:39:48.475236 1364533 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1004 03:39:48.486547 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1004 03:39:48.514479 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1004 03:39:48.658512 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1004 03:39:48.671436 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1004 03:39:48.711569 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:48.711606 1364533 retry.go:31] will retry after 353.636114ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1004 03:39:48.723808 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:48.723840 1364533 retry.go:31] will retry after 147.625795ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:48.872239 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1004 03:39:48.931043 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:48.931079 1364533 retry.go:31] will retry after 310.235003ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1004 03:39:48.931148 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:48.931164 1364533 retry.go:31] will retry after 265.798105ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1004 03:39:49.043812 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:49.043849 1364533 retry.go:31] will retry after 413.199268ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:49.066416 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1004 03:39:49.197021 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:49.197054 1364533 retry.go:31] will retry after 497.720435ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:49.197148 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1004 03:39:49.242253 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1004 03:39:49.327890 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:49.327956 1364533 retry.go:31] will retry after 796.837816ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1004 03:39:49.387039 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:49.387070 1364533 retry.go:31] will retry after 404.504294ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:49.457394 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1004 03:39:49.572060 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:49.572099 1364533 retry.go:31] will retry after 322.869742ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:49.676728 1364533 node_ready.go:53] error getting node "old-k8s-version-445570": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-445570": dial tcp 192.168.76.2:8443: connect: connection refused
I1004 03:39:49.694956 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1004 03:39:49.792390 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1004 03:39:49.881310 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:49.881343 1364533 retry.go:31] will retry after 1.036342548s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:49.895650 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1004 03:39:50.044822 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:50.044857 1364533 retry.go:31] will retry after 683.364709ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1004 03:39:50.080201 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:50.080237 1364533 retry.go:31] will retry after 1.014505504s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:50.125484 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1004 03:39:50.273669 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:50.273703 1364533 retry.go:31] will retry after 881.924555ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:50.728821 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1004 03:39:50.865207 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:50.865240 1364533 retry.go:31] will retry after 1.699083404s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:50.918485 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1004 03:39:51.062024 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:51.062061 1364533 retry.go:31] will retry after 968.607826ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:51.095360 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1004 03:39:51.155919 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1004 03:39:51.259334 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:51.259367 1364533 retry.go:31] will retry after 1.117878799s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1004 03:39:51.342101 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:51.342134 1364533 retry.go:31] will retry after 695.22781ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:52.031105 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1004 03:39:52.038509 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1004 03:39:52.177316 1364533 node_ready.go:53] error getting node "old-k8s-version-445570": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-445570": dial tcp 192.168.76.2:8443: connect: connection refused
W1004 03:39:52.214861 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:52.214935 1364533 retry.go:31] will retry after 953.249215ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1004 03:39:52.239785 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:52.239862 1364533 retry.go:31] will retry after 1.373813714s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:52.378232 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1004 03:39:52.502696 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:52.502782 1364533 retry.go:31] will retry after 2.545340942s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:52.564987 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1004 03:39:52.698460 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:52.698555 1364533 retry.go:31] will retry after 1.930421278s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:53.168954 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1004 03:39:53.236664 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:53.236700 1364533 retry.go:31] will retry after 2.118719417s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:53.613814 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1004 03:39:53.723382 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:53.723414 1364533 retry.go:31] will retry after 3.014146415s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:54.629958 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1004 03:39:54.676716 1364533 node_ready.go:53] error getting node "old-k8s-version-445570": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-445570": dial tcp 192.168.76.2:8443: connect: connection refused
W1004 03:39:54.727164 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:54.727199 1364533 retry.go:31] will retry after 3.843521746s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:55.048781 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1004 03:39:55.163648 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:55.163678 1364533 retry.go:31] will retry after 2.74755464s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:55.355546 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1004 03:39:55.472226 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:55.472256 1364533 retry.go:31] will retry after 3.667529923s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1004 03:39:56.738294 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1004 03:39:57.911896 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1004 03:39:58.570864 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1004 03:39:59.140921 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1004 03:40:06.677948 1364533 node_ready.go:53] error getting node "old-k8s-version-445570": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-445570": net/http: TLS handshake timeout
I1004 03:40:06.958679 1364533 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.220290247s)
W1004 03:40:06.958717 1364533 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I1004 03:40:06.958740 1364533 retry.go:31] will retry after 3.466758112s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I1004 03:40:07.912728 1364533 node_ready.go:49] node "old-k8s-version-445570" has status "Ready":"True"
I1004 03:40:07.912756 1364533 node_ready.go:38] duration metric: took 20.236935285s for node "old-k8s-version-445570" to be "Ready" ...
I1004 03:40:07.912767 1364533 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1004 03:40:08.054381 1364533 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-d25t5" in "kube-system" namespace to be "Ready" ...
I1004 03:40:08.125241 1364533 pod_ready.go:93] pod "coredns-74ff55c5b-d25t5" in "kube-system" namespace has status "Ready":"True"
I1004 03:40:08.125315 1364533 pod_ready.go:82] duration metric: took 70.845964ms for pod "coredns-74ff55c5b-d25t5" in "kube-system" namespace to be "Ready" ...
I1004 03:40:08.125342 1364533 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-445570" in "kube-system" namespace to be "Ready" ...
I1004 03:40:08.185753 1364533 pod_ready.go:93] pod "etcd-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"True"
I1004 03:40:08.185830 1364533 pod_ready.go:82] duration metric: took 60.466188ms for pod "etcd-old-k8s-version-445570" in "kube-system" namespace to be "Ready" ...
I1004 03:40:08.185869 1364533 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-445570" in "kube-system" namespace to be "Ready" ...
I1004 03:40:08.209642 1364533 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"True"
I1004 03:40:08.209716 1364533 pod_ready.go:82] duration metric: took 23.812153ms for pod "kube-apiserver-old-k8s-version-445570" in "kube-system" namespace to be "Ready" ...
I1004 03:40:08.209743 1364533 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace to be "Ready" ...
I1004 03:40:08.887759 1364533 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (10.975809709s)
I1004 03:40:08.888054 1364533 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (10.317151203s)
I1004 03:40:08.888160 1364533 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (9.747161231s)
I1004 03:40:08.890185 1364533 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-445570 addons enable metrics-server
I1004 03:40:10.217357 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:10.425747 1364533 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1004 03:40:10.963227 1364533 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-445570"
I1004 03:40:10.965688 1364533 out.go:177] * Enabled addons: storage-provisioner, dashboard, default-storageclass, metrics-server
I1004 03:40:10.967507 1364533 addons.go:510] duration metric: took 23.610609774s for enable addons: enabled=[storage-provisioner dashboard default-storageclass metrics-server]
I1004 03:40:12.724937 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:15.216264 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:17.716877 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:20.216612 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:22.715795 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:24.719830 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:27.216388 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:29.216846 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:31.219313 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:33.222617 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:35.724615 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:37.766272 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:40.217343 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:42.218455 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:44.723731 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:47.216363 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:49.216463 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:51.721233 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:54.216682 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:56.232221 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:40:58.720402 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:00.726120 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:02.726459 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:04.727781 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:07.216819 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:09.217349 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:11.717418 1364533 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:12.727272 1364533 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"True"
I1004 03:41:12.727311 1364533 pod_ready.go:82] duration metric: took 1m4.517545449s for pod "kube-controller-manager-old-k8s-version-445570" in "kube-system" namespace to be "Ready" ...
I1004 03:41:12.727324 1364533 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-tm9p4" in "kube-system" namespace to be "Ready" ...
I1004 03:41:12.739093 1364533 pod_ready.go:93] pod "kube-proxy-tm9p4" in "kube-system" namespace has status "Ready":"True"
I1004 03:41:12.739127 1364533 pod_ready.go:82] duration metric: took 11.796391ms for pod "kube-proxy-tm9p4" in "kube-system" namespace to be "Ready" ...
I1004 03:41:12.739139 1364533 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-445570" in "kube-system" namespace to be "Ready" ...
I1004 03:41:14.745697 1364533 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:16.746879 1364533 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:19.246497 1364533 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:21.746943 1364533 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:23.745933 1364533 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-445570" in "kube-system" namespace has status "Ready":"True"
I1004 03:41:23.746002 1364533 pod_ready.go:82] duration metric: took 11.00685361s for pod "kube-scheduler-old-k8s-version-445570" in "kube-system" namespace to be "Ready" ...
I1004 03:41:23.746028 1364533 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace to be "Ready" ...
I1004 03:41:25.760468 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:28.253211 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:30.752061 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:33.253997 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:35.751282 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:37.752033 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:39.752107 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:41.752461 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:44.251810 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:46.252579 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:48.305732 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:50.752349 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:52.752710 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:55.251842 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:57.252654 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:41:59.752681 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:02.252825 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:04.752535 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:06.765376 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:09.252639 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:11.252757 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:13.252883 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:15.754357 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:18.251979 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:20.253002 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:22.752121 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:25.251908 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:27.253634 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:29.752947 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:31.753072 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:33.757008 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:36.251857 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:38.253195 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:40.752145 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:42.767145 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:45.253704 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:47.752569 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:50.252476 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:52.253075 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:54.755395 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:57.253138 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:42:59.752424 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:02.252063 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:04.252427 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:06.252761 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:08.752768 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:11.252127 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:13.252265 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:15.252976 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:17.752561 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:20.252703 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:22.252859 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:24.252988 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:26.752747 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:29.252271 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:31.751566 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:33.752193 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:35.752578 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:38.253032 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:40.752408 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:42.752831 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:45.265319 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:47.751410 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:49.751796 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:52.252489 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:54.253225 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:56.253661 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:43:58.752140 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:00.752466 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:03.252749 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:05.752378 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:08.251933 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:10.252596 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:12.752750 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:15.253351 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:17.752410 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:20.252555 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:22.753075 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:25.252435 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:27.757903 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:29.782623 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:32.252342 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:34.252931 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:36.253120 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:38.752078 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:41.253036 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:43.754579 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:46.252663 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:48.253272 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:50.756459 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:53.251768 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:55.252493 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:57.751655 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:44:59.752726 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:45:02.251688 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:45:04.252524 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:45:06.751477 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:45:09.253098 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:45:11.253327 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:45:13.752155 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:45:15.755304 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:45:18.252034 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:45:20.289479 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:45:22.751457 1364533 pod_ready.go:103] pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace has status "Ready":"False"
I1004 03:45:23.753004 1364533 pod_ready.go:82] duration metric: took 4m0.006948975s for pod "metrics-server-9975d5f86-7vbmk" in "kube-system" namespace to be "Ready" ...
E1004 03:45:23.753027 1364533 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I1004 03:45:23.753036 1364533 pod_ready.go:39] duration metric: took 5m15.840258718s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1004 03:45:23.753050 1364533 api_server.go:52] waiting for apiserver process to appear ...
I1004 03:45:23.753080 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I1004 03:45:23.753156 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1004 03:45:23.809384 1364533 cri.go:89] found id: "7295a2d0ecfbb037cef3fc882b64353c1e4575b1c95d6af1c6fc9c96a1117454"
I1004 03:45:23.809406 1364533 cri.go:89] found id: "2ca331c9606d2e3fdf73e195154882978124a0238ea8e8961401d22f0b7cd51f"
I1004 03:45:23.809411 1364533 cri.go:89] found id: ""
I1004 03:45:23.809419 1364533 logs.go:282] 2 containers: [7295a2d0ecfbb037cef3fc882b64353c1e4575b1c95d6af1c6fc9c96a1117454 2ca331c9606d2e3fdf73e195154882978124a0238ea8e8961401d22f0b7cd51f]
I1004 03:45:23.809479 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:23.813398 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:23.817135 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I1004 03:45:23.817234 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1004 03:45:23.873280 1364533 cri.go:89] found id: "5436a81bb30f9621df50a410542d13c170eb3978f3fca9a4b268ce4954e20d08"
I1004 03:45:23.873300 1364533 cri.go:89] found id: "cf53ebe3031ec2133d6246e747d96d7f552d2736d7e6cd96300f5a2ac21352ec"
I1004 03:45:23.873311 1364533 cri.go:89] found id: ""
I1004 03:45:23.873318 1364533 logs.go:282] 2 containers: [5436a81bb30f9621df50a410542d13c170eb3978f3fca9a4b268ce4954e20d08 cf53ebe3031ec2133d6246e747d96d7f552d2736d7e6cd96300f5a2ac21352ec]
I1004 03:45:23.873380 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:23.881083 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:23.887553 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I1004 03:45:23.887631 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1004 03:45:23.934505 1364533 cri.go:89] found id: "c65ea8441f9c58b1b1bad277473595b6c22ee03a26bf15c60bedacb50f08105d"
I1004 03:45:23.934529 1364533 cri.go:89] found id: "5b535bea1bc5353fd89eb2f07b641c965bcf0920d107f3e61183ce2e39af4160"
I1004 03:45:23.934535 1364533 cri.go:89] found id: ""
I1004 03:45:23.934543 1364533 logs.go:282] 2 containers: [c65ea8441f9c58b1b1bad277473595b6c22ee03a26bf15c60bedacb50f08105d 5b535bea1bc5353fd89eb2f07b641c965bcf0920d107f3e61183ce2e39af4160]
I1004 03:45:23.934608 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:23.939226 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:23.949260 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I1004 03:45:23.949341 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1004 03:45:24.037809 1364533 cri.go:89] found id: "fd61154c785ee669b3a620fd034d912e5b6005c06a250bcf7606b989ca283b91"
I1004 03:45:24.037839 1364533 cri.go:89] found id: "1f76481f61cbe7daf82f893f0b6981b679e5a69b4198f0649d9874f825189c23"
I1004 03:45:24.037845 1364533 cri.go:89] found id: ""
I1004 03:45:24.037854 1364533 logs.go:282] 2 containers: [fd61154c785ee669b3a620fd034d912e5b6005c06a250bcf7606b989ca283b91 1f76481f61cbe7daf82f893f0b6981b679e5a69b4198f0649d9874f825189c23]
I1004 03:45:24.037918 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:24.042625 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:24.046725 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I1004 03:45:24.046804 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1004 03:45:24.091153 1364533 cri.go:89] found id: "7a1106279c108c93fe80eb2d47bc2a3c26515d0ea17e555376f4142a50dc8e36"
I1004 03:45:24.091176 1364533 cri.go:89] found id: "db56e60ccb26a4841473896cf63de198a919c74df5b3e1845b2a4f73cce7d321"
I1004 03:45:24.091182 1364533 cri.go:89] found id: ""
I1004 03:45:24.091190 1364533 logs.go:282] 2 containers: [7a1106279c108c93fe80eb2d47bc2a3c26515d0ea17e555376f4142a50dc8e36 db56e60ccb26a4841473896cf63de198a919c74df5b3e1845b2a4f73cce7d321]
I1004 03:45:24.091252 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:24.096386 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:24.100179 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I1004 03:45:24.100627 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1004 03:45:24.141515 1364533 cri.go:89] found id: "82b8e7498dd882ec676ce6d369194f9c7ce4d6c8fd44bd1a4efa6b9e965d9c1f"
I1004 03:45:24.141537 1364533 cri.go:89] found id: "f0343958cd2a62f0bc9fa707bef4553a3c44375d07b13d0c06f7728977fda287"
I1004 03:45:24.141542 1364533 cri.go:89] found id: ""
I1004 03:45:24.141549 1364533 logs.go:282] 2 containers: [82b8e7498dd882ec676ce6d369194f9c7ce4d6c8fd44bd1a4efa6b9e965d9c1f f0343958cd2a62f0bc9fa707bef4553a3c44375d07b13d0c06f7728977fda287]
I1004 03:45:24.141607 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:24.145484 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:24.149953 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I1004 03:45:24.150031 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1004 03:45:24.198270 1364533 cri.go:89] found id: "f8aacb2fb53da0491e7751aed07aea89402a0735466b779e4d04bf40f82a3515"
I1004 03:45:24.198295 1364533 cri.go:89] found id: "9b85407f811920c6bd4bf65c40d73c3828a80edb440329a260629dadac6c325b"
I1004 03:45:24.198301 1364533 cri.go:89] found id: ""
I1004 03:45:24.198308 1364533 logs.go:282] 2 containers: [f8aacb2fb53da0491e7751aed07aea89402a0735466b779e4d04bf40f82a3515 9b85407f811920c6bd4bf65c40d73c3828a80edb440329a260629dadac6c325b]
I1004 03:45:24.198369 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:24.202066 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:24.205439 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I1004 03:45:24.205531 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I1004 03:45:24.243497 1364533 cri.go:89] found id: "04caef5abf18eb64fc69564f2f195bf5c77f3dfcdbdf6c9a8ea68e37d9d094bf"
I1004 03:45:24.243516 1364533 cri.go:89] found id: "b199a132a65232987bd2f9d36ca0edafd86724a43cd8b1d00bcce04f1b95be77"
I1004 03:45:24.243520 1364533 cri.go:89] found id: ""
I1004 03:45:24.243528 1364533 logs.go:282] 2 containers: [04caef5abf18eb64fc69564f2f195bf5c77f3dfcdbdf6c9a8ea68e37d9d094bf b199a132a65232987bd2f9d36ca0edafd86724a43cd8b1d00bcce04f1b95be77]
I1004 03:45:24.243583 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:24.247179 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:24.250742 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I1004 03:45:24.250847 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I1004 03:45:24.288907 1364533 cri.go:89] found id: "e25a99d73dc123b7ad1337a13bac763678ba647ef7414e06362277eb1ceaf920"
I1004 03:45:24.288928 1364533 cri.go:89] found id: ""
I1004 03:45:24.288936 1364533 logs.go:282] 1 containers: [e25a99d73dc123b7ad1337a13bac763678ba647ef7414e06362277eb1ceaf920]
I1004 03:45:24.289005 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:24.292588 1364533 logs.go:123] Gathering logs for kubelet ...
I1004 03:45:24.292610 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W1004 03:45:24.349611 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.720678 671 reflector.go:138] object-"kube-system"/"kindnet-token-896vn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-896vn" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:24.349842 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.720764 671 reflector.go:138] object-"kube-system"/"coredns-token-b58cn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-b58cn" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:24.350077 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.720820 671 reflector.go:138] object-"kube-system"/"storage-provisioner-token-qfjnb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-qfjnb" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:24.350294 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.720869 671 reflector.go:138] object-"kube-system"/"kube-proxy-token-9x4ch": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-9x4ch" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:24.350514 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.720917 671 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:24.350732 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.720983 671 reflector.go:138] object-"default"/"default-token-mqxtr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-mqxtr" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:24.350957 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.721024 671 reflector.go:138] object-"kube-system"/"metrics-server-token-75zps": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-75zps" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:24.351164 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.721068 671 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:24.365714 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:11 old-k8s-version-445570 kubelet[671]: E1004 03:40:11.809865 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1004 03:45:24.365957 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:12 old-k8s-version-445570 kubelet[671]: E1004 03:40:12.524062 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.368777 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:25 old-k8s-version-445570 kubelet[671]: E1004 03:40:25.351183 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1004 03:45:24.371037 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:37 old-k8s-version-445570 kubelet[671]: E1004 03:40:37.341825 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.371505 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:37 old-k8s-version-445570 kubelet[671]: E1004 03:40:37.610610 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.371835 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:38 old-k8s-version-445570 kubelet[671]: E1004 03:40:38.614513 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.372162 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:39 old-k8s-version-445570 kubelet[671]: E1004 03:40:39.617155 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.375269 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:52 old-k8s-version-445570 kubelet[671]: E1004 03:40:52.345391 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1004 03:45:24.377047 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:53 old-k8s-version-445570 kubelet[671]: E1004 03:40:53.660236 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.377827 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:58 old-k8s-version-445570 kubelet[671]: E1004 03:40:58.315454 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.378262 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:07 old-k8s-version-445570 kubelet[671]: E1004 03:41:07.338008 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.378637 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:10 old-k8s-version-445570 kubelet[671]: E1004 03:41:10.337576 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.378827 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:19 old-k8s-version-445570 kubelet[671]: E1004 03:41:19.339131 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.379609 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:26 old-k8s-version-445570 kubelet[671]: E1004 03:41:26.778876 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.379944 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:28 old-k8s-version-445570 kubelet[671]: E1004 03:41:28.315566 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.385016 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:34 old-k8s-version-445570 kubelet[671]: E1004 03:41:34.346479 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1004 03:45:24.385377 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:41 old-k8s-version-445570 kubelet[671]: E1004 03:41:41.341220 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.385567 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:47 old-k8s-version-445570 kubelet[671]: E1004 03:41:47.343841 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.385897 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:55 old-k8s-version-445570 kubelet[671]: E1004 03:41:55.338126 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.386256 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:00 old-k8s-version-445570 kubelet[671]: E1004 03:42:00.341688 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.387160 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:07 old-k8s-version-445570 kubelet[671]: E1004 03:42:07.887419 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.387669 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:08 old-k8s-version-445570 kubelet[671]: E1004 03:42:08.891782 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.388543 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:14 old-k8s-version-445570 kubelet[671]: E1004 03:42:14.339176 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.388930 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:21 old-k8s-version-445570 kubelet[671]: E1004 03:42:21.337426 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.389382 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:28 old-k8s-version-445570 kubelet[671]: E1004 03:42:28.337831 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.389758 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:32 old-k8s-version-445570 kubelet[671]: E1004 03:42:32.337461 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.390044 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:41 old-k8s-version-445570 kubelet[671]: E1004 03:42:41.337927 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.390382 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:46 old-k8s-version-445570 kubelet[671]: E1004 03:42:46.337394 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.390566 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:54 old-k8s-version-445570 kubelet[671]: E1004 03:42:54.337799 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.391113 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:01 old-k8s-version-445570 kubelet[671]: E1004 03:43:01.341025 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.393984 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:08 old-k8s-version-445570 kubelet[671]: E1004 03:43:08.345159 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1004 03:45:24.394327 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:14 old-k8s-version-445570 kubelet[671]: E1004 03:43:14.337315 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.394516 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:22 old-k8s-version-445570 kubelet[671]: E1004 03:43:22.337815 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.395101 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:29 old-k8s-version-445570 kubelet[671]: E1004 03:43:29.135206 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.395284 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:33 old-k8s-version-445570 kubelet[671]: E1004 03:43:33.340492 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.395613 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:38 old-k8s-version-445570 kubelet[671]: E1004 03:43:38.315603 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.395799 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:48 old-k8s-version-445570 kubelet[671]: E1004 03:43:48.337782 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.396135 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:52 old-k8s-version-445570 kubelet[671]: E1004 03:43:52.337453 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.396336 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:00 old-k8s-version-445570 kubelet[671]: E1004 03:44:00.340379 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.396675 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:04 old-k8s-version-445570 kubelet[671]: E1004 03:44:04.337451 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.396992 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:15 old-k8s-version-445570 kubelet[671]: E1004 03:44:15.338470 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.397196 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:15 old-k8s-version-445570 kubelet[671]: E1004 03:44:15.338490 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.397420 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:26 old-k8s-version-445570 kubelet[671]: E1004 03:44:26.338825 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.397757 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:30 old-k8s-version-445570 kubelet[671]: E1004 03:44:30.337556 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.397947 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:37 old-k8s-version-445570 kubelet[671]: E1004 03:44:37.337773 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.398274 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:42 old-k8s-version-445570 kubelet[671]: E1004 03:44:42.337758 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.398460 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:48 old-k8s-version-445570 kubelet[671]: E1004 03:44:48.337763 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.398789 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:55 old-k8s-version-445570 kubelet[671]: E1004 03:44:55.342140 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.398974 1364533 logs.go:138] Found kubelet problem: Oct 04 03:45:00 old-k8s-version-445570 kubelet[671]: E1004 03:45:00.338647 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.399300 1364533 logs.go:138] Found kubelet problem: Oct 04 03:45:10 old-k8s-version-445570 kubelet[671]: E1004 03:45:10.337424 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:24.399484 1364533 logs.go:138] Found kubelet problem: Oct 04 03:45:13 old-k8s-version-445570 kubelet[671]: E1004 03:45:13.337752 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:24.399858 1364533 logs.go:138] Found kubelet problem: Oct 04 03:45:21 old-k8s-version-445570 kubelet[671]: E1004 03:45:21.338227 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
I1004 03:45:24.399876 1364533 logs.go:123] Gathering logs for kube-apiserver [2ca331c9606d2e3fdf73e195154882978124a0238ea8e8961401d22f0b7cd51f] ...
I1004 03:45:24.399891 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2ca331c9606d2e3fdf73e195154882978124a0238ea8e8961401d22f0b7cd51f"
I1004 03:45:24.460252 1364533 logs.go:123] Gathering logs for kube-proxy [db56e60ccb26a4841473896cf63de198a919c74df5b3e1845b2a4f73cce7d321] ...
I1004 03:45:24.460336 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db56e60ccb26a4841473896cf63de198a919c74df5b3e1845b2a4f73cce7d321"
I1004 03:45:24.511060 1364533 logs.go:123] Gathering logs for kube-controller-manager [f0343958cd2a62f0bc9fa707bef4553a3c44375d07b13d0c06f7728977fda287] ...
I1004 03:45:24.511091 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f0343958cd2a62f0bc9fa707bef4553a3c44375d07b13d0c06f7728977fda287"
I1004 03:45:24.599116 1364533 logs.go:123] Gathering logs for kubernetes-dashboard [e25a99d73dc123b7ad1337a13bac763678ba647ef7414e06362277eb1ceaf920] ...
I1004 03:45:24.599156 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e25a99d73dc123b7ad1337a13bac763678ba647ef7414e06362277eb1ceaf920"
I1004 03:45:24.645633 1364533 logs.go:123] Gathering logs for kube-apiserver [7295a2d0ecfbb037cef3fc882b64353c1e4575b1c95d6af1c6fc9c96a1117454] ...
I1004 03:45:24.645667 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7295a2d0ecfbb037cef3fc882b64353c1e4575b1c95d6af1c6fc9c96a1117454"
I1004 03:45:24.716785 1364533 logs.go:123] Gathering logs for etcd [5436a81bb30f9621df50a410542d13c170eb3978f3fca9a4b268ce4954e20d08] ...
I1004 03:45:24.716839 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5436a81bb30f9621df50a410542d13c170eb3978f3fca9a4b268ce4954e20d08"
I1004 03:45:24.769332 1364533 logs.go:123] Gathering logs for kube-scheduler [1f76481f61cbe7daf82f893f0b6981b679e5a69b4198f0649d9874f825189c23] ...
I1004 03:45:24.769364 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1f76481f61cbe7daf82f893f0b6981b679e5a69b4198f0649d9874f825189c23"
I1004 03:45:24.812217 1364533 logs.go:123] Gathering logs for kube-proxy [7a1106279c108c93fe80eb2d47bc2a3c26515d0ea17e555376f4142a50dc8e36] ...
I1004 03:45:24.812247 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7a1106279c108c93fe80eb2d47bc2a3c26515d0ea17e555376f4142a50dc8e36"
I1004 03:45:24.853299 1364533 logs.go:123] Gathering logs for kube-controller-manager [82b8e7498dd882ec676ce6d369194f9c7ce4d6c8fd44bd1a4efa6b9e965d9c1f] ...
I1004 03:45:24.853327 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 82b8e7498dd882ec676ce6d369194f9c7ce4d6c8fd44bd1a4efa6b9e965d9c1f"
I1004 03:45:24.918755 1364533 logs.go:123] Gathering logs for kindnet [9b85407f811920c6bd4bf65c40d73c3828a80edb440329a260629dadac6c325b] ...
I1004 03:45:24.918793 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9b85407f811920c6bd4bf65c40d73c3828a80edb440329a260629dadac6c325b"
I1004 03:45:24.964680 1364533 logs.go:123] Gathering logs for storage-provisioner [04caef5abf18eb64fc69564f2f195bf5c77f3dfcdbdf6c9a8ea68e37d9d094bf] ...
I1004 03:45:24.964712 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 04caef5abf18eb64fc69564f2f195bf5c77f3dfcdbdf6c9a8ea68e37d9d094bf"
I1004 03:45:25.009297 1364533 logs.go:123] Gathering logs for dmesg ...
I1004 03:45:25.009330 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1004 03:45:25.032144 1364533 logs.go:123] Gathering logs for describe nodes ...
I1004 03:45:25.032191 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I1004 03:45:25.194250 1364533 logs.go:123] Gathering logs for etcd [cf53ebe3031ec2133d6246e747d96d7f552d2736d7e6cd96300f5a2ac21352ec] ...
I1004 03:45:25.194284 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cf53ebe3031ec2133d6246e747d96d7f552d2736d7e6cd96300f5a2ac21352ec"
I1004 03:45:25.234759 1364533 logs.go:123] Gathering logs for containerd ...
I1004 03:45:25.234794 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I1004 03:45:25.298098 1364533 logs.go:123] Gathering logs for container status ...
I1004 03:45:25.298144 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1004 03:45:25.351916 1364533 logs.go:123] Gathering logs for coredns [c65ea8441f9c58b1b1bad277473595b6c22ee03a26bf15c60bedacb50f08105d] ...
I1004 03:45:25.351946 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c65ea8441f9c58b1b1bad277473595b6c22ee03a26bf15c60bedacb50f08105d"
I1004 03:45:25.391402 1364533 logs.go:123] Gathering logs for coredns [5b535bea1bc5353fd89eb2f07b641c965bcf0920d107f3e61183ce2e39af4160] ...
I1004 03:45:25.391433 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5b535bea1bc5353fd89eb2f07b641c965bcf0920d107f3e61183ce2e39af4160"
I1004 03:45:25.432888 1364533 logs.go:123] Gathering logs for kube-scheduler [fd61154c785ee669b3a620fd034d912e5b6005c06a250bcf7606b989ca283b91] ...
I1004 03:45:25.432918 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fd61154c785ee669b3a620fd034d912e5b6005c06a250bcf7606b989ca283b91"
I1004 03:45:25.473025 1364533 logs.go:123] Gathering logs for kindnet [f8aacb2fb53da0491e7751aed07aea89402a0735466b779e4d04bf40f82a3515] ...
I1004 03:45:25.473054 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f8aacb2fb53da0491e7751aed07aea89402a0735466b779e4d04bf40f82a3515"
I1004 03:45:25.521397 1364533 logs.go:123] Gathering logs for storage-provisioner [b199a132a65232987bd2f9d36ca0edafd86724a43cd8b1d00bcce04f1b95be77] ...
I1004 03:45:25.521430 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b199a132a65232987bd2f9d36ca0edafd86724a43cd8b1d00bcce04f1b95be77"
I1004 03:45:25.560531 1364533 out.go:358] Setting ErrFile to fd 2...
I1004 03:45:25.560553 1364533 out.go:392] TERM=,COLORTERM=, which probably does not support color
W1004 03:45:25.560635 1364533 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W1004 03:45:25.560647 1364533 out.go:270] Oct 04 03:44:55 old-k8s-version-445570 kubelet[671]: E1004 03:44:55.342140 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
Oct 04 03:44:55 old-k8s-version-445570 kubelet[671]: E1004 03:44:55.342140 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:25.560676 1364533 out.go:270] Oct 04 03:45:00 old-k8s-version-445570 kubelet[671]: E1004 03:45:00.338647 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 04 03:45:00 old-k8s-version-445570 kubelet[671]: E1004 03:45:00.338647 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:25.560702 1364533 out.go:270] Oct 04 03:45:10 old-k8s-version-445570 kubelet[671]: E1004 03:45:10.337424 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
Oct 04 03:45:10 old-k8s-version-445570 kubelet[671]: E1004 03:45:10.337424 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:25.560730 1364533 out.go:270] Oct 04 03:45:13 old-k8s-version-445570 kubelet[671]: E1004 03:45:13.337752 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 04 03:45:13 old-k8s-version-445570 kubelet[671]: E1004 03:45:13.337752 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:25.560738 1364533 out.go:270] Oct 04 03:45:21 old-k8s-version-445570 kubelet[671]: E1004 03:45:21.338227 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
Oct 04 03:45:21 old-k8s-version-445570 kubelet[671]: E1004 03:45:21.338227 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
I1004 03:45:25.560744 1364533 out.go:358] Setting ErrFile to fd 2...
I1004 03:45:25.560765 1364533 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1004 03:45:35.561915 1364533 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1004 03:45:35.574040 1364533 api_server.go:72] duration metric: took 5m48.217077824s to wait for apiserver process to appear ...
I1004 03:45:35.574065 1364533 api_server.go:88] waiting for apiserver healthz status ...
I1004 03:45:35.574101 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I1004 03:45:35.574170 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1004 03:45:35.617914 1364533 cri.go:89] found id: "7295a2d0ecfbb037cef3fc882b64353c1e4575b1c95d6af1c6fc9c96a1117454"
I1004 03:45:35.617940 1364533 cri.go:89] found id: "2ca331c9606d2e3fdf73e195154882978124a0238ea8e8961401d22f0b7cd51f"
I1004 03:45:35.617945 1364533 cri.go:89] found id: ""
I1004 03:45:35.617952 1364533 logs.go:282] 2 containers: [7295a2d0ecfbb037cef3fc882b64353c1e4575b1c95d6af1c6fc9c96a1117454 2ca331c9606d2e3fdf73e195154882978124a0238ea8e8961401d22f0b7cd51f]
I1004 03:45:35.618010 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.621667 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.625012 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I1004 03:45:35.625083 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1004 03:45:35.662151 1364533 cri.go:89] found id: "5436a81bb30f9621df50a410542d13c170eb3978f3fca9a4b268ce4954e20d08"
I1004 03:45:35.662171 1364533 cri.go:89] found id: "cf53ebe3031ec2133d6246e747d96d7f552d2736d7e6cd96300f5a2ac21352ec"
I1004 03:45:35.662176 1364533 cri.go:89] found id: ""
I1004 03:45:35.662183 1364533 logs.go:282] 2 containers: [5436a81bb30f9621df50a410542d13c170eb3978f3fca9a4b268ce4954e20d08 cf53ebe3031ec2133d6246e747d96d7f552d2736d7e6cd96300f5a2ac21352ec]
I1004 03:45:35.662239 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.665793 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.669104 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I1004 03:45:35.669193 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1004 03:45:35.706661 1364533 cri.go:89] found id: "c65ea8441f9c58b1b1bad277473595b6c22ee03a26bf15c60bedacb50f08105d"
I1004 03:45:35.706682 1364533 cri.go:89] found id: "5b535bea1bc5353fd89eb2f07b641c965bcf0920d107f3e61183ce2e39af4160"
I1004 03:45:35.706686 1364533 cri.go:89] found id: ""
I1004 03:45:35.706693 1364533 logs.go:282] 2 containers: [c65ea8441f9c58b1b1bad277473595b6c22ee03a26bf15c60bedacb50f08105d 5b535bea1bc5353fd89eb2f07b641c965bcf0920d107f3e61183ce2e39af4160]
I1004 03:45:35.706749 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.716172 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.720984 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I1004 03:45:35.721057 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1004 03:45:35.759908 1364533 cri.go:89] found id: "fd61154c785ee669b3a620fd034d912e5b6005c06a250bcf7606b989ca283b91"
I1004 03:45:35.759980 1364533 cri.go:89] found id: "1f76481f61cbe7daf82f893f0b6981b679e5a69b4198f0649d9874f825189c23"
I1004 03:45:35.759999 1364533 cri.go:89] found id: ""
I1004 03:45:35.760022 1364533 logs.go:282] 2 containers: [fd61154c785ee669b3a620fd034d912e5b6005c06a250bcf7606b989ca283b91 1f76481f61cbe7daf82f893f0b6981b679e5a69b4198f0649d9874f825189c23]
I1004 03:45:35.760102 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.763646 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.766969 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I1004 03:45:35.767068 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1004 03:45:35.813890 1364533 cri.go:89] found id: "7a1106279c108c93fe80eb2d47bc2a3c26515d0ea17e555376f4142a50dc8e36"
I1004 03:45:35.813913 1364533 cri.go:89] found id: "db56e60ccb26a4841473896cf63de198a919c74df5b3e1845b2a4f73cce7d321"
I1004 03:45:35.813918 1364533 cri.go:89] found id: ""
I1004 03:45:35.813924 1364533 logs.go:282] 2 containers: [7a1106279c108c93fe80eb2d47bc2a3c26515d0ea17e555376f4142a50dc8e36 db56e60ccb26a4841473896cf63de198a919c74df5b3e1845b2a4f73cce7d321]
I1004 03:45:35.814006 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.817498 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.820988 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I1004 03:45:35.821056 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1004 03:45:35.861338 1364533 cri.go:89] found id: "82b8e7498dd882ec676ce6d369194f9c7ce4d6c8fd44bd1a4efa6b9e965d9c1f"
I1004 03:45:35.861362 1364533 cri.go:89] found id: "f0343958cd2a62f0bc9fa707bef4553a3c44375d07b13d0c06f7728977fda287"
I1004 03:45:35.861367 1364533 cri.go:89] found id: ""
I1004 03:45:35.861374 1364533 logs.go:282] 2 containers: [82b8e7498dd882ec676ce6d369194f9c7ce4d6c8fd44bd1a4efa6b9e965d9c1f f0343958cd2a62f0bc9fa707bef4553a3c44375d07b13d0c06f7728977fda287]
I1004 03:45:35.861427 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.864955 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.869212 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I1004 03:45:35.869331 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1004 03:45:35.907556 1364533 cri.go:89] found id: "f8aacb2fb53da0491e7751aed07aea89402a0735466b779e4d04bf40f82a3515"
I1004 03:45:35.907588 1364533 cri.go:89] found id: "9b85407f811920c6bd4bf65c40d73c3828a80edb440329a260629dadac6c325b"
I1004 03:45:35.907593 1364533 cri.go:89] found id: ""
I1004 03:45:35.907600 1364533 logs.go:282] 2 containers: [f8aacb2fb53da0491e7751aed07aea89402a0735466b779e4d04bf40f82a3515 9b85407f811920c6bd4bf65c40d73c3828a80edb440329a260629dadac6c325b]
I1004 03:45:35.907689 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.911221 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.914458 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I1004 03:45:35.914554 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I1004 03:45:35.958883 1364533 cri.go:89] found id: "e25a99d73dc123b7ad1337a13bac763678ba647ef7414e06362277eb1ceaf920"
I1004 03:45:35.958958 1364533 cri.go:89] found id: ""
I1004 03:45:35.958980 1364533 logs.go:282] 1 containers: [e25a99d73dc123b7ad1337a13bac763678ba647ef7414e06362277eb1ceaf920]
I1004 03:45:35.959043 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:35.962624 1364533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I1004 03:45:35.962724 1364533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I1004 03:45:36.020750 1364533 cri.go:89] found id: "04caef5abf18eb64fc69564f2f195bf5c77f3dfcdbdf6c9a8ea68e37d9d094bf"
I1004 03:45:36.020772 1364533 cri.go:89] found id: "b199a132a65232987bd2f9d36ca0edafd86724a43cd8b1d00bcce04f1b95be77"
I1004 03:45:36.020777 1364533 cri.go:89] found id: ""
I1004 03:45:36.020784 1364533 logs.go:282] 2 containers: [04caef5abf18eb64fc69564f2f195bf5c77f3dfcdbdf6c9a8ea68e37d9d094bf b199a132a65232987bd2f9d36ca0edafd86724a43cd8b1d00bcce04f1b95be77]
I1004 03:45:36.020845 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:36.024770 1364533 ssh_runner.go:195] Run: which crictl
I1004 03:45:36.029362 1364533 logs.go:123] Gathering logs for kube-scheduler [1f76481f61cbe7daf82f893f0b6981b679e5a69b4198f0649d9874f825189c23] ...
I1004 03:45:36.029391 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1f76481f61cbe7daf82f893f0b6981b679e5a69b4198f0649d9874f825189c23"
I1004 03:45:36.091438 1364533 logs.go:123] Gathering logs for etcd [5436a81bb30f9621df50a410542d13c170eb3978f3fca9a4b268ce4954e20d08] ...
I1004 03:45:36.092069 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5436a81bb30f9621df50a410542d13c170eb3978f3fca9a4b268ce4954e20d08"
I1004 03:45:36.158735 1364533 logs.go:123] Gathering logs for etcd [cf53ebe3031ec2133d6246e747d96d7f552d2736d7e6cd96300f5a2ac21352ec] ...
I1004 03:45:36.158835 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cf53ebe3031ec2133d6246e747d96d7f552d2736d7e6cd96300f5a2ac21352ec"
I1004 03:45:36.224436 1364533 logs.go:123] Gathering logs for coredns [c65ea8441f9c58b1b1bad277473595b6c22ee03a26bf15c60bedacb50f08105d] ...
I1004 03:45:36.224468 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c65ea8441f9c58b1b1bad277473595b6c22ee03a26bf15c60bedacb50f08105d"
I1004 03:45:36.280120 1364533 logs.go:123] Gathering logs for coredns [5b535bea1bc5353fd89eb2f07b641c965bcf0920d107f3e61183ce2e39af4160] ...
I1004 03:45:36.280149 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5b535bea1bc5353fd89eb2f07b641c965bcf0920d107f3e61183ce2e39af4160"
I1004 03:45:36.346943 1364533 logs.go:123] Gathering logs for kindnet [9b85407f811920c6bd4bf65c40d73c3828a80edb440329a260629dadac6c325b] ...
I1004 03:45:36.346972 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9b85407f811920c6bd4bf65c40d73c3828a80edb440329a260629dadac6c325b"
I1004 03:45:36.398339 1364533 logs.go:123] Gathering logs for kubernetes-dashboard [e25a99d73dc123b7ad1337a13bac763678ba647ef7414e06362277eb1ceaf920] ...
I1004 03:45:36.398369 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e25a99d73dc123b7ad1337a13bac763678ba647ef7414e06362277eb1ceaf920"
I1004 03:45:36.449141 1364533 logs.go:123] Gathering logs for storage-provisioner [b199a132a65232987bd2f9d36ca0edafd86724a43cd8b1d00bcce04f1b95be77] ...
I1004 03:45:36.449176 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b199a132a65232987bd2f9d36ca0edafd86724a43cd8b1d00bcce04f1b95be77"
I1004 03:45:36.511292 1364533 logs.go:123] Gathering logs for containerd ...
I1004 03:45:36.511322 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I1004 03:45:36.585926 1364533 logs.go:123] Gathering logs for kubelet ...
I1004 03:45:36.585964 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W1004 03:45:36.646922 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.720678 671 reflector.go:138] object-"kube-system"/"kindnet-token-896vn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-896vn" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:36.647168 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.720764 671 reflector.go:138] object-"kube-system"/"coredns-token-b58cn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-b58cn" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:36.647399 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.720820 671 reflector.go:138] object-"kube-system"/"storage-provisioner-token-qfjnb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-qfjnb" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:36.647648 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.720869 671 reflector.go:138] object-"kube-system"/"kube-proxy-token-9x4ch": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-9x4ch" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:36.647851 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.720917 671 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:36.648058 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.720983 671 reflector.go:138] object-"default"/"default-token-mqxtr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-mqxtr" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:36.648288 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.721024 671 reflector.go:138] object-"kube-system"/"metrics-server-token-75zps": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-75zps" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:36.648496 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:07 old-k8s-version-445570 kubelet[671]: E1004 03:40:07.721068 671 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-445570" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-445570' and this object
W1004 03:45:36.663090 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:11 old-k8s-version-445570 kubelet[671]: E1004 03:40:11.809865 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1004 03:45:36.663300 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:12 old-k8s-version-445570 kubelet[671]: E1004 03:40:12.524062 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.666126 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:25 old-k8s-version-445570 kubelet[671]: E1004 03:40:25.351183 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1004 03:45:36.668746 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:37 old-k8s-version-445570 kubelet[671]: E1004 03:40:37.341825 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.669287 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:37 old-k8s-version-445570 kubelet[671]: E1004 03:40:37.610610 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.669734 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:38 old-k8s-version-445570 kubelet[671]: E1004 03:40:38.614513 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.670214 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:39 old-k8s-version-445570 kubelet[671]: E1004 03:40:39.617155 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.673263 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:52 old-k8s-version-445570 kubelet[671]: E1004 03:40:52.345391 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1004 03:45:36.674006 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:53 old-k8s-version-445570 kubelet[671]: E1004 03:40:53.660236 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.674409 1364533 logs.go:138] Found kubelet problem: Oct 04 03:40:58 old-k8s-version-445570 kubelet[671]: E1004 03:40:58.315454 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.674619 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:07 old-k8s-version-445570 kubelet[671]: E1004 03:41:07.338008 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.675004 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:10 old-k8s-version-445570 kubelet[671]: E1004 03:41:10.337576 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.675228 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:19 old-k8s-version-445570 kubelet[671]: E1004 03:41:19.339131 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.675982 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:26 old-k8s-version-445570 kubelet[671]: E1004 03:41:26.778876 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.676373 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:28 old-k8s-version-445570 kubelet[671]: E1004 03:41:28.315566 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.679056 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:34 old-k8s-version-445570 kubelet[671]: E1004 03:41:34.346479 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1004 03:45:36.679435 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:41 old-k8s-version-445570 kubelet[671]: E1004 03:41:41.341220 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.679620 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:47 old-k8s-version-445570 kubelet[671]: E1004 03:41:47.343841 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.679941 1364533 logs.go:138] Found kubelet problem: Oct 04 03:41:55 old-k8s-version-445570 kubelet[671]: E1004 03:41:55.338126 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.680146 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:00 old-k8s-version-445570 kubelet[671]: E1004 03:42:00.341688 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.680766 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:07 old-k8s-version-445570 kubelet[671]: E1004 03:42:07.887419 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.681104 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:08 old-k8s-version-445570 kubelet[671]: E1004 03:42:08.891782 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.681291 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:14 old-k8s-version-445570 kubelet[671]: E1004 03:42:14.339176 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.681617 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:21 old-k8s-version-445570 kubelet[671]: E1004 03:42:21.337426 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.681799 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:28 old-k8s-version-445570 kubelet[671]: E1004 03:42:28.337831 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.682122 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:32 old-k8s-version-445570 kubelet[671]: E1004 03:42:32.337461 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.682301 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:41 old-k8s-version-445570 kubelet[671]: E1004 03:42:41.337927 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.682633 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:46 old-k8s-version-445570 kubelet[671]: E1004 03:42:46.337394 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.682819 1364533 logs.go:138] Found kubelet problem: Oct 04 03:42:54 old-k8s-version-445570 kubelet[671]: E1004 03:42:54.337799 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.683145 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:01 old-k8s-version-445570 kubelet[671]: E1004 03:43:01.341025 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.685721 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:08 old-k8s-version-445570 kubelet[671]: E1004 03:43:08.345159 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1004 03:45:36.686056 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:14 old-k8s-version-445570 kubelet[671]: E1004 03:43:14.337315 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.686242 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:22 old-k8s-version-445570 kubelet[671]: E1004 03:43:22.337815 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.686830 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:29 old-k8s-version-445570 kubelet[671]: E1004 03:43:29.135206 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.687012 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:33 old-k8s-version-445570 kubelet[671]: E1004 03:43:33.340492 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.687380 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:38 old-k8s-version-445570 kubelet[671]: E1004 03:43:38.315603 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.687579 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:48 old-k8s-version-445570 kubelet[671]: E1004 03:43:48.337782 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.687935 1364533 logs.go:138] Found kubelet problem: Oct 04 03:43:52 old-k8s-version-445570 kubelet[671]: E1004 03:43:52.337453 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.688125 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:00 old-k8s-version-445570 kubelet[671]: E1004 03:44:00.340379 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.688471 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:04 old-k8s-version-445570 kubelet[671]: E1004 03:44:04.337451 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.688815 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:15 old-k8s-version-445570 kubelet[671]: E1004 03:44:15.338470 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.689023 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:15 old-k8s-version-445570 kubelet[671]: E1004 03:44:15.338490 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.689214 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:26 old-k8s-version-445570 kubelet[671]: E1004 03:44:26.338825 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.689766 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:30 old-k8s-version-445570 kubelet[671]: E1004 03:44:30.337556 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.689963 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:37 old-k8s-version-445570 kubelet[671]: E1004 03:44:37.337773 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.690288 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:42 old-k8s-version-445570 kubelet[671]: E1004 03:44:42.337758 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.690476 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:48 old-k8s-version-445570 kubelet[671]: E1004 03:44:48.337763 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.690800 1364533 logs.go:138] Found kubelet problem: Oct 04 03:44:55 old-k8s-version-445570 kubelet[671]: E1004 03:44:55.342140 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.690983 1364533 logs.go:138] Found kubelet problem: Oct 04 03:45:00 old-k8s-version-445570 kubelet[671]: E1004 03:45:00.338647 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.692661 1364533 logs.go:138] Found kubelet problem: Oct 04 03:45:10 old-k8s-version-445570 kubelet[671]: E1004 03:45:10.337424 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.692859 1364533 logs.go:138] Found kubelet problem: Oct 04 03:45:13 old-k8s-version-445570 kubelet[671]: E1004 03:45:13.337752 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.693190 1364533 logs.go:138] Found kubelet problem: Oct 04 03:45:21 old-k8s-version-445570 kubelet[671]: E1004 03:45:21.338227 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:36.693373 1364533 logs.go:138] Found kubelet problem: Oct 04 03:45:27 old-k8s-version-445570 kubelet[671]: E1004 03:45:27.339413 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:36.695156 1364533 logs.go:138] Found kubelet problem: Oct 04 03:45:35 old-k8s-version-445570 kubelet[671]: E1004 03:45:35.337992 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
I1004 03:45:36.695182 1364533 logs.go:123] Gathering logs for describe nodes ...
I1004 03:45:36.695197 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I1004 03:45:36.893650 1364533 logs.go:123] Gathering logs for kube-apiserver [7295a2d0ecfbb037cef3fc882b64353c1e4575b1c95d6af1c6fc9c96a1117454] ...
I1004 03:45:36.893681 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7295a2d0ecfbb037cef3fc882b64353c1e4575b1c95d6af1c6fc9c96a1117454"
I1004 03:45:36.998974 1364533 logs.go:123] Gathering logs for kindnet [f8aacb2fb53da0491e7751aed07aea89402a0735466b779e4d04bf40f82a3515] ...
I1004 03:45:36.999014 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f8aacb2fb53da0491e7751aed07aea89402a0735466b779e4d04bf40f82a3515"
I1004 03:45:37.066175 1364533 logs.go:123] Gathering logs for container status ...
I1004 03:45:37.066214 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1004 03:45:37.144258 1364533 logs.go:123] Gathering logs for storage-provisioner [04caef5abf18eb64fc69564f2f195bf5c77f3dfcdbdf6c9a8ea68e37d9d094bf] ...
I1004 03:45:37.144315 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 04caef5abf18eb64fc69564f2f195bf5c77f3dfcdbdf6c9a8ea68e37d9d094bf"
I1004 03:45:37.198229 1364533 logs.go:123] Gathering logs for dmesg ...
I1004 03:45:37.198264 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1004 03:45:37.216564 1364533 logs.go:123] Gathering logs for kube-scheduler [fd61154c785ee669b3a620fd034d912e5b6005c06a250bcf7606b989ca283b91] ...
I1004 03:45:37.216601 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fd61154c785ee669b3a620fd034d912e5b6005c06a250bcf7606b989ca283b91"
I1004 03:45:37.279944 1364533 logs.go:123] Gathering logs for kube-proxy [7a1106279c108c93fe80eb2d47bc2a3c26515d0ea17e555376f4142a50dc8e36] ...
I1004 03:45:37.279978 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7a1106279c108c93fe80eb2d47bc2a3c26515d0ea17e555376f4142a50dc8e36"
I1004 03:45:37.332522 1364533 logs.go:123] Gathering logs for kube-proxy [db56e60ccb26a4841473896cf63de198a919c74df5b3e1845b2a4f73cce7d321] ...
I1004 03:45:37.332550 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db56e60ccb26a4841473896cf63de198a919c74df5b3e1845b2a4f73cce7d321"
I1004 03:45:37.401262 1364533 logs.go:123] Gathering logs for kube-apiserver [2ca331c9606d2e3fdf73e195154882978124a0238ea8e8961401d22f0b7cd51f] ...
I1004 03:45:37.401296 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2ca331c9606d2e3fdf73e195154882978124a0238ea8e8961401d22f0b7cd51f"
I1004 03:45:37.463550 1364533 logs.go:123] Gathering logs for kube-controller-manager [82b8e7498dd882ec676ce6d369194f9c7ce4d6c8fd44bd1a4efa6b9e965d9c1f] ...
I1004 03:45:37.463599 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 82b8e7498dd882ec676ce6d369194f9c7ce4d6c8fd44bd1a4efa6b9e965d9c1f"
I1004 03:45:37.568577 1364533 logs.go:123] Gathering logs for kube-controller-manager [f0343958cd2a62f0bc9fa707bef4553a3c44375d07b13d0c06f7728977fda287] ...
I1004 03:45:37.568611 1364533 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f0343958cd2a62f0bc9fa707bef4553a3c44375d07b13d0c06f7728977fda287"
I1004 03:45:37.673677 1364533 out.go:358] Setting ErrFile to fd 2...
I1004 03:45:37.673705 1364533 out.go:392] TERM=,COLORTERM=, which probably does not support color
W1004 03:45:37.673761 1364533 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W1004 03:45:37.673769 1364533 out.go:270] Oct 04 03:45:10 old-k8s-version-445570 kubelet[671]: E1004 03:45:10.337424 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
Oct 04 03:45:10 old-k8s-version-445570 kubelet[671]: E1004 03:45:10.337424 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:37.673788 1364533 out.go:270] Oct 04 03:45:13 old-k8s-version-445570 kubelet[671]: E1004 03:45:13.337752 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 04 03:45:13 old-k8s-version-445570 kubelet[671]: E1004 03:45:13.337752 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:37.673797 1364533 out.go:270] Oct 04 03:45:21 old-k8s-version-445570 kubelet[671]: E1004 03:45:21.338227 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
Oct 04 03:45:21 old-k8s-version-445570 kubelet[671]: E1004 03:45:21.338227 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
W1004 03:45:37.673802 1364533 out.go:270] Oct 04 03:45:27 old-k8s-version-445570 kubelet[671]: E1004 03:45:27.339413 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 04 03:45:27 old-k8s-version-445570 kubelet[671]: E1004 03:45:27.339413 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1004 03:45:37.673809 1364533 out.go:270] Oct 04 03:45:35 old-k8s-version-445570 kubelet[671]: E1004 03:45:35.337992 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
Oct 04 03:45:35 old-k8s-version-445570 kubelet[671]: E1004 03:45:35.337992 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
I1004 03:45:37.673813 1364533 out.go:358] Setting ErrFile to fd 2...
I1004 03:45:37.673821 1364533 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1004 03:45:47.675349 1364533 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I1004 03:45:47.688748 1364533 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I1004 03:45:47.741147 1364533 out.go:201]
W1004 03:45:47.765419 1364533 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W1004 03:45:47.765461 1364533 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W1004 03:45:47.765480 1364533 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W1004 03:45:47.765485 1364533 out.go:270] *
*
W1004 03:45:47.766343 1364533 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1004 03:45:47.797913 1364533 out.go:201]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-445570 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-445570
helpers_test.go:235: (dbg) docker inspect old-k8s-version-445570:
-- stdout --
[
{
"Id": "53d441e0f4417540d052bbcffb3de00f9e209050733a427ae19c1053e0076b53",
"Created": "2024-10-04T03:36:27.277899456Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1364731,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-10-04T03:39:39.539218687Z",
"FinishedAt": "2024-10-04T03:39:38.47895341Z"
},
"Image": "sha256:b5f10d57944829de859b6363a7c57065ccc6b1805dabb3bce283aaecb83f3acc",
"ResolvConfPath": "/var/lib/docker/containers/53d441e0f4417540d052bbcffb3de00f9e209050733a427ae19c1053e0076b53/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/53d441e0f4417540d052bbcffb3de00f9e209050733a427ae19c1053e0076b53/hostname",
"HostsPath": "/var/lib/docker/containers/53d441e0f4417540d052bbcffb3de00f9e209050733a427ae19c1053e0076b53/hosts",
"LogPath": "/var/lib/docker/containers/53d441e0f4417540d052bbcffb3de00f9e209050733a427ae19c1053e0076b53/53d441e0f4417540d052bbcffb3de00f9e209050733a427ae19c1053e0076b53-json.log",
"Name": "/old-k8s-version-445570",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-445570:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-445570",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/d4cec1bb00851aec00976a8d9ad32c710487e4427d64029f4f63c539f20da7ee-init/diff:/var/lib/docker/overlay2/3fd4f374838913cfff21eeb0320112c1c5932de8178b660a56df0e13b7402d74/diff",
"MergedDir": "/var/lib/docker/overlay2/d4cec1bb00851aec00976a8d9ad32c710487e4427d64029f4f63c539f20da7ee/merged",
"UpperDir": "/var/lib/docker/overlay2/d4cec1bb00851aec00976a8d9ad32c710487e4427d64029f4f63c539f20da7ee/diff",
"WorkDir": "/var/lib/docker/overlay2/d4cec1bb00851aec00976a8d9ad32c710487e4427d64029f4f63c539f20da7ee/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-445570",
"Source": "/var/lib/docker/volumes/old-k8s-version-445570/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-445570",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-445570",
"name.minikube.sigs.k8s.io": "old-k8s-version-445570",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "53e7bfecaf0ce21860e1984b85c65ac72115ddd4ce814175a99e877df7263ac4",
"SandboxKey": "/var/run/docker/netns/53e7bfecaf0c",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34547"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34548"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34551"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34549"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34550"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-445570": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null,
"NetworkID": "4d255da3c2e5a150ca577d15d5bd841fb0968b57142c23debebbe9468bcad537",
"EndpointID": "0234b99f3390763ff32d9aa251e4a5d5c8defbda8307c360102ec8cf4b1c2d27",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-445570",
"53d441e0f441"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-445570 -n old-k8s-version-445570
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-445570 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-445570 logs -n 25: (2.784329076s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| start | -p cert-expiration-671389 | cert-expiration-671389 | jenkins | v1.34.0 | 04 Oct 24 03:35 UTC | 04 Oct 24 03:36 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-103536 | force-systemd-env-103536 | jenkins | v1.34.0 | 04 Oct 24 03:35 UTC | 04 Oct 24 03:35 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-103536 | force-systemd-env-103536 | jenkins | v1.34.0 | 04 Oct 24 03:35 UTC | 04 Oct 24 03:35 UTC |
| start | -p cert-options-884103 | cert-options-884103 | jenkins | v1.34.0 | 04 Oct 24 03:35 UTC | 04 Oct 24 03:36 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-884103 ssh | cert-options-884103 | jenkins | v1.34.0 | 04 Oct 24 03:36 UTC | 04 Oct 24 03:36 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-884103 -- sudo | cert-options-884103 | jenkins | v1.34.0 | 04 Oct 24 03:36 UTC | 04 Oct 24 03:36 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-884103 | cert-options-884103 | jenkins | v1.34.0 | 04 Oct 24 03:36 UTC | 04 Oct 24 03:36 UTC |
| start | -p old-k8s-version-445570 | old-k8s-version-445570 | jenkins | v1.34.0 | 04 Oct 24 03:36 UTC | 04 Oct 24 03:39 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-671389 | cert-expiration-671389 | jenkins | v1.34.0 | 04 Oct 24 03:39 UTC | 04 Oct 24 03:39 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-671389 | cert-expiration-671389 | jenkins | v1.34.0 | 04 Oct 24 03:39 UTC | 04 Oct 24 03:39 UTC |
| start | -p no-preload-554493 | no-preload-554493 | jenkins | v1.34.0 | 04 Oct 24 03:39 UTC | 04 Oct 24 03:40 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| addons | enable metrics-server -p old-k8s-version-445570 | old-k8s-version-445570 | jenkins | v1.34.0 | 04 Oct 24 03:39 UTC | 04 Oct 24 03:39 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-445570 | old-k8s-version-445570 | jenkins | v1.34.0 | 04 Oct 24 03:39 UTC | 04 Oct 24 03:39 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-445570 | old-k8s-version-445570 | jenkins | v1.34.0 | 04 Oct 24 03:39 UTC | 04 Oct 24 03:39 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-445570 | old-k8s-version-445570 | jenkins | v1.34.0 | 04 Oct 24 03:39 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-554493 | no-preload-554493 | jenkins | v1.34.0 | 04 Oct 24 03:40 UTC | 04 Oct 24 03:40 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-554493 | no-preload-554493 | jenkins | v1.34.0 | 04 Oct 24 03:40 UTC | 04 Oct 24 03:40 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-554493 | no-preload-554493 | jenkins | v1.34.0 | 04 Oct 24 03:40 UTC | 04 Oct 24 03:40 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-554493 | no-preload-554493 | jenkins | v1.34.0 | 04 Oct 24 03:40 UTC | 04 Oct 24 03:45 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| image | no-preload-554493 image list | no-preload-554493 | jenkins | v1.34.0 | 04 Oct 24 03:45 UTC | 04 Oct 24 03:45 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-554493 | no-preload-554493 | jenkins | v1.34.0 | 04 Oct 24 03:45 UTC | 04 Oct 24 03:45 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-554493 | no-preload-554493 | jenkins | v1.34.0 | 04 Oct 24 03:45 UTC | 04 Oct 24 03:45 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-554493 | no-preload-554493 | jenkins | v1.34.0 | 04 Oct 24 03:45 UTC | 04 Oct 24 03:45 UTC |
| delete | -p no-preload-554493 | no-preload-554493 | jenkins | v1.34.0 | 04 Oct 24 03:45 UTC | 04 Oct 24 03:45 UTC |
| start | -p embed-certs-690742 | embed-certs-690742 | jenkins | v1.34.0 | 04 Oct 24 03:45 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/10/04 03:45:42
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1004 03:45:42.884494 1375632 out.go:345] Setting OutFile to fd 1 ...
I1004 03:45:42.884618 1375632 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1004 03:45:42.884627 1375632 out.go:358] Setting ErrFile to fd 2...
I1004 03:45:42.884633 1375632 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1004 03:45:42.884872 1375632 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19546-1149434/.minikube/bin
I1004 03:45:42.885307 1375632 out.go:352] Setting JSON to false
I1004 03:45:42.886442 1375632 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":26891,"bootTime":1727986652,"procs":224,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I1004 03:45:42.886514 1375632 start.go:139] virtualization:
I1004 03:45:42.889190 1375632 out.go:177] * [embed-certs-690742] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I1004 03:45:42.891995 1375632 out.go:177] - MINIKUBE_LOCATION=19546
I1004 03:45:42.892124 1375632 notify.go:220] Checking for updates...
I1004 03:45:42.895534 1375632 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1004 03:45:42.897765 1375632 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19546-1149434/kubeconfig
I1004 03:45:42.899990 1375632 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19546-1149434/.minikube
I1004 03:45:42.901773 1375632 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I1004 03:45:42.903446 1375632 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1004 03:45:42.905971 1375632 config.go:182] Loaded profile config "old-k8s-version-445570": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I1004 03:45:42.906083 1375632 driver.go:394] Setting default libvirt URI to qemu:///system
I1004 03:45:42.936395 1375632 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I1004 03:45:42.936512 1375632 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1004 03:45:42.990583 1375632 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:34 OomKillDisable:true NGoroutines:52 SystemTime:2024-10-04 03:45:42.980301172 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I1004 03:45:42.990689 1375632 docker.go:318] overlay module found
I1004 03:45:42.992732 1375632 out.go:177] * Using the docker driver based on user configuration
I1004 03:45:42.994423 1375632 start.go:297] selected driver: docker
I1004 03:45:42.994441 1375632 start.go:901] validating driver "docker" against <nil>
I1004 03:45:42.994455 1375632 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1004 03:45:42.995096 1375632 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1004 03:45:43.057341 1375632 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:34 OomKillDisable:true NGoroutines:52 SystemTime:2024-10-04 03:45:43.048129251 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I1004 03:45:43.057546 1375632 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I1004 03:45:43.057767 1375632 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1004 03:45:43.059735 1375632 out.go:177] * Using Docker driver with root privileges
I1004 03:45:43.061527 1375632 cni.go:84] Creating CNI manager for ""
I1004 03:45:43.061588 1375632 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1004 03:45:43.061601 1375632 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I1004 03:45:43.061679 1375632 start.go:340] cluster config:
{Name:embed-certs-690742 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:embed-certs-690742 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contai
nerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stat
icIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1004 03:45:43.063494 1375632 out.go:177] * Starting "embed-certs-690742" primary control-plane node in "embed-certs-690742" cluster
I1004 03:45:43.065103 1375632 cache.go:121] Beginning downloading kic base image for docker with containerd
I1004 03:45:43.067121 1375632 out.go:177] * Pulling base image v0.0.45-1727731891-master ...
I1004 03:45:43.068864 1375632 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 in local docker daemon
I1004 03:45:43.068868 1375632 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I1004 03:45:43.068927 1375632 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19546-1149434/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4
I1004 03:45:43.068935 1375632 cache.go:56] Caching tarball of preloaded images
I1004 03:45:43.069014 1375632 preload.go:172] Found /home/jenkins/minikube-integration/19546-1149434/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I1004 03:45:43.069024 1375632 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on containerd
I1004 03:45:43.069128 1375632 profile.go:143] Saving config to /home/jenkins/minikube-integration/19546-1149434/.minikube/profiles/embed-certs-690742/config.json ...
I1004 03:45:43.069145 1375632 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19546-1149434/.minikube/profiles/embed-certs-690742/config.json: {Name:mkf7865187de804637fa3d0890640c1689051ba5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1004 03:45:43.088034 1375632 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 in local docker daemon, skipping pull
I1004 03:45:43.088056 1375632 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 exists in daemon, skipping load
I1004 03:45:43.088069 1375632 cache.go:194] Successfully downloaded all kic artifacts
I1004 03:45:43.088097 1375632 start.go:360] acquireMachinesLock for embed-certs-690742: {Name:mk20ca3433e0c49bc2ecfdb24b72603f90bc0b41 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1004 03:45:43.088812 1375632 start.go:364] duration metric: took 692.036µs to acquireMachinesLock for "embed-certs-690742"
I1004 03:45:43.088850 1375632 start.go:93] Provisioning new machine with config: &{Name:embed-certs-690742 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:embed-certs-690742 Namespace:default APIServerHAVIP: APIServ
erName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disable
Metrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I1004 03:45:43.088933 1375632 start.go:125] createHost starting for "" (driver="docker")
I1004 03:45:47.675349 1364533 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I1004 03:45:47.688748 1364533 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I1004 03:45:47.741147 1364533 out.go:201]
W1004 03:45:47.765419 1364533 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W1004 03:45:47.765461 1364533 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W1004 03:45:47.765480 1364533 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W1004 03:45:47.765485 1364533 out.go:270] *
W1004 03:45:47.766343 1364533 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1004 03:45:47.797913 1364533 out.go:201]
I1004 03:45:43.091554 1375632 out.go:235] * Creating docker container (CPUs=2, Memory=2200MB) ...
I1004 03:45:43.091836 1375632 start.go:159] libmachine.API.Create for "embed-certs-690742" (driver="docker")
I1004 03:45:43.091870 1375632 client.go:168] LocalClient.Create starting
I1004 03:45:43.091939 1375632 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19546-1149434/.minikube/certs/ca.pem
I1004 03:45:43.091973 1375632 main.go:141] libmachine: Decoding PEM data...
I1004 03:45:43.091992 1375632 main.go:141] libmachine: Parsing certificate...
I1004 03:45:43.092049 1375632 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19546-1149434/.minikube/certs/cert.pem
I1004 03:45:43.092086 1375632 main.go:141] libmachine: Decoding PEM data...
I1004 03:45:43.092100 1375632 main.go:141] libmachine: Parsing certificate...
I1004 03:45:43.092558 1375632 cli_runner.go:164] Run: docker network inspect embed-certs-690742 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1004 03:45:43.114089 1375632 cli_runner.go:211] docker network inspect embed-certs-690742 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1004 03:45:43.114174 1375632 network_create.go:284] running [docker network inspect embed-certs-690742] to gather additional debugging logs...
I1004 03:45:43.114197 1375632 cli_runner.go:164] Run: docker network inspect embed-certs-690742
W1004 03:45:43.129367 1375632 cli_runner.go:211] docker network inspect embed-certs-690742 returned with exit code 1
I1004 03:45:43.129400 1375632 network_create.go:287] error running [docker network inspect embed-certs-690742]: docker network inspect embed-certs-690742: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-690742 not found
I1004 03:45:43.129414 1375632 network_create.go:289] output of [docker network inspect embed-certs-690742]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-690742 not found
** /stderr **
I1004 03:45:43.129558 1375632 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1004 03:45:43.144067 1375632 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-9a360696897c IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:9f:3a:5e:6c} reservation:<nil>}
I1004 03:45:43.144627 1375632 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-1b255e34ff22 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:c8:25:72:87} reservation:<nil>}
I1004 03:45:43.145085 1375632 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-196dd403b54f IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:45:3d:82:93} reservation:<nil>}
I1004 03:45:43.145452 1375632 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-4d255da3c2e5 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:bf:3d:c0:9e} reservation:<nil>}
I1004 03:45:43.145972 1375632 network.go:206] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001920000}
I1004 03:45:43.145996 1375632 network_create.go:124] attempt to create docker network embed-certs-690742 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I1004 03:45:43.146055 1375632 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-690742 embed-certs-690742
I1004 03:45:43.224890 1375632 network_create.go:108] docker network embed-certs-690742 192.168.85.0/24 created
I1004 03:45:43.224925 1375632 kic.go:121] calculated static IP "192.168.85.2" for the "embed-certs-690742" container
I1004 03:45:43.225019 1375632 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1004 03:45:43.239022 1375632 cli_runner.go:164] Run: docker volume create embed-certs-690742 --label name.minikube.sigs.k8s.io=embed-certs-690742 --label created_by.minikube.sigs.k8s.io=true
I1004 03:45:43.256524 1375632 oci.go:103] Successfully created a docker volume embed-certs-690742
I1004 03:45:43.256619 1375632 cli_runner.go:164] Run: docker run --rm --name embed-certs-690742-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-690742 --entrypoint /usr/bin/test -v embed-certs-690742:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 -d /var/lib
I1004 03:45:43.881965 1375632 oci.go:107] Successfully prepared a docker volume embed-certs-690742
I1004 03:45:43.882024 1375632 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I1004 03:45:43.882045 1375632 kic.go:194] Starting extracting preloaded images to volume ...
I1004 03:45:43.882121 1375632 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19546-1149434/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-690742:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 -I lz4 -xf /preloaded.tar -C /extractDir
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
541099ab654ad 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 39a59314e83fb dashboard-metrics-scraper-8d5bb5db8-brtqr
e25a99d73dc12 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 a68df72e19ad8 kubernetes-dashboard-cd95d586-psgpt
f8aacb2fb53da 6a23fa8fd2b78 5 minutes ago Running kindnet-cni 1 6bff25a9fbcf6 kindnet-56kgm
04caef5abf18e ba04bb24b9575 5 minutes ago Running storage-provisioner 1 0a1f920990ae2 storage-provisioner
c65ea8441f9c5 db91994f4ee8f 5 minutes ago Running coredns 1 e4d92cce003c2 coredns-74ff55c5b-d25t5
7a1106279c108 25a5233254979 5 minutes ago Running kube-proxy 1 514ddeb834289 kube-proxy-tm9p4
72d7d731f2d17 1611cd07b61d5 5 minutes ago Running busybox 1 2291d979d96b0 busybox
fd61154c785ee e7605f88f17d6 5 minutes ago Running kube-scheduler 1 96a415f44644b kube-scheduler-old-k8s-version-445570
82b8e7498dd88 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 47ef51c82fb03 kube-controller-manager-old-k8s-version-445570
5436a81bb30f9 05b738aa1bc63 5 minutes ago Running etcd 1 299126b4ba4ff etcd-old-k8s-version-445570
7295a2d0ecfbb 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 0835e665ec181 kube-apiserver-old-k8s-version-445570
88ad5c2cefc35 1611cd07b61d5 6 minutes ago Exited busybox 0 9cc6fe0921e37 busybox
5b535bea1bc53 db91994f4ee8f 8 minutes ago Exited coredns 0 f49bfd82584d4 coredns-74ff55c5b-d25t5
9b85407f81192 6a23fa8fd2b78 8 minutes ago Exited kindnet-cni 0 bd1865e1916fc kindnet-56kgm
b199a132a6523 ba04bb24b9575 8 minutes ago Exited storage-provisioner 0 5ff96f6895330 storage-provisioner
db56e60ccb26a 25a5233254979 8 minutes ago Exited kube-proxy 0 657fd06fc071b kube-proxy-tm9p4
f0343958cd2a6 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 45b4f3532885a kube-controller-manager-old-k8s-version-445570
1f76481f61cbe e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 e56558cdb61fe kube-scheduler-old-k8s-version-445570
2ca331c9606d2 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 8025a67c4cbbb kube-apiserver-old-k8s-version-445570
cf53ebe3031ec 05b738aa1bc63 8 minutes ago Exited etcd 0 79667dbbe1678 etcd-old-k8s-version-445570
==> containerd <==
Oct 04 03:41:34 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:41:34.343575688Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Oct 04 03:41:34 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:41:34.345137484Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Oct 04 03:41:34 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:41:34.345236085Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Oct 04 03:42:07 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:42:07.340877475Z" level=info msg="CreateContainer within sandbox \"39a59314e83fb2452394a91abe5e606ca0b0fac0dbea00438355f2a79580e5b9\" for container name:\"dashboard-metrics-scraper\" attempt:4"
Oct 04 03:42:07 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:42:07.362537195Z" level=info msg="CreateContainer within sandbox \"39a59314e83fb2452394a91abe5e606ca0b0fac0dbea00438355f2a79580e5b9\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"46a6636b23643ba2a917c4748907eb005f58f3c610509360ac3f4c670e6fa1f1\""
Oct 04 03:42:07 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:42:07.363300452Z" level=info msg="StartContainer for \"46a6636b23643ba2a917c4748907eb005f58f3c610509360ac3f4c670e6fa1f1\""
Oct 04 03:42:07 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:42:07.448059053Z" level=info msg="StartContainer for \"46a6636b23643ba2a917c4748907eb005f58f3c610509360ac3f4c670e6fa1f1\" returns successfully"
Oct 04 03:42:07 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:42:07.474987947Z" level=info msg="shim disconnected" id=46a6636b23643ba2a917c4748907eb005f58f3c610509360ac3f4c670e6fa1f1 namespace=k8s.io
Oct 04 03:42:07 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:42:07.475052866Z" level=warning msg="cleaning up after shim disconnected" id=46a6636b23643ba2a917c4748907eb005f58f3c610509360ac3f4c670e6fa1f1 namespace=k8s.io
Oct 04 03:42:07 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:42:07.475074397Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Oct 04 03:42:07 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:42:07.898139471Z" level=info msg="RemoveContainer for \"90da46afcbe44648b2eb32cb1cd5c826ef87c223d2054ef51472000b5cbcbbfe\""
Oct 04 03:42:07 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:42:07.905825185Z" level=info msg="RemoveContainer for \"90da46afcbe44648b2eb32cb1cd5c826ef87c223d2054ef51472000b5cbcbbfe\" returns successfully"
Oct 04 03:43:08 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:43:08.338367552Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 04 03:43:08 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:43:08.343062226Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Oct 04 03:43:08 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:43:08.344678831Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Oct 04 03:43:08 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:43:08.344684468Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Oct 04 03:43:28 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:43:28.339287343Z" level=info msg="CreateContainer within sandbox \"39a59314e83fb2452394a91abe5e606ca0b0fac0dbea00438355f2a79580e5b9\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Oct 04 03:43:28 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:43:28.354553104Z" level=info msg="CreateContainer within sandbox \"39a59314e83fb2452394a91abe5e606ca0b0fac0dbea00438355f2a79580e5b9\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"541099ab654adffd4369c8a8d599dd601bc9f82430e011116576d472bc561bac\""
Oct 04 03:43:28 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:43:28.355372073Z" level=info msg="StartContainer for \"541099ab654adffd4369c8a8d599dd601bc9f82430e011116576d472bc561bac\""
Oct 04 03:43:28 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:43:28.432770645Z" level=info msg="StartContainer for \"541099ab654adffd4369c8a8d599dd601bc9f82430e011116576d472bc561bac\" returns successfully"
Oct 04 03:43:28 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:43:28.462225344Z" level=info msg="shim disconnected" id=541099ab654adffd4369c8a8d599dd601bc9f82430e011116576d472bc561bac namespace=k8s.io
Oct 04 03:43:28 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:43:28.462290509Z" level=warning msg="cleaning up after shim disconnected" id=541099ab654adffd4369c8a8d599dd601bc9f82430e011116576d472bc561bac namespace=k8s.io
Oct 04 03:43:28 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:43:28.462300913Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Oct 04 03:43:29 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:43:29.139875282Z" level=info msg="RemoveContainer for \"46a6636b23643ba2a917c4748907eb005f58f3c610509360ac3f4c670e6fa1f1\""
Oct 04 03:43:29 old-k8s-version-445570 containerd[570]: time="2024-10-04T03:43:29.162340689Z" level=info msg="RemoveContainer for \"46a6636b23643ba2a917c4748907eb005f58f3c610509360ac3f4c670e6fa1f1\" returns successfully"
==> coredns [5b535bea1bc5353fd89eb2f07b641c965bcf0920d107f3e61183ce2e39af4160] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:33719 - 54397 "HINFO IN 1863994683067902719.8725812619912626578. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.005646324s
==> coredns [c65ea8441f9c58b1b1bad277473595b6c22ee03a26bf15c60bedacb50f08105d] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:45252 - 73 "HINFO IN 5779111556160776051.4278965858038898769. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.00543611s
==> describe nodes <==
Name: old-k8s-version-445570
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-445570
kubernetes.io/os=linux
minikube.k8s.io/commit=bb93d8722461655cd69aaff21bc3938f9e86d89e
minikube.k8s.io/name=old-k8s-version-445570
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_10_04T03_37_05_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 04 Oct 2024 03:37:01 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-445570
AcquireTime: <unset>
RenewTime: Fri, 04 Oct 2024 03:45:40 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 04 Oct 2024 03:41:00 +0000 Fri, 04 Oct 2024 03:36:54 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 04 Oct 2024 03:41:00 +0000 Fri, 04 Oct 2024 03:36:54 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 04 Oct 2024 03:41:00 +0000 Fri, 04 Oct 2024 03:36:54 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 04 Oct 2024 03:41:00 +0000 Fri, 04 Oct 2024 03:37:20 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-445570
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
System Info:
Machine ID: 45110b9e1c304cfebedfd4551012ef48
System UUID: 8355de09-cc63-4b7c-9a1c-cb7a1f8036f2
Boot ID: c9bb91eb-f5c3-4f81-9b8d-aca1ad72b7b9
Kernel Version: 5.15.0-1070-aws
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.22
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m37s
kube-system coredns-74ff55c5b-d25t5 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 8m30s
kube-system etcd-old-k8s-version-445570 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 8m37s
kube-system kindnet-56kgm 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 8m30s
kube-system kube-apiserver-old-k8s-version-445570 250m (12%) 0 (0%) 0 (0%) 0 (0%) 8m37s
kube-system kube-controller-manager-old-k8s-version-445570 200m (10%) 0 (0%) 0 (0%) 0 (0%) 8m37s
kube-system kube-proxy-tm9p4 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m30s
kube-system kube-scheduler-old-k8s-version-445570 100m (5%) 0 (0%) 0 (0%) 0 (0%) 8m37s
kube-system metrics-server-9975d5f86-7vbmk 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 6m24s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m29s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-brtqr 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m24s
kubernetes-dashboard kubernetes-dashboard-cd95d586-psgpt 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m24s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 100m (5%)
memory 420Mi (5%) 220Mi (2%)
ephemeral-storage 100Mi (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m58s (x5 over 8m58s) kubelet Node old-k8s-version-445570 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m58s (x5 over 8m58s) kubelet Node old-k8s-version-445570 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m58s (x4 over 8m58s) kubelet Node old-k8s-version-445570 status is now: NodeHasSufficientPID
Normal Starting 8m38s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m38s kubelet Node old-k8s-version-445570 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m38s kubelet Node old-k8s-version-445570 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m38s kubelet Node old-k8s-version-445570 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m37s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m30s kubelet Node old-k8s-version-445570 status is now: NodeReady
Normal Starting 8m29s kube-proxy Starting kube-proxy.
Normal Starting 5m55s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m55s (x8 over 5m55s) kubelet Node old-k8s-version-445570 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m55s (x7 over 5m55s) kubelet Node old-k8s-version-445570 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m55s (x8 over 5m55s) kubelet Node old-k8s-version-445570 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m55s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m40s kube-proxy Starting kube-proxy.
==> dmesg <==
[Oct 4 02:19] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
[ +0.194222] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
[ +0.045203] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
==> etcd [5436a81bb30f9621df50a410542d13c170eb3978f3fca9a4b268ce4954e20d08] <==
2024-10-04 03:41:50.215149 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:42:00.225558 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:42:10.215255 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:42:20.215142 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:42:30.215402 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:42:40.215226 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:42:50.215213 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:43:00.215949 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:43:10.215120 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:43:20.215240 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:43:30.215319 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:43:40.215120 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:43:50.215189 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:44:00.241033 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:44:10.215246 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:44:20.215264 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:44:30.215249 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:44:40.215218 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:44:50.215128 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:45:00.220824 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:45:10.215167 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:45:20.215301 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:45:30.215275 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:45:40.215954 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:45:50.215301 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [cf53ebe3031ec2133d6246e747d96d7f552d2736d7e6cd96300f5a2ac21352ec] <==
raft2024/10/04 03:36:54 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/10/04 03:36:54 INFO: ea7e25599daad906 became leader at term 2
raft2024/10/04 03:36:54 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-10-04 03:36:54.371984 I | embed: ready to serve client requests
2024-10-04 03:36:54.373404 I | embed: serving client requests on 192.168.76.2:2379
2024-10-04 03:36:54.373592 I | etcdserver: setting up the initial cluster version to 3.4
2024-10-04 03:36:54.373891 I | embed: ready to serve client requests
2024-10-04 03:36:54.375128 I | embed: serving client requests on 127.0.0.1:2379
2024-10-04 03:36:54.381226 I | etcdserver: published {Name:old-k8s-version-445570 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-10-04 03:36:54.404023 N | etcdserver/membership: set the initial cluster version to 3.4
2024-10-04 03:36:54.404676 I | etcdserver/api: enabled capabilities for version 3.4
2024-10-04 03:37:16.678140 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:37:23.608387 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:37:33.608215 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:37:43.608376 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:37:53.608135 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:38:03.608426 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:38:13.608232 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:38:23.608465 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:38:33.608572 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:38:43.608378 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:38:53.608244 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:39:03.608307 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:39:13.613151 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-04 03:39:23.608413 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
03:45:50 up 7:28, 0 users, load average: 1.40, 1.82, 2.36
Linux old-k8s-version-445570 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [9b85407f811920c6bd4bf65c40d73c3828a80edb440329a260629dadac6c325b] <==
I1004 03:37:25.002460 1 controller.go:374] Syncing nftables rules
I1004 03:37:34.817577 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:37:34.817700 1 main.go:299] handling current node
I1004 03:37:44.817800 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:37:44.817901 1 main.go:299] handling current node
I1004 03:37:54.817235 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:37:54.817273 1 main.go:299] handling current node
I1004 03:38:04.827844 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:38:04.827879 1 main.go:299] handling current node
I1004 03:38:14.822322 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:38:14.822361 1 main.go:299] handling current node
I1004 03:38:24.817244 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:38:24.817278 1 main.go:299] handling current node
I1004 03:38:34.824026 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:38:34.824060 1 main.go:299] handling current node
I1004 03:38:44.820365 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:38:44.820398 1 main.go:299] handling current node
I1004 03:38:54.824920 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:38:54.824957 1 main.go:299] handling current node
I1004 03:39:04.823801 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:39:04.823834 1 main.go:299] handling current node
I1004 03:39:14.817531 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:39:14.817564 1 main.go:299] handling current node
I1004 03:39:24.817820 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:39:24.817860 1 main.go:299] handling current node
==> kindnet [f8aacb2fb53da0491e7751aed07aea89402a0735466b779e4d04bf40f82a3515] <==
I1004 03:43:42.704568 1 main.go:299] handling current node
I1004 03:43:52.708380 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:43:52.708473 1 main.go:299] handling current node
I1004 03:44:02.710333 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:44:02.710535 1 main.go:299] handling current node
I1004 03:44:12.701900 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:44:12.701931 1 main.go:299] handling current node
I1004 03:44:22.708359 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:44:22.708394 1 main.go:299] handling current node
I1004 03:44:32.708362 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:44:32.708398 1 main.go:299] handling current node
I1004 03:44:42.707266 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:44:42.708183 1 main.go:299] handling current node
I1004 03:44:52.713643 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:44:52.713675 1 main.go:299] handling current node
I1004 03:45:02.709817 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:45:02.709856 1 main.go:299] handling current node
I1004 03:45:12.701704 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:45:12.701801 1 main.go:299] handling current node
I1004 03:45:22.708169 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:45:22.708420 1 main.go:299] handling current node
I1004 03:45:32.706162 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:45:32.706198 1 main.go:299] handling current node
I1004 03:45:42.714477 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1004 03:45:42.714515 1 main.go:299] handling current node
==> kube-apiserver [2ca331c9606d2e3fdf73e195154882978124a0238ea8e8961401d22f0b7cd51f] <==
I1004 03:37:02.168411 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I1004 03:37:02.696780 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1004 03:37:02.740210 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W1004 03:37:02.844767 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I1004 03:37:02.845811 1 controller.go:606] quota admission added evaluator for: endpoints
I1004 03:37:02.850090 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1004 03:37:03.820244 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I1004 03:37:04.336611 1 controller.go:606] quota admission added evaluator for: deployments.apps
I1004 03:37:04.436500 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I1004 03:37:12.767049 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I1004 03:37:20.393783 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I1004 03:37:20.395636 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I1004 03:37:25.769201 1 client.go:360] parsed scheme: "passthrough"
I1004 03:37:25.769246 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1004 03:37:25.769257 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1004 03:37:56.308955 1 client.go:360] parsed scheme: "passthrough"
I1004 03:37:56.309071 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1004 03:37:56.309140 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1004 03:38:39.979921 1 client.go:360] parsed scheme: "passthrough"
I1004 03:38:39.979970 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1004 03:38:39.979985 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1004 03:39:21.237529 1 client.go:360] parsed scheme: "passthrough"
I1004 03:39:21.237578 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1004 03:39:21.237586 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
E1004 03:39:24.463622 1 upgradeaware.go:387] Error proxying data from backend to client: write tcp 192.168.76.2:8443->192.168.76.1:55714: write: connection reset by peer
==> kube-apiserver [7295a2d0ecfbb037cef3fc882b64353c1e4575b1c95d6af1c6fc9c96a1117454] <==
I1004 03:42:27.406920 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1004 03:42:27.406950 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1004 03:43:03.791600 1 client.go:360] parsed scheme: "passthrough"
I1004 03:43:03.791662 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1004 03:43:03.791672 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W1004 03:43:10.172857 1 handler_proxy.go:102] no RequestInfo found in the context
E1004 03:43:10.172945 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1004 03:43:10.172958 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I1004 03:43:41.354955 1 client.go:360] parsed scheme: "passthrough"
I1004 03:43:41.355010 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1004 03:43:41.355019 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1004 03:44:20.310729 1 client.go:360] parsed scheme: "passthrough"
I1004 03:44:20.310927 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1004 03:44:20.311017 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1004 03:44:55.519565 1 client.go:360] parsed scheme: "passthrough"
I1004 03:44:55.519618 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1004 03:44:55.519631 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W1004 03:45:08.905607 1 handler_proxy.go:102] no RequestInfo found in the context
E1004 03:45:08.905857 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1004 03:45:08.905873 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I1004 03:45:34.464439 1 client.go:360] parsed scheme: "passthrough"
I1004 03:45:34.464487 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1004 03:45:34.464495 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [82b8e7498dd882ec676ce6d369194f9c7ce4d6c8fd44bd1a4efa6b9e965d9c1f] <==
E1004 03:41:27.468111 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1004 03:41:30.970142 1 request.go:655] Throttling request took 1.048045642s, request: GET:https://192.168.76.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
W1004 03:41:31.821592 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1004 03:41:57.969899 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1004 03:42:03.472160 1 request.go:655] Throttling request took 1.048151808s, request: GET:https://192.168.76.2:8443/apis/scheduling.k8s.io/v1beta1?timeout=32s
W1004 03:42:04.323662 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1004 03:42:28.471757 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1004 03:42:35.974006 1 request.go:655] Throttling request took 1.048332333s, request: GET:https://192.168.76.2:8443/apis/rbac.authorization.k8s.io/v1beta1?timeout=32s
W1004 03:42:36.825584 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1004 03:42:58.973782 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1004 03:43:08.476096 1 request.go:655] Throttling request took 1.048508271s, request: GET:https://192.168.76.2:8443/apis/authorization.k8s.io/v1?timeout=32s
W1004 03:43:09.327558 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1004 03:43:29.475899 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1004 03:43:40.978110 1 request.go:655] Throttling request took 1.048513578s, request: GET:https://192.168.76.2:8443/apis/events.k8s.io/v1beta1?timeout=32s
W1004 03:43:41.829562 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1004 03:43:59.977684 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1004 03:44:13.480150 1 request.go:655] Throttling request took 1.048376753s, request: GET:https://192.168.76.2:8443/apis/authentication.k8s.io/v1?timeout=32s
W1004 03:44:14.331595 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1004 03:44:30.479582 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1004 03:44:45.981909 1 request.go:655] Throttling request took 1.048294196s, request: GET:https://192.168.76.2:8443/apis/authentication.k8s.io/v1?timeout=32s
W1004 03:44:46.833499 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1004 03:45:00.981988 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1004 03:45:18.484068 1 request.go:655] Throttling request took 1.048520551s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W1004 03:45:19.335693 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1004 03:45:31.483928 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
==> kube-controller-manager [f0343958cd2a62f0bc9fa707bef4553a3c44375d07b13d0c06f7728977fda287] <==
I1004 03:37:20.385199 1 range_allocator.go:373] Set node old-k8s-version-445570 PodCIDR to [10.244.0.0/24]
I1004 03:37:20.429519 1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-old-k8s-version-445570" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I1004 03:37:20.438333 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
I1004 03:37:20.471787 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-tm9p4"
I1004 03:37:20.476389 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-56kgm"
I1004 03:37:20.479141 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-h7lvz"
I1004 03:37:20.488881 1 shared_informer.go:247] Caches are synced for disruption
I1004 03:37:20.490276 1 disruption.go:339] Sending events to api server.
I1004 03:37:20.490709 1 shared_informer.go:247] Caches are synced for ReplicationController
I1004 03:37:20.505188 1 shared_informer.go:247] Caches are synced for resource quota
I1004 03:37:20.517888 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-d25t5"
I1004 03:37:20.568415 1 shared_informer.go:247] Caches are synced for job
E1004 03:37:20.599433 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"86526c89-dce6-4642-82a1-fb5043c17110", ResourceVersion:"265", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63863609824, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001a2b000), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001a2b020)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0x4001a2b040), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x400185d180), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001a2b
060), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001a2b080), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001a2b0c0)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001886ba0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4000d63b28), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40003bfea0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x400000ebe0)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4000d63b78)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
E1004 03:37:20.600391 1 daemon_controller.go:320] kube-system/kindnet failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kindnet", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"50b1b9f1-a11a-452d-8b49-db4d894c78ac", ResourceVersion:"277", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63863609824, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"},\"name\":\"kindnet\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"app\":\"k
indnet\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"}},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"HOST_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.hostIP\"}}},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"POD_SUBNET\",\"value\":\"10.244.0.0/16\"}],\"image\":\"docker.io/kindest/kindnetd:v20240813-c6f155d6\",\"name\":\"kindnet-cni\",\"resources\":{\"limits\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"}},\"securityContext\":{\"capabilities\":{\"add\":[\"NET_RAW\",\"NET_ADMIN\"]},\"privileged\":false},\"volumeMounts\":[{\"mountPath\":\"/etc/cni/net.d\",\"name\":\"cni-cfg\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\",\"readOnly\":false},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\",\"readOnly\":true}]}],\"hostNetwork\":true,\"serviceAccountName\":\"kindnet\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\
":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/etc/cni/net.d\",\"type\":\"DirectoryOrCreate\"},\"name\":\"cni-cfg\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"}]}}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001a2b120), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001a2b140)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4001a2b160), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string
{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"cni-cfg", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001a2b180), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil),
FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001a2b1a0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Glust
erfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001a2b1c0), EmptyDi
r:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil),
PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kindnet-cni", Image:"docker.io/kindest/kindnetd:v20240813-c6f155d6", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOST_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001a2b1e0)}, v1.EnvVar{Name:"POD_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001a2b220)}, v1.EnvVar{Name:"POD_SUBNET", Value:"10.244.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:
0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-cfg", ReadOnly:false, MountPath:"/etc/cni/net.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:
(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001886c00), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4000d63d98), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"kindnet", DeprecatedServiceAccount:"kindnet", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40003bff80), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}},
HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x400000ec00)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4000d63df0)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kindnet": the object has been modified; please apply your changes to the latest version and try again
I1004 03:37:20.705379 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I1004 03:37:21.005590 1 shared_informer.go:247] Caches are synced for garbage collector
I1004 03:37:21.016329 1 shared_informer.go:247] Caches are synced for garbage collector
I1004 03:37:21.016357 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I1004 03:37:21.256396 1 request.go:655] Throttling request took 1.051213342s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
I1004 03:37:22.013961 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I1004 03:37:22.014885 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-h7lvz"
I1004 03:37:22.055601 1 shared_informer.go:240] Waiting for caches to sync for resource quota
I1004 03:37:22.055862 1 shared_informer.go:247] Caches are synced for resource quota
I1004 03:37:25.368141 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I1004 03:39:25.511074 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
==> kube-proxy [7a1106279c108c93fe80eb2d47bc2a3c26515d0ea17e555376f4142a50dc8e36] <==
I1004 03:40:10.340134 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I1004 03:40:10.340347 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W1004 03:40:10.357401 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I1004 03:40:10.357743 1 server_others.go:185] Using iptables Proxier.
I1004 03:40:10.358092 1 server.go:650] Version: v1.20.0
I1004 03:40:10.358877 1 config.go:315] Starting service config controller
I1004 03:40:10.361205 1 shared_informer.go:240] Waiting for caches to sync for service config
I1004 03:40:10.361398 1 config.go:224] Starting endpoint slice config controller
I1004 03:40:10.361803 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I1004 03:40:10.461386 1 shared_informer.go:247] Caches are synced for service config
I1004 03:40:10.462027 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-proxy [db56e60ccb26a4841473896cf63de198a919c74df5b3e1845b2a4f73cce7d321] <==
I1004 03:37:21.524431 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I1004 03:37:21.524555 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W1004 03:37:21.562571 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I1004 03:37:21.562663 1 server_others.go:185] Using iptables Proxier.
I1004 03:37:21.562926 1 server.go:650] Version: v1.20.0
I1004 03:37:21.563404 1 config.go:315] Starting service config controller
I1004 03:37:21.563424 1 shared_informer.go:240] Waiting for caches to sync for service config
I1004 03:37:21.564607 1 config.go:224] Starting endpoint slice config controller
I1004 03:37:21.564622 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I1004 03:37:21.664408 1 shared_informer.go:247] Caches are synced for service config
I1004 03:37:21.664729 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [1f76481f61cbe7daf82f893f0b6981b679e5a69b4198f0649d9874f825189c23] <==
W1004 03:37:01.309377 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W1004 03:37:01.309592 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W1004 03:37:01.309696 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W1004 03:37:01.309781 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1004 03:37:01.368609 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I1004 03:37:01.368877 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1004 03:37:01.368981 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1004 03:37:01.369091 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E1004 03:37:01.384977 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E1004 03:37:01.385335 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E1004 03:37:01.385572 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E1004 03:37:01.385809 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E1004 03:37:01.386042 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E1004 03:37:01.386394 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E1004 03:37:01.386628 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E1004 03:37:01.386934 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E1004 03:37:01.387159 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E1004 03:37:01.388475 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E1004 03:37:01.389234 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E1004 03:37:01.403709 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E1004 03:37:02.250814 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E1004 03:37:02.348236 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E1004 03:37:02.421426 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E1004 03:37:02.525122 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
I1004 03:37:02.969199 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [fd61154c785ee669b3a620fd034d912e5b6005c06a250bcf7606b989ca283b91] <==
I1004 03:40:00.394931 1 serving.go:331] Generated self-signed cert in-memory
W1004 03:40:07.808972 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W1004 03:40:07.809021 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W1004 03:40:07.809037 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W1004 03:40:07.809043 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1004 03:40:07.964779 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I1004 03:40:07.964887 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1004 03:40:07.964903 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1004 03:40:07.964917 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I1004 03:40:08.068507 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Oct 04 03:44:04 old-k8s-version-445570 kubelet[671]: E1004 03:44:04.337451 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
Oct 04 03:44:15 old-k8s-version-445570 kubelet[671]: I1004 03:44:15.337300 671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 541099ab654adffd4369c8a8d599dd601bc9f82430e011116576d472bc561bac
Oct 04 03:44:15 old-k8s-version-445570 kubelet[671]: E1004 03:44:15.338470 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 04 03:44:15 old-k8s-version-445570 kubelet[671]: E1004 03:44:15.338490 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
Oct 04 03:44:26 old-k8s-version-445570 kubelet[671]: E1004 03:44:26.338825 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 04 03:44:30 old-k8s-version-445570 kubelet[671]: I1004 03:44:30.337206 671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 541099ab654adffd4369c8a8d599dd601bc9f82430e011116576d472bc561bac
Oct 04 03:44:30 old-k8s-version-445570 kubelet[671]: E1004 03:44:30.337556 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
Oct 04 03:44:37 old-k8s-version-445570 kubelet[671]: E1004 03:44:37.337773 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 04 03:44:42 old-k8s-version-445570 kubelet[671]: I1004 03:44:42.337367 671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 541099ab654adffd4369c8a8d599dd601bc9f82430e011116576d472bc561bac
Oct 04 03:44:42 old-k8s-version-445570 kubelet[671]: E1004 03:44:42.337758 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
Oct 04 03:44:48 old-k8s-version-445570 kubelet[671]: E1004 03:44:48.337763 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 04 03:44:55 old-k8s-version-445570 kubelet[671]: I1004 03:44:55.340528 671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 541099ab654adffd4369c8a8d599dd601bc9f82430e011116576d472bc561bac
Oct 04 03:44:55 old-k8s-version-445570 kubelet[671]: E1004 03:44:55.342140 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
Oct 04 03:45:00 old-k8s-version-445570 kubelet[671]: E1004 03:45:00.338647 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 04 03:45:10 old-k8s-version-445570 kubelet[671]: I1004 03:45:10.337041 671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 541099ab654adffd4369c8a8d599dd601bc9f82430e011116576d472bc561bac
Oct 04 03:45:10 old-k8s-version-445570 kubelet[671]: E1004 03:45:10.337424 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
Oct 04 03:45:13 old-k8s-version-445570 kubelet[671]: E1004 03:45:13.337752 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 04 03:45:21 old-k8s-version-445570 kubelet[671]: I1004 03:45:21.337788 671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 541099ab654adffd4369c8a8d599dd601bc9f82430e011116576d472bc561bac
Oct 04 03:45:21 old-k8s-version-445570 kubelet[671]: E1004 03:45:21.338227 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
Oct 04 03:45:27 old-k8s-version-445570 kubelet[671]: E1004 03:45:27.339413 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 04 03:45:35 old-k8s-version-445570 kubelet[671]: I1004 03:45:35.337231 671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 541099ab654adffd4369c8a8d599dd601bc9f82430e011116576d472bc561bac
Oct 04 03:45:35 old-k8s-version-445570 kubelet[671]: E1004 03:45:35.337992 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
Oct 04 03:45:42 old-k8s-version-445570 kubelet[671]: E1004 03:45:42.338430 671 pod_workers.go:191] Error syncing pod 645bea79-708e-4fa4-b469-d493c518b4ac ("metrics-server-9975d5f86-7vbmk_kube-system(645bea79-708e-4fa4-b469-d493c518b4ac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 04 03:45:47 old-k8s-version-445570 kubelet[671]: I1004 03:45:47.337094 671 scope.go:95] [topologymanager] RemoveContainer - Container ID: 541099ab654adffd4369c8a8d599dd601bc9f82430e011116576d472bc561bac
Oct 04 03:45:47 old-k8s-version-445570 kubelet[671]: E1004 03:45:47.337464 671 pod_workers.go:191] Error syncing pod c3a92bfd-530b-4a7c-9e24-b8c20a20cdba ("dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-brtqr_kubernetes-dashboard(c3a92bfd-530b-4a7c-9e24-b8c20a20cdba)"
==> kubernetes-dashboard [e25a99d73dc123b7ad1337a13bac763678ba647ef7414e06362277eb1ceaf920] <==
2024/10/04 03:40:31 Using namespace: kubernetes-dashboard
2024/10/04 03:40:31 Using in-cluster config to connect to apiserver
2024/10/04 03:40:31 Using secret token for csrf signing
2024/10/04 03:40:31 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/10/04 03:40:31 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/10/04 03:40:31 Successful initial request to the apiserver, version: v1.20.0
2024/10/04 03:40:31 Generating JWE encryption key
2024/10/04 03:40:31 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/10/04 03:40:31 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/10/04 03:40:31 Initializing JWE encryption key from synchronized object
2024/10/04 03:40:31 Creating in-cluster Sidecar client
2024/10/04 03:40:31 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/04 03:40:31 Serving insecurely on HTTP port: 9090
2024/10/04 03:41:01 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/04 03:41:31 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/04 03:42:01 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/04 03:42:31 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/04 03:43:01 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/04 03:43:31 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/04 03:44:01 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/04 03:44:31 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/04 03:45:01 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/04 03:45:31 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/04 03:40:31 Starting overwatch
==> storage-provisioner [04caef5abf18eb64fc69564f2f195bf5c77f3dfcdbdf6c9a8ea68e37d9d094bf] <==
I1004 03:40:11.888341 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1004 03:40:11.911904 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1004 03:40:11.911974 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I1004 03:40:29.371797 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1004 03:40:29.371996 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-445570_3f5faf02-0708-4f45-8be9-0032a8c0f8b1!
I1004 03:40:29.381137 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"62c8eb01-4a4a-4bde-81f4-fdc0db4e0eaa", APIVersion:"v1", ResourceVersion:"798", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-445570_3f5faf02-0708-4f45-8be9-0032a8c0f8b1 became leader
I1004 03:40:29.472224 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-445570_3f5faf02-0708-4f45-8be9-0032a8c0f8b1!
==> storage-provisioner [b199a132a65232987bd2f9d36ca0edafd86724a43cd8b1d00bcce04f1b95be77] <==
I1004 03:37:22.561675 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1004 03:37:22.578344 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1004 03:37:22.578395 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I1004 03:37:22.590076 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1004 03:37:22.590267 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-445570_df75ff9a-585a-4488-a2d0-c93e68d8101d!
I1004 03:37:22.591036 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"62c8eb01-4a4a-4bde-81f4-fdc0db4e0eaa", APIVersion:"v1", ResourceVersion:"467", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-445570_df75ff9a-585a-4488-a2d0-c93e68d8101d became leader
I1004 03:37:22.691412 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-445570_df75ff9a-585a-4488-a2d0-c93e68d8101d!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-445570 -n old-k8s-version-445570
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-445570 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-7vbmk
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-445570 describe pod metrics-server-9975d5f86-7vbmk
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-445570 describe pod metrics-server-9975d5f86-7vbmk: exit status 1 (102.053526ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-7vbmk" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-445570 describe pod metrics-server-9975d5f86-7vbmk: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (372.72s)