=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-635133 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E0606 21:34:03.949765 285223 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/addons-246757/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-635133 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 80 (6m8.778846926s)
-- stdout --
* [old-k8s-version-635133] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19038
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19038-279835/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19038-279835/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.1
* Using the docker driver based on existing profile
* Starting "old-k8s-version-635133" primary control-plane node in "old-k8s-version-635133" cluster
* Pulling base image v0.0.44-1717668449-19038 ...
* Restarting existing docker container for "old-k8s-version-635133" ...
* Preparing Kubernetes v1.20.0 on containerd 1.6.33 ...
* Verifying Kubernetes components...
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-635133 addons enable metrics-server
* Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
-- /stdout --
** stderr **
I0606 21:33:57.315076 480289 out.go:291] Setting OutFile to fd 1 ...
I0606 21:33:57.315207 480289 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0606 21:33:57.315216 480289 out.go:304] Setting ErrFile to fd 2...
I0606 21:33:57.315221 480289 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0606 21:33:57.315470 480289 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19038-279835/.minikube/bin
I0606 21:33:57.315819 480289 out.go:298] Setting JSON to false
I0606 21:33:57.316766 480289 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":8181,"bootTime":1717701457,"procs":209,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0606 21:33:57.316834 480289 start.go:139] virtualization:
I0606 21:33:57.324771 480289 out.go:177] * [old-k8s-version-635133] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0606 21:33:57.327107 480289 out.go:177] - MINIKUBE_LOCATION=19038
I0606 21:33:57.329175 480289 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0606 21:33:57.327207 480289 notify.go:220] Checking for updates...
I0606 21:33:57.334081 480289 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19038-279835/kubeconfig
I0606 21:33:57.336523 480289 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19038-279835/.minikube
I0606 21:33:57.338875 480289 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0606 21:33:57.341526 480289 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0606 21:33:57.343375 480289 config.go:182] Loaded profile config "old-k8s-version-635133": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0606 21:33:57.345415 480289 out.go:177] * Kubernetes 1.30.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.1
I0606 21:33:57.347059 480289 driver.go:392] Setting default libvirt URI to qemu:///system
I0606 21:33:57.393215 480289 docker.go:122] docker version: linux-26.1.4:Docker Engine - Community
I0606 21:33:57.393359 480289 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0606 21:33:57.518861 480289 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:67 SystemTime:2024-06-06 21:33:57.503534978 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1062-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214982656 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d2d58213f83a351ca8f528a95fbd145f5654e957 Expected:d2d58213f83a351ca8f528a95fbd145f5654e957} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.1]] Warnings:<nil>}}
I0606 21:33:57.518969 480289 docker.go:295] overlay module found
I0606 21:33:57.520979 480289 out.go:177] * Using the docker driver based on existing profile
I0606 21:33:57.522667 480289 start.go:297] selected driver: docker
I0606 21:33:57.522683 480289 start.go:901] validating driver "docker" against &{Name:old-k8s-version-635133 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-635133 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0606 21:33:57.522803 480289 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0606 21:33:57.523469 480289 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0606 21:33:57.610566 480289 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:67 SystemTime:2024-06-06 21:33:57.600035351 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1062-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214982656 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d2d58213f83a351ca8f528a95fbd145f5654e957 Expected:d2d58213f83a351ca8f528a95fbd145f5654e957} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.1]] Warnings:<nil>}}
I0606 21:33:57.610907 480289 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0606 21:33:57.610973 480289 cni.go:84] Creating CNI manager for ""
I0606 21:33:57.610983 480289 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0606 21:33:57.611019 480289 start.go:340] cluster config:
{Name:old-k8s-version-635133 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-635133 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0606 21:33:57.613430 480289 out.go:177] * Starting "old-k8s-version-635133" primary control-plane node in "old-k8s-version-635133" cluster
I0606 21:33:57.615330 480289 cache.go:121] Beginning downloading kic base image for docker with containerd
I0606 21:33:57.617432 480289 out.go:177] * Pulling base image v0.0.44-1717668449-19038 ...
I0606 21:33:57.619032 480289 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0606 21:33:57.619088 480289 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19038-279835/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0606 21:33:57.619098 480289 cache.go:56] Caching tarball of preloaded images
I0606 21:33:57.619185 480289 preload.go:173] Found /home/jenkins/minikube-integration/19038-279835/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0606 21:33:57.619195 480289 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0606 21:33:57.619314 480289 profile.go:143] Saving config to /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/old-k8s-version-635133/config.json ...
I0606 21:33:57.619522 480289 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 in local docker daemon
I0606 21:33:57.649646 480289 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 in local docker daemon, skipping pull
I0606 21:33:57.649671 480289 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 exists in daemon, skipping load
I0606 21:33:57.649691 480289 cache.go:194] Successfully downloaded all kic artifacts
I0606 21:33:57.649734 480289 start.go:360] acquireMachinesLock for old-k8s-version-635133: {Name:mk5ccd1552e8305c8ad9604b0edf6e4ce1eb4b57 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0606 21:33:57.649802 480289 start.go:364] duration metric: took 44.275µs to acquireMachinesLock for "old-k8s-version-635133"
I0606 21:33:57.649821 480289 start.go:96] Skipping create...Using existing machine configuration
I0606 21:33:57.649827 480289 fix.go:54] fixHost starting:
I0606 21:33:57.650092 480289 cli_runner.go:164] Run: docker container inspect old-k8s-version-635133 --format={{.State.Status}}
I0606 21:33:57.691705 480289 fix.go:112] recreateIfNeeded on old-k8s-version-635133: state=Stopped err=<nil>
W0606 21:33:57.691732 480289 fix.go:138] unexpected machine state, will restart: <nil>
I0606 21:33:57.693974 480289 out.go:177] * Restarting existing docker container for "old-k8s-version-635133" ...
I0606 21:33:57.695441 480289 cli_runner.go:164] Run: docker start old-k8s-version-635133
I0606 21:33:58.137977 480289 cli_runner.go:164] Run: docker container inspect old-k8s-version-635133 --format={{.State.Status}}
I0606 21:33:58.171460 480289 kic.go:430] container "old-k8s-version-635133" state is running.
I0606 21:33:58.171855 480289 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-635133
I0606 21:33:58.202743 480289 profile.go:143] Saving config to /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/old-k8s-version-635133/config.json ...
I0606 21:33:58.202973 480289 machine.go:94] provisionDockerMachine start ...
I0606 21:33:58.203040 480289 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-635133
I0606 21:33:58.226833 480289 main.go:141] libmachine: Using SSH client type: native
I0606 21:33:58.227101 480289 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bb0] 0x3e5410 <nil> [] 0s} 127.0.0.1 33437 <nil> <nil>}
I0606 21:33:58.227116 480289 main.go:141] libmachine: About to run SSH command:
hostname
I0606 21:33:58.227731 480289 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:47518->127.0.0.1:33437: read: connection reset by peer
I0606 21:34:01.366224 480289 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-635133
I0606 21:34:01.366247 480289 ubuntu.go:169] provisioning hostname "old-k8s-version-635133"
I0606 21:34:01.366335 480289 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-635133
I0606 21:34:01.383033 480289 main.go:141] libmachine: Using SSH client type: native
I0606 21:34:01.383293 480289 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bb0] 0x3e5410 <nil> [] 0s} 127.0.0.1 33437 <nil> <nil>}
I0606 21:34:01.383311 480289 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-635133 && echo "old-k8s-version-635133" | sudo tee /etc/hostname
I0606 21:34:01.536584 480289 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-635133
I0606 21:34:01.536748 480289 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-635133
I0606 21:34:01.554116 480289 main.go:141] libmachine: Using SSH client type: native
I0606 21:34:01.554365 480289 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bb0] 0x3e5410 <nil> [] 0s} 127.0.0.1 33437 <nil> <nil>}
I0606 21:34:01.554382 480289 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-635133' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-635133/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-635133' | sudo tee -a /etc/hosts;
fi
fi
I0606 21:34:01.693620 480289 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0606 21:34:01.693663 480289 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19038-279835/.minikube CaCertPath:/home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19038-279835/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19038-279835/.minikube}
I0606 21:34:01.693706 480289 ubuntu.go:177] setting up certificates
I0606 21:34:01.693747 480289 provision.go:84] configureAuth start
I0606 21:34:01.693855 480289 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-635133
I0606 21:34:01.722548 480289 provision.go:143] copyHostCerts
I0606 21:34:01.722614 480289 exec_runner.go:144] found /home/jenkins/minikube-integration/19038-279835/.minikube/ca.pem, removing ...
I0606 21:34:01.722623 480289 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19038-279835/.minikube/ca.pem
I0606 21:34:01.722699 480289 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19038-279835/.minikube/ca.pem (1078 bytes)
I0606 21:34:01.722803 480289 exec_runner.go:144] found /home/jenkins/minikube-integration/19038-279835/.minikube/cert.pem, removing ...
I0606 21:34:01.722809 480289 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19038-279835/.minikube/cert.pem
I0606 21:34:01.722835 480289 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19038-279835/.minikube/cert.pem (1123 bytes)
I0606 21:34:01.722898 480289 exec_runner.go:144] found /home/jenkins/minikube-integration/19038-279835/.minikube/key.pem, removing ...
I0606 21:34:01.722903 480289 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19038-279835/.minikube/key.pem
I0606 21:34:01.722926 480289 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19038-279835/.minikube/key.pem (1675 bytes)
I0606 21:34:01.722980 480289 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19038-279835/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-635133 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-635133]
I0606 21:34:02.354310 480289 provision.go:177] copyRemoteCerts
I0606 21:34:02.354401 480289 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0606 21:34:02.354469 480289 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-635133
I0606 21:34:02.376952 480289 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33437 SSHKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/old-k8s-version-635133/id_rsa Username:docker}
I0606 21:34:02.475649 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0606 21:34:02.509374 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0606 21:34:02.537857 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0606 21:34:02.562588 480289 provision.go:87] duration metric: took 868.807902ms to configureAuth
I0606 21:34:02.562616 480289 ubuntu.go:193] setting minikube options for container-runtime
I0606 21:34:02.562875 480289 config.go:182] Loaded profile config "old-k8s-version-635133": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0606 21:34:02.562887 480289 machine.go:97] duration metric: took 4.359898857s to provisionDockerMachine
I0606 21:34:02.562895 480289 start.go:293] postStartSetup for "old-k8s-version-635133" (driver="docker")
I0606 21:34:02.562906 480289 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0606 21:34:02.562960 480289 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0606 21:34:02.563002 480289 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-635133
I0606 21:34:02.578668 480289 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33437 SSHKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/old-k8s-version-635133/id_rsa Username:docker}
I0606 21:34:02.675321 480289 ssh_runner.go:195] Run: cat /etc/os-release
I0606 21:34:02.678412 480289 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0606 21:34:02.678446 480289 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0606 21:34:02.678498 480289 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0606 21:34:02.678512 480289 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0606 21:34:02.678529 480289 filesync.go:126] Scanning /home/jenkins/minikube-integration/19038-279835/.minikube/addons for local assets ...
I0606 21:34:02.678592 480289 filesync.go:126] Scanning /home/jenkins/minikube-integration/19038-279835/.minikube/files for local assets ...
I0606 21:34:02.678672 480289 filesync.go:149] local asset: /home/jenkins/minikube-integration/19038-279835/.minikube/files/etc/ssl/certs/2852232.pem -> 2852232.pem in /etc/ssl/certs
I0606 21:34:02.678773 480289 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0606 21:34:02.687144 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/files/etc/ssl/certs/2852232.pem --> /etc/ssl/certs/2852232.pem (1708 bytes)
I0606 21:34:02.710929 480289 start.go:296] duration metric: took 148.018835ms for postStartSetup
I0606 21:34:02.711032 480289 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0606 21:34:02.711090 480289 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-635133
I0606 21:34:02.731553 480289 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33437 SSHKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/old-k8s-version-635133/id_rsa Username:docker}
I0606 21:34:02.823273 480289 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0606 21:34:02.828390 480289 fix.go:56] duration metric: took 5.178555944s for fixHost
I0606 21:34:02.828414 480289 start.go:83] releasing machines lock for "old-k8s-version-635133", held for 5.178604034s
I0606 21:34:02.828480 480289 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-635133
I0606 21:34:02.844300 480289 ssh_runner.go:195] Run: cat /version.json
I0606 21:34:02.844350 480289 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-635133
I0606 21:34:02.844586 480289 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0606 21:34:02.844633 480289 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-635133
I0606 21:34:02.867994 480289 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33437 SSHKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/old-k8s-version-635133/id_rsa Username:docker}
I0606 21:34:02.875778 480289 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33437 SSHKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/old-k8s-version-635133/id_rsa Username:docker}
I0606 21:34:03.087561 480289 ssh_runner.go:195] Run: systemctl --version
I0606 21:34:03.092119 480289 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0606 21:34:03.096652 480289 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0606 21:34:03.115105 480289 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0606 21:34:03.115180 480289 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0606 21:34:03.124229 480289 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0606 21:34:03.124255 480289 start.go:494] detecting cgroup driver to use...
I0606 21:34:03.124286 480289 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0606 21:34:03.124362 480289 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0606 21:34:03.137945 480289 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0606 21:34:03.149389 480289 docker.go:217] disabling cri-docker service (if available) ...
I0606 21:34:03.149471 480289 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0606 21:34:03.163134 480289 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0606 21:34:03.174836 480289 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0606 21:34:03.254625 480289 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0606 21:34:03.337237 480289 docker.go:233] disabling docker service ...
I0606 21:34:03.337333 480289 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0606 21:34:03.350426 480289 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0606 21:34:03.361719 480289 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0606 21:34:03.452703 480289 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0606 21:34:03.557610 480289 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0606 21:34:03.569344 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0606 21:34:03.585582 480289 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0606 21:34:03.595666 480289 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0606 21:34:03.605355 480289 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0606 21:34:03.605447 480289 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0606 21:34:03.615691 480289 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0606 21:34:03.625427 480289 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0606 21:34:03.635148 480289 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0606 21:34:03.644618 480289 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0606 21:34:03.653482 480289 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0606 21:34:03.663003 480289 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0606 21:34:03.672269 480289 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0606 21:34:03.680738 480289 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0606 21:34:03.772408 480289 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0606 21:34:03.989136 480289 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0606 21:34:03.989219 480289 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0606 21:34:03.993109 480289 start.go:562] Will wait 60s for crictl version
I0606 21:34:03.993170 480289 ssh_runner.go:195] Run: which crictl
I0606 21:34:03.999072 480289 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0606 21:34:04.051087 480289 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.33
RuntimeApiVersion: v1
I0606 21:34:04.051152 480289 ssh_runner.go:195] Run: containerd --version
I0606 21:34:04.076873 480289 ssh_runner.go:195] Run: containerd --version
I0606 21:34:04.104966 480289 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.6.33 ...
I0606 21:34:04.107209 480289 cli_runner.go:164] Run: docker network inspect old-k8s-version-635133 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0606 21:34:04.121622 480289 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0606 21:34:04.125107 480289 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0606 21:34:04.135745 480289 kubeadm.go:877] updating cluster {Name:old-k8s-version-635133 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-635133 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0606 21:34:04.135872 480289 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0606 21:34:04.135934 480289 ssh_runner.go:195] Run: sudo crictl images --output json
I0606 21:34:04.172107 480289 containerd.go:627] all images are preloaded for containerd runtime.
I0606 21:34:04.172129 480289 containerd.go:534] Images already preloaded, skipping extraction
I0606 21:34:04.172197 480289 ssh_runner.go:195] Run: sudo crictl images --output json
I0606 21:34:04.206871 480289 containerd.go:627] all images are preloaded for containerd runtime.
I0606 21:34:04.206895 480289 cache_images.go:84] Images are preloaded, skipping loading
I0606 21:34:04.206903 480289 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.20.0 containerd true true} ...
I0606 21:34:04.207017 480289 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-635133 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-635133 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0606 21:34:04.207082 480289 ssh_runner.go:195] Run: sudo crictl info
I0606 21:34:04.242355 480289 cni.go:84] Creating CNI manager for ""
I0606 21:34:04.242377 480289 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0606 21:34:04.242388 480289 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0606 21:34:04.242407 480289 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-635133 NodeName:old-k8s-version-635133 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0606 21:34:04.242573 480289 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-635133"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0606 21:34:04.242640 480289 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0606 21:34:04.251150 480289 binaries.go:44] Found k8s binaries, skipping transfer
I0606 21:34:04.251232 480289 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0606 21:34:04.259976 480289 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0606 21:34:04.277973 480289 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0606 21:34:04.300011 480289 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0606 21:34:04.319625 480289 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0606 21:34:04.323036 480289 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0606 21:34:04.333719 480289 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0606 21:34:04.422191 480289 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0606 21:34:04.439382 480289 certs.go:68] Setting up /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/old-k8s-version-635133 for IP: 192.168.85.2
I0606 21:34:04.439403 480289 certs.go:194] generating shared ca certs ...
I0606 21:34:04.439438 480289 certs.go:226] acquiring lock for ca certs: {Name:mkc759f49abe4f4f96b3e66fc6cad3282470b17e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0606 21:34:04.439595 480289 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19038-279835/.minikube/ca.key
I0606 21:34:04.439658 480289 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19038-279835/.minikube/proxy-client-ca.key
I0606 21:34:04.439673 480289 certs.go:256] generating profile certs ...
I0606 21:34:04.439781 480289 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/old-k8s-version-635133/client.key
I0606 21:34:04.439864 480289 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/old-k8s-version-635133/apiserver.key.cdd89efb
I0606 21:34:04.439933 480289 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/old-k8s-version-635133/proxy-client.key
I0606 21:34:04.440078 480289 certs.go:484] found cert: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/285223.pem (1338 bytes)
W0606 21:34:04.440131 480289 certs.go:480] ignoring /home/jenkins/minikube-integration/19038-279835/.minikube/certs/285223_empty.pem, impossibly tiny 0 bytes
I0606 21:34:04.440143 480289 certs.go:484] found cert: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca-key.pem (1679 bytes)
I0606 21:34:04.440170 480289 certs.go:484] found cert: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca.pem (1078 bytes)
I0606 21:34:04.440223 480289 certs.go:484] found cert: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/cert.pem (1123 bytes)
I0606 21:34:04.440253 480289 certs.go:484] found cert: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/key.pem (1675 bytes)
I0606 21:34:04.440315 480289 certs.go:484] found cert: /home/jenkins/minikube-integration/19038-279835/.minikube/files/etc/ssl/certs/2852232.pem (1708 bytes)
I0606 21:34:04.440991 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0606 21:34:04.535972 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0606 21:34:04.563390 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0606 21:34:04.592599 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0606 21:34:04.622948 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/old-k8s-version-635133/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0606 21:34:04.648614 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/old-k8s-version-635133/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0606 21:34:04.672966 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/old-k8s-version-635133/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0606 21:34:04.698128 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/old-k8s-version-635133/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0606 21:34:04.722706 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/files/etc/ssl/certs/2852232.pem --> /usr/share/ca-certificates/2852232.pem (1708 bytes)
I0606 21:34:04.746838 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0606 21:34:04.770282 480289 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/certs/285223.pem --> /usr/share/ca-certificates/285223.pem (1338 bytes)
I0606 21:34:04.793227 480289 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0606 21:34:04.809648 480289 ssh_runner.go:195] Run: openssl version
I0606 21:34:04.814798 480289 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/285223.pem && ln -fs /usr/share/ca-certificates/285223.pem /etc/ssl/certs/285223.pem"
I0606 21:34:04.823842 480289 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/285223.pem
I0606 21:34:04.827062 480289 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 6 20:54 /usr/share/ca-certificates/285223.pem
I0606 21:34:04.827163 480289 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/285223.pem
I0606 21:34:04.833887 480289 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/285223.pem /etc/ssl/certs/51391683.0"
I0606 21:34:04.843018 480289 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2852232.pem && ln -fs /usr/share/ca-certificates/2852232.pem /etc/ssl/certs/2852232.pem"
I0606 21:34:04.852317 480289 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2852232.pem
I0606 21:34:04.855793 480289 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 6 20:54 /usr/share/ca-certificates/2852232.pem
I0606 21:34:04.855857 480289 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2852232.pem
I0606 21:34:04.862788 480289 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/2852232.pem /etc/ssl/certs/3ec20f2e.0"
I0606 21:34:04.871688 480289 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0606 21:34:04.880810 480289 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0606 21:34:04.884374 480289 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 6 20:47 /usr/share/ca-certificates/minikubeCA.pem
I0606 21:34:04.884482 480289 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0606 21:34:04.891199 480289 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0606 21:34:04.899615 480289 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0606 21:34:04.902965 480289 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0606 21:34:04.909527 480289 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0606 21:34:04.916600 480289 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0606 21:34:04.927053 480289 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0606 21:34:04.937834 480289 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0606 21:34:04.945830 480289 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0606 21:34:04.953541 480289 kubeadm.go:391] StartCluster: {Name:old-k8s-version-635133 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-635133 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0606 21:34:04.953662 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0606 21:34:04.953781 480289 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0606 21:34:05.021090 480289 cri.go:89] found id: "3919c4ccc1d88147f87d6fc5f44cb29d25a5f18189bf2aa2b90d426614366965"
I0606 21:34:05.021175 480289 cri.go:89] found id: "77ca58fcab3e446b291be4f6754268bd76dc2fee93422a432640c65fdededbfc"
I0606 21:34:05.021196 480289 cri.go:89] found id: "988b3d43deecf64d1b76c87a6b2549293b95791fc4c680f5648c990beb49af24"
I0606 21:34:05.021214 480289 cri.go:89] found id: "cc7c81a5dd13471ff67e97eb9f31c6f9bf45a0f03ef825da4593fb36b1845b11"
I0606 21:34:05.021234 480289 cri.go:89] found id: "bee54e91e1fb25a822ac99adb4f1c0003ae7aaefa4107cf384d7143a74247580"
I0606 21:34:05.021261 480289 cri.go:89] found id: "36c683ec52ff63ae2e147bf5c0a21d1760c6a0a30b2b13be193810c032c53f64"
I0606 21:34:05.021282 480289 cri.go:89] found id: "3dc1c84feb8a29630e4de6f4eaaf57533c377c5e8e79a0c5e5f93e9f1b5efe09"
I0606 21:34:05.021299 480289 cri.go:89] found id: "52a1b7afe7153c756f497d76cdf3b2515aea9392d68afd3ffec265ed78e8a2d5"
I0606 21:34:05.021316 480289 cri.go:89] found id: "cc0c393556c3d6da8e41b24e8de1e4c2b58dce0feafdd92f3b8db91825500060"
I0606 21:34:05.021347 480289 cri.go:89] found id: ""
I0606 21:34:05.021420 480289 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0606 21:34:05.034973 480289 cri.go:116] JSON = null
W0606 21:34:05.035061 480289 kubeadm.go:398] unpause failed: list paused: list returned 0 containers, but ps returned 9
I0606 21:34:05.035140 480289 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0606 21:34:05.044317 480289 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0606 21:34:05.044339 480289 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0606 21:34:05.044345 480289 kubeadm.go:587] restartPrimaryControlPlane start ...
I0606 21:34:05.044422 480289 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0606 21:34:05.053715 480289 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0606 21:34:05.054178 480289 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-635133" does not appear in /home/jenkins/minikube-integration/19038-279835/kubeconfig
I0606 21:34:05.054291 480289 kubeconfig.go:62] /home/jenkins/minikube-integration/19038-279835/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-635133" cluster setting kubeconfig missing "old-k8s-version-635133" context setting]
I0606 21:34:05.054600 480289 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19038-279835/kubeconfig: {Name:mka5feb49a349ac20523d222b9261befd65ae27e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0606 21:34:05.056712 480289 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0606 21:34:05.068292 480289 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.85.2
I0606 21:34:05.068326 480289 kubeadm.go:591] duration metric: took 23.974908ms to restartPrimaryControlPlane
I0606 21:34:05.068336 480289 kubeadm.go:393] duration metric: took 114.8051ms to StartCluster
I0606 21:34:05.068351 480289 settings.go:142] acquiring lock: {Name:mk8f89aa1063a7c38223e46a53ac1cfd3f47d552 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0606 21:34:05.068412 480289 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19038-279835/kubeconfig
I0606 21:34:05.069072 480289 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19038-279835/kubeconfig: {Name:mka5feb49a349ac20523d222b9261befd65ae27e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0606 21:34:05.069275 480289 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0606 21:34:05.074641 480289 out.go:177] * Verifying Kubernetes components...
I0606 21:34:05.069576 480289 config.go:182] Loaded profile config "old-k8s-version-635133": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0606 21:34:05.069587 480289 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0606 21:34:05.077116 480289 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-635133"
I0606 21:34:05.077213 480289 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-635133"
W0606 21:34:05.077235 480289 addons.go:243] addon storage-provisioner should already be in state true
I0606 21:34:05.077249 480289 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-635133"
I0606 21:34:05.077294 480289 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-635133"
W0606 21:34:05.077306 480289 addons.go:243] addon metrics-server should already be in state true
I0606 21:34:05.077332 480289 host.go:66] Checking if "old-k8s-version-635133" exists ...
I0606 21:34:05.077243 480289 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-635133"
I0606 21:34:05.077381 480289 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-635133"
I0606 21:34:05.077661 480289 cli_runner.go:164] Run: docker container inspect old-k8s-version-635133 --format={{.State.Status}}
I0606 21:34:05.077744 480289 cli_runner.go:164] Run: docker container inspect old-k8s-version-635133 --format={{.State.Status}}
I0606 21:34:05.077333 480289 host.go:66] Checking if "old-k8s-version-635133" exists ...
I0606 21:34:05.077182 480289 addons.go:69] Setting dashboard=true in profile "old-k8s-version-635133"
I0606 21:34:05.078557 480289 addons.go:234] Setting addon dashboard=true in "old-k8s-version-635133"
W0606 21:34:05.078568 480289 addons.go:243] addon dashboard should already be in state true
I0606 21:34:05.078607 480289 host.go:66] Checking if "old-k8s-version-635133" exists ...
I0606 21:34:05.078970 480289 cli_runner.go:164] Run: docker container inspect old-k8s-version-635133 --format={{.State.Status}}
I0606 21:34:05.079337 480289 cli_runner.go:164] Run: docker container inspect old-k8s-version-635133 --format={{.State.Status}}
I0606 21:34:05.077171 480289 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0606 21:34:05.142885 480289 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0606 21:34:05.146529 480289 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0606 21:34:05.146560 480289 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0606 21:34:05.146639 480289 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-635133
I0606 21:34:05.149129 480289 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0606 21:34:05.142860 480289 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0606 21:34:05.151708 480289 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-635133"
W0606 21:34:05.151760 480289 addons.go:243] addon default-storageclass should already be in state true
I0606 21:34:05.151787 480289 host.go:66] Checking if "old-k8s-version-635133" exists ...
I0606 21:34:05.152212 480289 cli_runner.go:164] Run: docker container inspect old-k8s-version-635133 --format={{.State.Status}}
I0606 21:34:05.154352 480289 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0606 21:34:05.157297 480289 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0606 21:34:05.157318 480289 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0606 21:34:05.157382 480289 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-635133
I0606 21:34:05.157555 480289 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0606 21:34:05.157565 480289 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0606 21:34:05.157613 480289 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-635133
I0606 21:34:05.194692 480289 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0606 21:34:05.194713 480289 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0606 21:34:05.194778 480289 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-635133
I0606 21:34:05.200517 480289 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33437 SSHKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/old-k8s-version-635133/id_rsa Username:docker}
I0606 21:34:05.231545 480289 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33437 SSHKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/old-k8s-version-635133/id_rsa Username:docker}
I0606 21:34:05.235455 480289 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33437 SSHKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/old-k8s-version-635133/id_rsa Username:docker}
I0606 21:34:05.240426 480289 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0606 21:34:05.272203 480289 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33437 SSHKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/old-k8s-version-635133/id_rsa Username:docker}
I0606 21:34:05.280574 480289 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-635133" to be "Ready" ...
I0606 21:34:05.343728 480289 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0606 21:34:05.343747 480289 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0606 21:34:05.378286 480289 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0606 21:34:05.378350 480289 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0606 21:34:05.385962 480289 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0606 21:34:05.386040 480289 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0606 21:34:05.392820 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0606 21:34:05.415946 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0606 21:34:05.432786 480289 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0606 21:34:05.432961 480289 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0606 21:34:05.441397 480289 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0606 21:34:05.441477 480289 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0606 21:34:05.504311 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0606 21:34:05.527059 480289 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0606 21:34:05.527140 480289 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0606 21:34:05.593056 480289 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0606 21:34:05.593152 480289 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0606 21:34:05.660464 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:05.660512 480289 retry.go:31] will retry after 358.238363ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:05.677597 480289 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0606 21:34:05.677681 480289 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0606 21:34:05.698527 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:05.698566 480289 retry.go:31] will retry after 230.784048ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0606 21:34:05.699930 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:05.699967 480289 retry.go:31] will retry after 331.737744ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:05.714753 480289 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0606 21:34:05.714777 480289 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0606 21:34:05.732898 480289 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0606 21:34:05.732969 480289 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0606 21:34:05.750826 480289 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0606 21:34:05.750848 480289 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0606 21:34:05.768857 480289 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0606 21:34:05.768887 480289 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0606 21:34:05.786270 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0606 21:34:05.856375 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:05.856418 480289 retry.go:31] will retry after 281.06822ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:05.929713 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0606 21:34:06.019236 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0606 21:34:06.032906 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0606 21:34:06.051810 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:06.051892 480289 retry.go:31] will retry after 501.271203ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:06.138296 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0606 21:34:06.167277 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:06.167366 480289 retry.go:31] will retry after 314.896149ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0606 21:34:06.167456 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:06.167495 480289 retry.go:31] will retry after 222.209602ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0606 21:34:06.238752 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:06.238784 480289 retry.go:31] will retry after 250.062856ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:06.390603 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0606 21:34:06.483006 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0606 21:34:06.489600 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0606 21:34:06.508041 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:06.508074 480289 retry.go:31] will retry after 314.705621ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:06.553305 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0606 21:34:06.625182 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:06.625260 480289 retry.go:31] will retry after 392.749974ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0606 21:34:06.625309 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:06.625352 480289 retry.go:31] will retry after 529.986336ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0606 21:34:06.680856 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:06.680895 480289 retry.go:31] will retry after 599.033169ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:06.823757 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0606 21:34:06.905665 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:06.905700 480289 retry.go:31] will retry after 823.487798ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:07.019092 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0606 21:34:07.094650 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:07.094684 480289 retry.go:31] will retry after 732.277748ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:07.155873 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0606 21:34:07.228874 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:07.228907 480289 retry.go:31] will retry after 1.200620377s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:07.280288 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0606 21:34:07.281006 480289 node_ready.go:53] error getting node "old-k8s-version-635133": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-635133": dial tcp 192.168.85.2:8443: connect: connection refused
W0606 21:34:07.351670 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:07.351755 480289 retry.go:31] will retry after 986.988351ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:07.730086 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0606 21:34:07.805382 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:07.805416 480289 retry.go:31] will retry after 1.504645831s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:07.827570 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0606 21:34:07.899910 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:07.899942 480289 retry.go:31] will retry after 1.622637234s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:08.338989 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0606 21:34:08.408562 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:08.408594 480289 retry.go:31] will retry after 1.86683619s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:08.429719 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0606 21:34:08.530857 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:08.530887 480289 retry.go:31] will retry after 1.790365153s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:09.281363 480289 node_ready.go:53] error getting node "old-k8s-version-635133": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-635133": dial tcp 192.168.85.2:8443: connect: connection refused
I0606 21:34:09.310578 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0606 21:34:09.376926 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:09.377007 480289 retry.go:31] will retry after 1.576506313s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:09.523325 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0606 21:34:09.589664 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:09.589697 480289 retry.go:31] will retry after 2.136208867s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:10.275696 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0606 21:34:10.322304 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0606 21:34:10.358314 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:10.358342 480289 retry.go:31] will retry after 2.364650132s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0606 21:34:10.409350 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:10.409385 480289 retry.go:31] will retry after 1.443285372s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:10.954297 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0606 21:34:11.056827 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:11.056860 480289 retry.go:31] will retry after 3.523371429s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:11.281505 480289 node_ready.go:53] error getting node "old-k8s-version-635133": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-635133": dial tcp 192.168.85.2:8443: connect: connection refused
I0606 21:34:11.726763 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0606 21:34:11.808064 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:11.808092 480289 retry.go:31] will retry after 3.239803303s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:11.853293 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0606 21:34:11.962620 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:11.962648 480289 retry.go:31] will retry after 3.622006687s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:12.723937 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0606 21:34:12.797419 480289 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:12.797451 480289 retry.go:31] will retry after 4.223694125s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0606 21:34:13.781053 480289 node_ready.go:53] error getting node "old-k8s-version-635133": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-635133": dial tcp 192.168.85.2:8443: connect: connection refused
I0606 21:34:14.581037 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0606 21:34:15.048466 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0606 21:34:15.585463 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0606 21:34:17.022299 480289 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0606 21:34:23.646412 480289 node_ready.go:49] node "old-k8s-version-635133" has status "Ready":"True"
I0606 21:34:23.646436 480289 node_ready.go:38] duration metric: took 18.365824534s for node "old-k8s-version-635133" to be "Ready" ...
I0606 21:34:23.646447 480289 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0606 21:34:23.680320 480289 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-k84pg" in "kube-system" namespace to be "Ready" ...
I0606 21:34:24.063047 480289 pod_ready.go:92] pod "coredns-74ff55c5b-k84pg" in "kube-system" namespace has status "Ready":"True"
I0606 21:34:24.063075 480289 pod_ready.go:81] duration metric: took 382.70716ms for pod "coredns-74ff55c5b-k84pg" in "kube-system" namespace to be "Ready" ...
I0606 21:34:24.063087 480289 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-635133" in "kube-system" namespace to be "Ready" ...
I0606 21:34:24.091400 480289 pod_ready.go:92] pod "etcd-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"True"
I0606 21:34:24.091430 480289 pod_ready.go:81] duration metric: took 28.335031ms for pod "etcd-old-k8s-version-635133" in "kube-system" namespace to be "Ready" ...
I0606 21:34:24.091448 480289 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-635133" in "kube-system" namespace to be "Ready" ...
I0606 21:34:25.727358 480289 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (11.146278744s)
I0606 21:34:25.727401 480289 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-635133"
I0606 21:34:25.880455 480289 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (10.294949111s)
I0606 21:34:25.880530 480289 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (10.832024175s)
I0606 21:34:25.882548 480289 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-635133 addons enable metrics-server
I0606 21:34:25.912823 480289 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (8.890486286s)
I0606 21:34:25.923434 480289 out.go:177] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
I0606 21:34:25.925235 480289 addons.go:510] duration metric: took 20.85563917s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
I0606 21:34:26.099562 480289 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:34:28.598121 480289 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:34:31.098494 480289 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"True"
I0606 21:34:31.098520 480289 pod_ready.go:81] duration metric: took 7.007063433s for pod "kube-apiserver-old-k8s-version-635133" in "kube-system" namespace to be "Ready" ...
I0606 21:34:31.098532 480289 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace to be "Ready" ...
I0606 21:34:33.105570 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:34:35.605664 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:34:38.108919 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:34:40.606348 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:34:43.105531 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:34:45.108282 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:34:47.607648 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:34:50.112700 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:34:52.605703 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:34:55.105795 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:34:57.106035 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:34:59.117267 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:01.606345 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:03.608928 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:06.105414 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:08.604200 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:10.604665 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:13.105086 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:15.106522 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:17.606118 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:20.106346 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:22.605779 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:25.106525 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:27.604286 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:29.604453 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:31.605184 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:33.605399 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:36.105007 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:38.105349 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:40.110172 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:42.604980 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:45.111578 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:47.608076 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:50.105985 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:52.604947 480289 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:53.605061 480289 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"True"
I0606 21:35:53.605083 480289 pod_ready.go:81] duration metric: took 1m22.506544004s for pod "kube-controller-manager-old-k8s-version-635133" in "kube-system" namespace to be "Ready" ...
I0606 21:35:53.605094 480289 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-7wjhq" in "kube-system" namespace to be "Ready" ...
I0606 21:35:53.609756 480289 pod_ready.go:92] pod "kube-proxy-7wjhq" in "kube-system" namespace has status "Ready":"True"
I0606 21:35:53.609779 480289 pod_ready.go:81] duration metric: took 4.676814ms for pod "kube-proxy-7wjhq" in "kube-system" namespace to be "Ready" ...
I0606 21:35:53.609790 480289 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-635133" in "kube-system" namespace to be "Ready" ...
I0606 21:35:53.614844 480289 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-635133" in "kube-system" namespace has status "Ready":"True"
I0606 21:35:53.614870 480289 pod_ready.go:81] duration metric: took 5.073223ms for pod "kube-scheduler-old-k8s-version-635133" in "kube-system" namespace to be "Ready" ...
I0606 21:35:53.614881 480289 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace to be "Ready" ...
I0606 21:35:55.620957 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:35:57.621074 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:00.132478 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:02.621271 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:05.120942 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:07.121335 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:09.620539 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:11.620969 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:13.621441 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:15.621873 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:18.120908 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:20.121806 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:22.620906 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:24.623092 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:27.122247 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:29.620734 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:31.621287 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:33.621692 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:36.120912 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:38.121072 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:40.121491 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:42.123302 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:44.627632 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:47.121153 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:49.620934 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:51.622627 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:53.623991 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:56.120766 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:36:58.121589 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:00.191351 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:02.620807 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:04.723862 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:07.121502 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:09.122272 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:11.620369 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:13.624645 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:16.121529 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:18.621223 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:21.120895 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:23.121468 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:25.620882 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:27.621882 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:30.122772 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:32.621117 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:34.621321 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:37.120572 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:39.122427 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:41.123873 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:43.620685 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:45.621260 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:48.120285 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:50.120619 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:52.122837 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:54.627318 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:57.121323 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:37:59.121620 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:01.621008 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:04.121162 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:06.620661 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:09.122113 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:11.621408 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:14.121672 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:16.620999 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:19.120763 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:21.120830 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:23.120883 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:25.122220 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:27.621121 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:30.121613 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:32.620385 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:34.620945 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:36.621567 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:39.121521 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:41.620740 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:43.621245 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:45.621275 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:48.121256 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:50.122199 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:52.623845 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:55.121879 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:38:57.621745 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:00.125668 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:02.620515 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:05.121992 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:07.621213 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:10.122246 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:12.620949 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:14.621192 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:16.621980 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:19.121576 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:21.620227 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:23.620728 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:26.121596 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:28.620496 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:30.622867 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:33.122111 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:35.637860 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:38.123000 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:40.621364 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:42.622132 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:45.124514 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:47.623282 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:50.121122 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:52.124050 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:53.624381 480289 pod_ready.go:81] duration metric: took 4m0.00948461s for pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace to be "Ready" ...
E0606 21:39:53.624406 480289 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0606 21:39:53.624420 480289 pod_ready.go:38] duration metric: took 5m29.977947311s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0606 21:39:53.624433 480289 api_server.go:52] waiting for apiserver process to appear ...
I0606 21:39:53.624461 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0606 21:39:53.624541 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0606 21:39:53.684252 480289 cri.go:89] found id: "d92e466d4ff93db5deca41ec84d1bf7a858dcb1ce897d06575ffb06ff7a02646"
I0606 21:39:53.684284 480289 cri.go:89] found id: "3dc1c84feb8a29630e4de6f4eaaf57533c377c5e8e79a0c5e5f93e9f1b5efe09"
I0606 21:39:53.684289 480289 cri.go:89] found id: ""
I0606 21:39:53.684297 480289 logs.go:276] 2 containers: [d92e466d4ff93db5deca41ec84d1bf7a858dcb1ce897d06575ffb06ff7a02646 3dc1c84feb8a29630e4de6f4eaaf57533c377c5e8e79a0c5e5f93e9f1b5efe09]
I0606 21:39:53.684349 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.690020 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.694358 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0606 21:39:53.694471 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0606 21:39:53.754259 480289 cri.go:89] found id: "c29c288b6359fcd41bdf8a354f2e6e05fed74207851ef2e0ffa67bb314ae8d97"
I0606 21:39:53.754288 480289 cri.go:89] found id: "36c683ec52ff63ae2e147bf5c0a21d1760c6a0a30b2b13be193810c032c53f64"
I0606 21:39:53.754293 480289 cri.go:89] found id: ""
I0606 21:39:53.754311 480289 logs.go:276] 2 containers: [c29c288b6359fcd41bdf8a354f2e6e05fed74207851ef2e0ffa67bb314ae8d97 36c683ec52ff63ae2e147bf5c0a21d1760c6a0a30b2b13be193810c032c53f64]
I0606 21:39:53.754379 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.759346 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.764148 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0606 21:39:53.764249 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0606 21:39:53.833615 480289 cri.go:89] found id: "e55f208de822b91f62dda76170dbc6e8bb26fdbfb117d19eb64f22bd0d14ab55"
I0606 21:39:53.833654 480289 cri.go:89] found id: "77ca58fcab3e446b291be4f6754268bd76dc2fee93422a432640c65fdededbfc"
I0606 21:39:53.833660 480289 cri.go:89] found id: ""
I0606 21:39:53.833667 480289 logs.go:276] 2 containers: [e55f208de822b91f62dda76170dbc6e8bb26fdbfb117d19eb64f22bd0d14ab55 77ca58fcab3e446b291be4f6754268bd76dc2fee93422a432640c65fdededbfc]
I0606 21:39:53.833751 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.840546 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.844055 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0606 21:39:53.844159 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0606 21:39:53.923206 480289 cri.go:89] found id: "17ca7fba4a93bd767c4b56ec20b283ba33353ff205a9275aa8211ba3ebcf8d7b"
I0606 21:39:53.923234 480289 cri.go:89] found id: "cc0c393556c3d6da8e41b24e8de1e4c2b58dce0feafdd92f3b8db91825500060"
I0606 21:39:53.923239 480289 cri.go:89] found id: ""
I0606 21:39:53.923246 480289 logs.go:276] 2 containers: [17ca7fba4a93bd767c4b56ec20b283ba33353ff205a9275aa8211ba3ebcf8d7b cc0c393556c3d6da8e41b24e8de1e4c2b58dce0feafdd92f3b8db91825500060]
I0606 21:39:53.923344 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.930946 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.936853 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0606 21:39:53.936952 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0606 21:39:54.029021 480289 cri.go:89] found id: "61364cca06a11106b4dcdbc01c72349914e26bf7dc1c81e5a8387007830c6bdb"
I0606 21:39:54.029045 480289 cri.go:89] found id: "bee54e91e1fb25a822ac99adb4f1c0003ae7aaefa4107cf384d7143a74247580"
I0606 21:39:54.029051 480289 cri.go:89] found id: ""
I0606 21:39:54.029061 480289 logs.go:276] 2 containers: [61364cca06a11106b4dcdbc01c72349914e26bf7dc1c81e5a8387007830c6bdb bee54e91e1fb25a822ac99adb4f1c0003ae7aaefa4107cf384d7143a74247580]
I0606 21:39:54.029149 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.035889 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.042391 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0606 21:39:54.042554 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0606 21:39:54.107479 480289 cri.go:89] found id: "95c850c794fedde40e049f91f9d0e75abf2d7d82c91b38c39e991dd5e3b8af49"
I0606 21:39:54.107508 480289 cri.go:89] found id: "52a1b7afe7153c756f497d76cdf3b2515aea9392d68afd3ffec265ed78e8a2d5"
I0606 21:39:54.107514 480289 cri.go:89] found id: ""
I0606 21:39:54.107536 480289 logs.go:276] 2 containers: [95c850c794fedde40e049f91f9d0e75abf2d7d82c91b38c39e991dd5e3b8af49 52a1b7afe7153c756f497d76cdf3b2515aea9392d68afd3ffec265ed78e8a2d5]
I0606 21:39:54.107605 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.113407 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.118592 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0606 21:39:54.118776 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0606 21:39:54.181856 480289 cri.go:89] found id: "2dac5b249cb881732b5741ed39817b7c23b3f4df26b536557815b70abf3e1d6b"
I0606 21:39:54.181949 480289 cri.go:89] found id: "988b3d43deecf64d1b76c87a6b2549293b95791fc4c680f5648c990beb49af24"
I0606 21:39:54.181968 480289 cri.go:89] found id: ""
I0606 21:39:54.181999 480289 logs.go:276] 2 containers: [2dac5b249cb881732b5741ed39817b7c23b3f4df26b536557815b70abf3e1d6b 988b3d43deecf64d1b76c87a6b2549293b95791fc4c680f5648c990beb49af24]
I0606 21:39:54.182125 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.187147 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.192155 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0606 21:39:54.192293 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0606 21:39:54.253744 480289 cri.go:89] found id: "f8800ceac902950a4fea28153008bc5a3a52171eb8f28a7e5c4b7b3c9727b18b"
I0606 21:39:54.253831 480289 cri.go:89] found id: ""
I0606 21:39:54.253854 480289 logs.go:276] 1 containers: [f8800ceac902950a4fea28153008bc5a3a52171eb8f28a7e5c4b7b3c9727b18b]
I0606 21:39:54.253963 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.258563 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0606 21:39:54.258731 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0606 21:39:54.323175 480289 cri.go:89] found id: "802abe80141bb9cd9e88dcb018e0323b18eaaa57079e90e1dc9a942c85f05355"
I0606 21:39:54.323248 480289 cri.go:89] found id: "19aaaaf394190c60194c94cf96c5f7a3d7ed7868bf9470d83ccd49ceeb94b496"
I0606 21:39:54.323268 480289 cri.go:89] found id: ""
I0606 21:39:54.323288 480289 logs.go:276] 2 containers: [802abe80141bb9cd9e88dcb018e0323b18eaaa57079e90e1dc9a942c85f05355 19aaaaf394190c60194c94cf96c5f7a3d7ed7868bf9470d83ccd49ceeb94b496]
I0606 21:39:54.323387 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.329403 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.336888 480289 logs.go:123] Gathering logs for kubelet ...
I0606 21:39:54.336970 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0606 21:39:54.417179 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:25 old-k8s-version-635133 kubelet[665]: E0606 21:34:25.288944 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0606 21:39:54.417402 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:25 old-k8s-version-635133 kubelet[665]: E0606 21:34:25.505444 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.420288 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:38 old-k8s-version-635133 kubelet[665]: E0606 21:34:38.133050 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0606 21:39:54.422433 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:47 old-k8s-version-635133 kubelet[665]: E0606 21:34:47.615284 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.426848 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:48 old-k8s-version-635133 kubelet[665]: E0606 21:34:48.618275 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.427233 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:52 old-k8s-version-635133 kubelet[665]: E0606 21:34:52.239024 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.427440 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:53 old-k8s-version-635133 kubelet[665]: E0606 21:34:53.127032 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.428233 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:56 old-k8s-version-635133 kubelet[665]: E0606 21:34:56.647302 665 pod_workers.go:191] Error syncing pod c63c8f50-421c-482f-92bc-d85adc05f868 ("storage-provisioner_kube-system(c63c8f50-421c-482f-92bc-d85adc05f868)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(c63c8f50-421c-482f-92bc-d85adc05f868)"
W0606 21:39:54.431217 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:05 old-k8s-version-635133 kubelet[665]: E0606 21:35:05.158334 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0606 21:39:54.431760 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:05 old-k8s-version-635133 kubelet[665]: E0606 21:35:05.663396 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.432219 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:12 old-k8s-version-635133 kubelet[665]: E0606 21:35:12.235777 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.432413 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:18 old-k8s-version-635133 kubelet[665]: E0606 21:35:18.126778 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.432737 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:23 old-k8s-version-635133 kubelet[665]: E0606 21:35:23.128320 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.432923 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:31 old-k8s-version-635133 kubelet[665]: E0606 21:35:31.138734 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.433504 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:38 old-k8s-version-635133 kubelet[665]: E0606 21:35:38.731622 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.433684 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:42 old-k8s-version-635133 kubelet[665]: E0606 21:35:42.126805 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.434006 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:42 old-k8s-version-635133 kubelet[665]: E0606 21:35:42.235385 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.436456 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:53 old-k8s-version-635133 kubelet[665]: E0606 21:35:53.138355 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0606 21:39:54.436781 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:56 old-k8s-version-635133 kubelet[665]: E0606 21:35:56.125964 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.436962 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:04 old-k8s-version-635133 kubelet[665]: E0606 21:36:04.126648 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.437284 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:08 old-k8s-version-635133 kubelet[665]: E0606 21:36:08.126063 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.437464 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:15 old-k8s-version-635133 kubelet[665]: E0606 21:36:15.136574 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.438049 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:21 old-k8s-version-635133 kubelet[665]: E0606 21:36:21.817649 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.438373 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:22 old-k8s-version-635133 kubelet[665]: E0606 21:36:22.820427 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.442666 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:28 old-k8s-version-635133 kubelet[665]: E0606 21:36:28.126190 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.443038 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:36 old-k8s-version-635133 kubelet[665]: E0606 21:36:36.126087 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.443245 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:43 old-k8s-version-635133 kubelet[665]: E0606 21:36:43.133902 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.443595 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:48 old-k8s-version-635133 kubelet[665]: E0606 21:36:48.126041 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.443800 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:58 old-k8s-version-635133 kubelet[665]: E0606 21:36:58.126341 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.444158 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:02 old-k8s-version-635133 kubelet[665]: E0606 21:37:02.126150 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.444362 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:09 old-k8s-version-635133 kubelet[665]: E0606 21:37:09.126426 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.444714 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:17 old-k8s-version-635133 kubelet[665]: E0606 21:37:17.126552 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.447402 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:21 old-k8s-version-635133 kubelet[665]: E0606 21:37:21.135241 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0606 21:39:54.447798 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:31 old-k8s-version-635133 kubelet[665]: E0606 21:37:31.125964 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.448044 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:35 old-k8s-version-635133 kubelet[665]: E0606 21:37:35.126779 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.448982 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:43 old-k8s-version-635133 kubelet[665]: E0606 21:37:43.971305 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.449378 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:47 old-k8s-version-635133 kubelet[665]: E0606 21:37:47.127768 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.449738 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:52 old-k8s-version-635133 kubelet[665]: E0606 21:37:52.235958 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.449944 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:00 old-k8s-version-635133 kubelet[665]: E0606 21:38:00.129638 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.450302 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:03 old-k8s-version-635133 kubelet[665]: E0606 21:38:03.129877 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.450519 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:14 old-k8s-version-635133 kubelet[665]: E0606 21:38:14.126311 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.451121 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:17 old-k8s-version-635133 kubelet[665]: E0606 21:38:17.126684 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.451338 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:29 old-k8s-version-635133 kubelet[665]: E0606 21:38:29.129822 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.451688 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:32 old-k8s-version-635133 kubelet[665]: E0606 21:38:32.125998 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.451908 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:42 old-k8s-version-635133 kubelet[665]: E0606 21:38:42.127143 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.452254 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:44 old-k8s-version-635133 kubelet[665]: E0606 21:38:44.126008 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.452459 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:53 old-k8s-version-635133 kubelet[665]: E0606 21:38:53.127225 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.452816 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:58 old-k8s-version-635133 kubelet[665]: E0606 21:38:58.126016 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.453005 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:06 old-k8s-version-635133 kubelet[665]: E0606 21:39:06.126631 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.453383 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:09 old-k8s-version-635133 kubelet[665]: E0606 21:39:09.135005 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.453573 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:18 old-k8s-version-635133 kubelet[665]: E0606 21:39:18.126566 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.453907 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:20 old-k8s-version-635133 kubelet[665]: E0606 21:39:20.127031 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.454096 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:30 old-k8s-version-635133 kubelet[665]: E0606 21:39:30.126719 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.454424 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:33 old-k8s-version-635133 kubelet[665]: E0606 21:39:33.126559 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.454637 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:44 old-k8s-version-635133 kubelet[665]: E0606 21:39:44.126752 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.455006 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:46 old-k8s-version-635133 kubelet[665]: E0606 21:39:46.127359 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
I0606 21:39:54.455020 480289 logs.go:123] Gathering logs for describe nodes ...
I0606 21:39:54.455046 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0606 21:39:54.653019 480289 logs.go:123] Gathering logs for kindnet [2dac5b249cb881732b5741ed39817b7c23b3f4df26b536557815b70abf3e1d6b] ...
I0606 21:39:54.653051 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2dac5b249cb881732b5741ed39817b7c23b3f4df26b536557815b70abf3e1d6b"
I0606 21:39:54.711514 480289 logs.go:123] Gathering logs for kubernetes-dashboard [f8800ceac902950a4fea28153008bc5a3a52171eb8f28a7e5c4b7b3c9727b18b] ...
I0606 21:39:54.711589 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f8800ceac902950a4fea28153008bc5a3a52171eb8f28a7e5c4b7b3c9727b18b"
I0606 21:39:54.760669 480289 logs.go:123] Gathering logs for storage-provisioner [802abe80141bb9cd9e88dcb018e0323b18eaaa57079e90e1dc9a942c85f05355] ...
I0606 21:39:54.760742 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 802abe80141bb9cd9e88dcb018e0323b18eaaa57079e90e1dc9a942c85f05355"
I0606 21:39:54.816319 480289 logs.go:123] Gathering logs for container status ...
I0606 21:39:54.816389 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0606 21:39:54.921026 480289 logs.go:123] Gathering logs for etcd [36c683ec52ff63ae2e147bf5c0a21d1760c6a0a30b2b13be193810c032c53f64] ...
I0606 21:39:54.921108 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 36c683ec52ff63ae2e147bf5c0a21d1760c6a0a30b2b13be193810c032c53f64"
I0606 21:39:54.988960 480289 logs.go:123] Gathering logs for coredns [77ca58fcab3e446b291be4f6754268bd76dc2fee93422a432640c65fdededbfc] ...
I0606 21:39:54.989032 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 77ca58fcab3e446b291be4f6754268bd76dc2fee93422a432640c65fdededbfc"
I0606 21:39:55.039920 480289 logs.go:123] Gathering logs for kube-proxy [61364cca06a11106b4dcdbc01c72349914e26bf7dc1c81e5a8387007830c6bdb] ...
I0606 21:39:55.039993 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 61364cca06a11106b4dcdbc01c72349914e26bf7dc1c81e5a8387007830c6bdb"
I0606 21:39:55.088587 480289 logs.go:123] Gathering logs for kube-proxy [bee54e91e1fb25a822ac99adb4f1c0003ae7aaefa4107cf384d7143a74247580] ...
I0606 21:39:55.088663 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bee54e91e1fb25a822ac99adb4f1c0003ae7aaefa4107cf384d7143a74247580"
I0606 21:39:55.151433 480289 logs.go:123] Gathering logs for kube-controller-manager [95c850c794fedde40e049f91f9d0e75abf2d7d82c91b38c39e991dd5e3b8af49] ...
I0606 21:39:55.151509 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 95c850c794fedde40e049f91f9d0e75abf2d7d82c91b38c39e991dd5e3b8af49"
I0606 21:39:55.224840 480289 logs.go:123] Gathering logs for kube-controller-manager [52a1b7afe7153c756f497d76cdf3b2515aea9392d68afd3ffec265ed78e8a2d5] ...
I0606 21:39:55.224911 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 52a1b7afe7153c756f497d76cdf3b2515aea9392d68afd3ffec265ed78e8a2d5"
I0606 21:39:55.385698 480289 logs.go:123] Gathering logs for kindnet [988b3d43deecf64d1b76c87a6b2549293b95791fc4c680f5648c990beb49af24] ...
I0606 21:39:55.385773 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 988b3d43deecf64d1b76c87a6b2549293b95791fc4c680f5648c990beb49af24"
I0606 21:39:55.458695 480289 logs.go:123] Gathering logs for dmesg ...
I0606 21:39:55.458765 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0606 21:39:55.481741 480289 logs.go:123] Gathering logs for kube-apiserver [d92e466d4ff93db5deca41ec84d1bf7a858dcb1ce897d06575ffb06ff7a02646] ...
I0606 21:39:55.481814 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d92e466d4ff93db5deca41ec84d1bf7a858dcb1ce897d06575ffb06ff7a02646"
I0606 21:39:55.553346 480289 logs.go:123] Gathering logs for coredns [e55f208de822b91f62dda76170dbc6e8bb26fdbfb117d19eb64f22bd0d14ab55] ...
I0606 21:39:55.553419 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e55f208de822b91f62dda76170dbc6e8bb26fdbfb117d19eb64f22bd0d14ab55"
I0606 21:39:55.610369 480289 logs.go:123] Gathering logs for kube-scheduler [cc0c393556c3d6da8e41b24e8de1e4c2b58dce0feafdd92f3b8db91825500060] ...
I0606 21:39:55.610440 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cc0c393556c3d6da8e41b24e8de1e4c2b58dce0feafdd92f3b8db91825500060"
I0606 21:39:55.666342 480289 logs.go:123] Gathering logs for storage-provisioner [19aaaaf394190c60194c94cf96c5f7a3d7ed7868bf9470d83ccd49ceeb94b496] ...
I0606 21:39:55.666417 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 19aaaaf394190c60194c94cf96c5f7a3d7ed7868bf9470d83ccd49ceeb94b496"
I0606 21:39:55.716641 480289 logs.go:123] Gathering logs for kube-apiserver [3dc1c84feb8a29630e4de6f4eaaf57533c377c5e8e79a0c5e5f93e9f1b5efe09] ...
I0606 21:39:55.716664 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3dc1c84feb8a29630e4de6f4eaaf57533c377c5e8e79a0c5e5f93e9f1b5efe09"
I0606 21:39:55.793626 480289 logs.go:123] Gathering logs for etcd [c29c288b6359fcd41bdf8a354f2e6e05fed74207851ef2e0ffa67bb314ae8d97] ...
I0606 21:39:55.793659 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c29c288b6359fcd41bdf8a354f2e6e05fed74207851ef2e0ffa67bb314ae8d97"
I0606 21:39:55.857600 480289 logs.go:123] Gathering logs for kube-scheduler [17ca7fba4a93bd767c4b56ec20b283ba33353ff205a9275aa8211ba3ebcf8d7b] ...
I0606 21:39:55.857675 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 17ca7fba4a93bd767c4b56ec20b283ba33353ff205a9275aa8211ba3ebcf8d7b"
I0606 21:39:55.906016 480289 logs.go:123] Gathering logs for containerd ...
I0606 21:39:55.906088 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0606 21:39:55.972112 480289 out.go:304] Setting ErrFile to fd 2...
I0606 21:39:55.972181 480289 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0606 21:39:55.972264 480289 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0606 21:39:55.972390 480289 out.go:239] Jun 06 21:39:20 old-k8s-version-635133 kubelet[665]: E0606 21:39:20.127031 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
Jun 06 21:39:20 old-k8s-version-635133 kubelet[665]: E0606 21:39:20.127031 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:55.972465 480289 out.go:239] Jun 06 21:39:30 old-k8s-version-635133 kubelet[665]: E0606 21:39:30.126719 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 06 21:39:30 old-k8s-version-635133 kubelet[665]: E0606 21:39:30.126719 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:55.972501 480289 out.go:239] Jun 06 21:39:33 old-k8s-version-635133 kubelet[665]: E0606 21:39:33.126559 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
Jun 06 21:39:33 old-k8s-version-635133 kubelet[665]: E0606 21:39:33.126559 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:55.972530 480289 out.go:239] Jun 06 21:39:44 old-k8s-version-635133 kubelet[665]: E0606 21:39:44.126752 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 06 21:39:44 old-k8s-version-635133 kubelet[665]: E0606 21:39:44.126752 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:55.972569 480289 out.go:239] Jun 06 21:39:46 old-k8s-version-635133 kubelet[665]: E0606 21:39:46.127359 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
Jun 06 21:39:46 old-k8s-version-635133 kubelet[665]: E0606 21:39:46.127359 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
I0606 21:39:55.972603 480289 out.go:304] Setting ErrFile to fd 2...
I0606 21:39:55.972623 480289 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0606 21:40:05.973906 480289 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0606 21:40:05.990738 480289 api_server.go:72] duration metric: took 6m0.921423886s to wait for apiserver process to appear ...
I0606 21:40:05.990759 480289 api_server.go:88] waiting for apiserver healthz status ...
I0606 21:40:05.993081 480289 out.go:177]
W0606 21:40:05.996206 480289 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W0606 21:40:05.996227 480289 out.go:239] *
*
W0606 21:40:05.997460 480289 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0606 21:40:06.002151 480289 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-635133 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-635133
helpers_test.go:235: (dbg) docker inspect old-k8s-version-635133:
-- stdout --
[
{
"Id": "0469a357db1e55053a2168b9686b9023c0b5f6469e34520252eb07fcca924e3b",
"Created": "2024-06-06T21:30:44.864399974Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 480470,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-06-06T21:33:58.127429377Z",
"FinishedAt": "2024-06-06T21:33:56.636080035Z"
},
"Image": "sha256:0447b96cd6875a02bcdf1fe363fc82b8e67a939ccbaf5e1ea3a43529d9e8a477",
"ResolvConfPath": "/var/lib/docker/containers/0469a357db1e55053a2168b9686b9023c0b5f6469e34520252eb07fcca924e3b/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/0469a357db1e55053a2168b9686b9023c0b5f6469e34520252eb07fcca924e3b/hostname",
"HostsPath": "/var/lib/docker/containers/0469a357db1e55053a2168b9686b9023c0b5f6469e34520252eb07fcca924e3b/hosts",
"LogPath": "/var/lib/docker/containers/0469a357db1e55053a2168b9686b9023c0b5f6469e34520252eb07fcca924e3b/0469a357db1e55053a2168b9686b9023c0b5f6469e34520252eb07fcca924e3b-json.log",
"Name": "/old-k8s-version-635133",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-635133:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-635133",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/4521dbb92ca089eafaf7f1953f82a2fc651e917db24e9d41756561c62c27193c-init/diff:/var/lib/docker/overlay2/c6222deded2f09a89f9f3dacff145d1e450da4c9a3c1f0b1ba9465ebfa2af3f5/diff",
"MergedDir": "/var/lib/docker/overlay2/4521dbb92ca089eafaf7f1953f82a2fc651e917db24e9d41756561c62c27193c/merged",
"UpperDir": "/var/lib/docker/overlay2/4521dbb92ca089eafaf7f1953f82a2fc651e917db24e9d41756561c62c27193c/diff",
"WorkDir": "/var/lib/docker/overlay2/4521dbb92ca089eafaf7f1953f82a2fc651e917db24e9d41756561c62c27193c/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-635133",
"Source": "/var/lib/docker/volumes/old-k8s-version-635133/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-635133",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-635133",
"name.minikube.sigs.k8s.io": "old-k8s-version-635133",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "26f0b58120fff34792a696a856436bb913afa04dadab74e23921f29f5fb2631b",
"SandboxKey": "/var/run/docker/netns/26f0b58120ff",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33437"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33436"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33433"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33435"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33434"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-635133": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:55:02",
"NetworkID": "3858d44903bd9e275f0c8949a88fe1788c3837c135eb76a4b9ccbe82331b0b5d",
"EndpointID": "bf2c8f12ee1f6e418c32cede1a7f25716bb1c97c54d490830259d06034b6537f",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-635133",
"0469a357db1e"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-635133 -n old-k8s-version-635133
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-635133 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-635133 logs -n 25: (2.093531853s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| start | -p cert-expiration-814742 | cert-expiration-814742 | jenkins | v1.33.1 | 06 Jun 24 21:29 UTC | 06 Jun 24 21:30 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-797841 | force-systemd-env-797841 | jenkins | v1.33.1 | 06 Jun 24 21:29 UTC | 06 Jun 24 21:29 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-797841 | force-systemd-env-797841 | jenkins | v1.33.1 | 06 Jun 24 21:29 UTC | 06 Jun 24 21:29 UTC |
| start | -p cert-options-667396 | cert-options-667396 | jenkins | v1.33.1 | 06 Jun 24 21:29 UTC | 06 Jun 24 21:30 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-667396 ssh | cert-options-667396 | jenkins | v1.33.1 | 06 Jun 24 21:30 UTC | 06 Jun 24 21:30 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-667396 -- sudo | cert-options-667396 | jenkins | v1.33.1 | 06 Jun 24 21:30 UTC | 06 Jun 24 21:30 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-667396 | cert-options-667396 | jenkins | v1.33.1 | 06 Jun 24 21:30 UTC | 06 Jun 24 21:30 UTC |
| start | -p old-k8s-version-635133 | old-k8s-version-635133 | jenkins | v1.33.1 | 06 Jun 24 21:30 UTC | 06 Jun 24 21:33 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-814742 | cert-expiration-814742 | jenkins | v1.33.1 | 06 Jun 24 21:33 UTC | 06 Jun 24 21:33 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-814742 | cert-expiration-814742 | jenkins | v1.33.1 | 06 Jun 24 21:33 UTC | 06 Jun 24 21:33 UTC |
| start | -p no-preload-259770 | no-preload-259770 | jenkins | v1.33.1 | 06 Jun 24 21:33 UTC | 06 Jun 24 21:34 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
| addons | enable metrics-server -p old-k8s-version-635133 | old-k8s-version-635133 | jenkins | v1.33.1 | 06 Jun 24 21:33 UTC | 06 Jun 24 21:33 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-635133 | old-k8s-version-635133 | jenkins | v1.33.1 | 06 Jun 24 21:33 UTC | 06 Jun 24 21:33 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-635133 | old-k8s-version-635133 | jenkins | v1.33.1 | 06 Jun 24 21:33 UTC | 06 Jun 24 21:33 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-635133 | old-k8s-version-635133 | jenkins | v1.33.1 | 06 Jun 24 21:33 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-259770 | no-preload-259770 | jenkins | v1.33.1 | 06 Jun 24 21:34 UTC | 06 Jun 24 21:34 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-259770 | no-preload-259770 | jenkins | v1.33.1 | 06 Jun 24 21:34 UTC | 06 Jun 24 21:34 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-259770 | no-preload-259770 | jenkins | v1.33.1 | 06 Jun 24 21:34 UTC | 06 Jun 24 21:34 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-259770 | no-preload-259770 | jenkins | v1.33.1 | 06 Jun 24 21:34 UTC | 06 Jun 24 21:39 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
| image | no-preload-259770 image list | no-preload-259770 | jenkins | v1.33.1 | 06 Jun 24 21:39 UTC | 06 Jun 24 21:39 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-259770 | no-preload-259770 | jenkins | v1.33.1 | 06 Jun 24 21:39 UTC | 06 Jun 24 21:39 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-259770 | no-preload-259770 | jenkins | v1.33.1 | 06 Jun 24 21:39 UTC | 06 Jun 24 21:39 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-259770 | no-preload-259770 | jenkins | v1.33.1 | 06 Jun 24 21:39 UTC | 06 Jun 24 21:39 UTC |
| delete | -p no-preload-259770 | no-preload-259770 | jenkins | v1.33.1 | 06 Jun 24 21:39 UTC | 06 Jun 24 21:39 UTC |
| start | -p embed-certs-242181 | embed-certs-242181 | jenkins | v1.33.1 | 06 Jun 24 21:39 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/06/06 21:39:35
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.3 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0606 21:39:35.954200 490214 out.go:291] Setting OutFile to fd 1 ...
I0606 21:39:35.954380 490214 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0606 21:39:35.954411 490214 out.go:304] Setting ErrFile to fd 2...
I0606 21:39:35.954430 490214 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0606 21:39:35.954703 490214 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19038-279835/.minikube/bin
I0606 21:39:35.955321 490214 out.go:298] Setting JSON to false
I0606 21:39:35.956624 490214 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":8519,"bootTime":1717701457,"procs":234,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0606 21:39:35.956734 490214 start.go:139] virtualization:
I0606 21:39:35.959629 490214 out.go:177] * [embed-certs-242181] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0606 21:39:35.961143 490214 out.go:177] - MINIKUBE_LOCATION=19038
I0606 21:39:35.963126 490214 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0606 21:39:35.961213 490214 notify.go:220] Checking for updates...
I0606 21:39:35.967221 490214 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19038-279835/kubeconfig
I0606 21:39:35.969372 490214 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19038-279835/.minikube
I0606 21:39:35.971270 490214 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0606 21:39:35.973130 490214 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0606 21:39:35.975474 490214 config.go:182] Loaded profile config "old-k8s-version-635133": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0606 21:39:35.975570 490214 driver.go:392] Setting default libvirt URI to qemu:///system
I0606 21:39:36.009938 490214 docker.go:122] docker version: linux-26.1.4:Docker Engine - Community
I0606 21:39:36.010061 490214 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0606 21:39:36.092952 490214 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-06-06 21:39:36.082983718 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1062-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214982656 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d2d58213f83a351ca8f528a95fbd145f5654e957 Expected:d2d58213f83a351ca8f528a95fbd145f5654e957} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.1]] Warnings:<nil>}}
I0606 21:39:36.093056 490214 docker.go:295] overlay module found
I0606 21:39:36.095423 490214 out.go:177] * Using the docker driver based on user configuration
I0606 21:39:36.097333 490214 start.go:297] selected driver: docker
I0606 21:39:36.097365 490214 start.go:901] validating driver "docker" against <nil>
I0606 21:39:36.097379 490214 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0606 21:39:36.099071 490214 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0606 21:39:36.159901 490214 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-06-06 21:39:36.150745265 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1062-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214982656 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d2d58213f83a351ca8f528a95fbd145f5654e957 Expected:d2d58213f83a351ca8f528a95fbd145f5654e957} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.1]] Warnings:<nil>}}
I0606 21:39:36.160067 490214 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0606 21:39:36.160363 490214 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0606 21:39:36.162208 490214 out.go:177] * Using Docker driver with root privileges
I0606 21:39:36.163859 490214 cni.go:84] Creating CNI manager for ""
I0606 21:39:36.163887 490214 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0606 21:39:36.163902 490214 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0606 21:39:36.163994 490214 start.go:340] cluster config:
{Name:embed-certs-242181 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-242181 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0606 21:39:36.166631 490214 out.go:177] * Starting "embed-certs-242181" primary control-plane node in "embed-certs-242181" cluster
I0606 21:39:36.168633 490214 cache.go:121] Beginning downloading kic base image for docker with containerd
I0606 21:39:36.170340 490214 out.go:177] * Pulling base image v0.0.44-1717668449-19038 ...
I0606 21:39:36.172300 490214 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime containerd
I0606 21:39:36.172352 490214 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19038-279835/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-containerd-overlay2-arm64.tar.lz4
I0606 21:39:36.172364 490214 cache.go:56] Caching tarball of preloaded images
I0606 21:39:36.172444 490214 preload.go:173] Found /home/jenkins/minikube-integration/19038-279835/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0606 21:39:36.172470 490214 cache.go:59] Finished verifying existence of preloaded tar for v1.30.1 on containerd
I0606 21:39:36.172582 490214 profile.go:143] Saving config to /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/config.json ...
I0606 21:39:36.172605 490214 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/config.json: {Name:mkbc7fd56a220219c8052f235760b7f431d3373a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0606 21:39:36.172757 490214 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 in local docker daemon
I0606 21:39:36.187230 490214 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 in local docker daemon, skipping pull
I0606 21:39:36.187253 490214 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 exists in daemon, skipping load
I0606 21:39:36.187272 490214 cache.go:194] Successfully downloaded all kic artifacts
I0606 21:39:36.187299 490214 start.go:360] acquireMachinesLock for embed-certs-242181: {Name:mk013c671c9349386ddb9bcde90a2b65a4a4b45f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0606 21:39:36.188062 490214 start.go:364] duration metric: took 739.457µs to acquireMachinesLock for "embed-certs-242181"
I0606 21:39:36.188097 490214 start.go:93] Provisioning new machine with config: &{Name:embed-certs-242181 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-242181 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0606 21:39:36.188177 490214 start.go:125] createHost starting for "" (driver="docker")
I0606 21:39:33.122111 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:35.637860 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:36.191080 490214 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0606 21:39:36.191396 490214 start.go:159] libmachine.API.Create for "embed-certs-242181" (driver="docker")
I0606 21:39:36.191431 490214 client.go:168] LocalClient.Create starting
I0606 21:39:36.191498 490214 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca.pem
I0606 21:39:36.191535 490214 main.go:141] libmachine: Decoding PEM data...
I0606 21:39:36.191559 490214 main.go:141] libmachine: Parsing certificate...
I0606 21:39:36.191611 490214 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19038-279835/.minikube/certs/cert.pem
I0606 21:39:36.191632 490214 main.go:141] libmachine: Decoding PEM data...
I0606 21:39:36.191642 490214 main.go:141] libmachine: Parsing certificate...
I0606 21:39:36.192002 490214 cli_runner.go:164] Run: docker network inspect embed-certs-242181 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0606 21:39:36.209514 490214 cli_runner.go:211] docker network inspect embed-certs-242181 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0606 21:39:36.209597 490214 network_create.go:281] running [docker network inspect embed-certs-242181] to gather additional debugging logs...
I0606 21:39:36.209616 490214 cli_runner.go:164] Run: docker network inspect embed-certs-242181
W0606 21:39:36.225553 490214 cli_runner.go:211] docker network inspect embed-certs-242181 returned with exit code 1
I0606 21:39:36.225582 490214 network_create.go:284] error running [docker network inspect embed-certs-242181]: docker network inspect embed-certs-242181: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-242181 not found
I0606 21:39:36.225596 490214 network_create.go:286] output of [docker network inspect embed-certs-242181]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-242181 not found
** /stderr **
I0606 21:39:36.225740 490214 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0606 21:39:36.241066 490214 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-eb027951d069 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:b7:92:20:2f} reservation:<nil>}
I0606 21:39:36.241500 490214 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-1b81711470d1 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:25:8f:00:21} reservation:<nil>}
I0606 21:39:36.242065 490214 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-db00787f4348 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:52:b9:0b:53} reservation:<nil>}
I0606 21:39:36.242611 490214 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40018da160}
I0606 21:39:36.242701 490214 network_create.go:124] attempt to create docker network embed-certs-242181 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0606 21:39:36.242789 490214 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-242181 embed-certs-242181
I0606 21:39:36.308447 490214 network_create.go:108] docker network embed-certs-242181 192.168.76.0/24 created
I0606 21:39:36.308487 490214 kic.go:121] calculated static IP "192.168.76.2" for the "embed-certs-242181" container
I0606 21:39:36.308629 490214 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0606 21:39:36.323659 490214 cli_runner.go:164] Run: docker volume create embed-certs-242181 --label name.minikube.sigs.k8s.io=embed-certs-242181 --label created_by.minikube.sigs.k8s.io=true
I0606 21:39:36.339047 490214 oci.go:103] Successfully created a docker volume embed-certs-242181
I0606 21:39:36.339145 490214 cli_runner.go:164] Run: docker run --rm --name embed-certs-242181-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-242181 --entrypoint /usr/bin/test -v embed-certs-242181:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 -d /var/lib
I0606 21:39:36.964622 490214 oci.go:107] Successfully prepared a docker volume embed-certs-242181
I0606 21:39:36.964684 490214 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime containerd
I0606 21:39:36.964705 490214 kic.go:194] Starting extracting preloaded images to volume ...
I0606 21:39:36.964793 490214 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19038-279835/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-242181:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 -I lz4 -xf /preloaded.tar -C /extractDir
I0606 21:39:38.123000 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:40.621364 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:41.558822 490214 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19038-279835/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-242181:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 -I lz4 -xf /preloaded.tar -C /extractDir: (4.593978326s)
I0606 21:39:41.558866 490214 kic.go:203] duration metric: took 4.59415709s to extract preloaded images to volume ...
W0606 21:39:41.559022 490214 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0606 21:39:41.559134 490214 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0606 21:39:41.608285 490214 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-242181 --name embed-certs-242181 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-242181 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-242181 --network embed-certs-242181 --ip 192.168.76.2 --volume embed-certs-242181:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6
I0606 21:39:41.953985 490214 cli_runner.go:164] Run: docker container inspect embed-certs-242181 --format={{.State.Running}}
I0606 21:39:41.975071 490214 cli_runner.go:164] Run: docker container inspect embed-certs-242181 --format={{.State.Status}}
I0606 21:39:41.996846 490214 cli_runner.go:164] Run: docker exec embed-certs-242181 stat /var/lib/dpkg/alternatives/iptables
I0606 21:39:42.063700 490214 oci.go:144] the created container "embed-certs-242181" has a running status.
I0606 21:39:42.063729 490214 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19038-279835/.minikube/machines/embed-certs-242181/id_rsa...
I0606 21:39:42.471455 490214 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19038-279835/.minikube/machines/embed-certs-242181/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0606 21:39:42.504800 490214 cli_runner.go:164] Run: docker container inspect embed-certs-242181 --format={{.State.Status}}
I0606 21:39:42.536866 490214 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0606 21:39:42.536888 490214 kic_runner.go:114] Args: [docker exec --privileged embed-certs-242181 chown docker:docker /home/docker/.ssh/authorized_keys]
I0606 21:39:42.632142 490214 cli_runner.go:164] Run: docker container inspect embed-certs-242181 --format={{.State.Status}}
I0606 21:39:42.659154 490214 machine.go:94] provisionDockerMachine start ...
I0606 21:39:42.659253 490214 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-242181
I0606 21:39:42.685898 490214 main.go:141] libmachine: Using SSH client type: native
I0606 21:39:42.686174 490214 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bb0] 0x3e5410 <nil> [] 0s} 127.0.0.1 33447 <nil> <nil>}
I0606 21:39:42.686184 490214 main.go:141] libmachine: About to run SSH command:
hostname
I0606 21:39:42.855762 490214 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-242181
I0606 21:39:42.855782 490214 ubuntu.go:169] provisioning hostname "embed-certs-242181"
I0606 21:39:42.855856 490214 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-242181
I0606 21:39:42.877775 490214 main.go:141] libmachine: Using SSH client type: native
I0606 21:39:42.878032 490214 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bb0] 0x3e5410 <nil> [] 0s} 127.0.0.1 33447 <nil> <nil>}
I0606 21:39:42.878044 490214 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-242181 && echo "embed-certs-242181" | sudo tee /etc/hostname
I0606 21:39:43.040855 490214 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-242181
I0606 21:39:43.040963 490214 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-242181
I0606 21:39:43.060669 490214 main.go:141] libmachine: Using SSH client type: native
I0606 21:39:43.060915 490214 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bb0] 0x3e5410 <nil> [] 0s} 127.0.0.1 33447 <nil> <nil>}
I0606 21:39:43.060938 490214 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-242181' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-242181/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-242181' | sudo tee -a /etc/hosts;
fi
fi
I0606 21:39:43.214398 490214 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0606 21:39:43.214433 490214 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19038-279835/.minikube CaCertPath:/home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19038-279835/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19038-279835/.minikube}
I0606 21:39:43.214527 490214 ubuntu.go:177] setting up certificates
I0606 21:39:43.214539 490214 provision.go:84] configureAuth start
I0606 21:39:43.214624 490214 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-242181
I0606 21:39:43.237840 490214 provision.go:143] copyHostCerts
I0606 21:39:43.237914 490214 exec_runner.go:144] found /home/jenkins/minikube-integration/19038-279835/.minikube/cert.pem, removing ...
I0606 21:39:43.237927 490214 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19038-279835/.minikube/cert.pem
I0606 21:39:43.237993 490214 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19038-279835/.minikube/cert.pem (1123 bytes)
I0606 21:39:43.238123 490214 exec_runner.go:144] found /home/jenkins/minikube-integration/19038-279835/.minikube/key.pem, removing ...
I0606 21:39:43.238133 490214 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19038-279835/.minikube/key.pem
I0606 21:39:43.238186 490214 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19038-279835/.minikube/key.pem (1675 bytes)
I0606 21:39:43.238268 490214 exec_runner.go:144] found /home/jenkins/minikube-integration/19038-279835/.minikube/ca.pem, removing ...
I0606 21:39:43.238280 490214 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19038-279835/.minikube/ca.pem
I0606 21:39:43.238325 490214 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19038-279835/.minikube/ca.pem (1078 bytes)
I0606 21:39:43.238377 490214 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19038-279835/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca-key.pem org=jenkins.embed-certs-242181 san=[127.0.0.1 192.168.76.2 embed-certs-242181 localhost minikube]
I0606 21:39:44.046832 490214 provision.go:177] copyRemoteCerts
I0606 21:39:44.046923 490214 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0606 21:39:44.046981 490214 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-242181
I0606 21:39:44.065723 490214 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33447 SSHKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/embed-certs-242181/id_rsa Username:docker}
I0606 21:39:44.164426 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0606 21:39:44.190639 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0606 21:39:44.220262 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0606 21:39:44.248666 490214 provision.go:87] duration metric: took 1.034111677s to configureAuth
I0606 21:39:44.248733 490214 ubuntu.go:193] setting minikube options for container-runtime
I0606 21:39:44.248939 490214 config.go:182] Loaded profile config "embed-certs-242181": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.1
I0606 21:39:44.248953 490214 machine.go:97] duration metric: took 1.589782677s to provisionDockerMachine
I0606 21:39:44.248960 490214 client.go:171] duration metric: took 8.057519579s to LocalClient.Create
I0606 21:39:44.248977 490214 start.go:167] duration metric: took 8.057586623s to libmachine.API.Create "embed-certs-242181"
I0606 21:39:44.248987 490214 start.go:293] postStartSetup for "embed-certs-242181" (driver="docker")
I0606 21:39:44.248996 490214 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0606 21:39:44.249054 490214 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0606 21:39:44.249099 490214 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-242181
I0606 21:39:44.265534 490214 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33447 SSHKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/embed-certs-242181/id_rsa Username:docker}
I0606 21:39:44.367639 490214 ssh_runner.go:195] Run: cat /etc/os-release
I0606 21:39:44.370940 490214 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0606 21:39:44.370976 490214 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0606 21:39:44.370987 490214 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0606 21:39:44.370994 490214 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0606 21:39:44.371008 490214 filesync.go:126] Scanning /home/jenkins/minikube-integration/19038-279835/.minikube/addons for local assets ...
I0606 21:39:44.371063 490214 filesync.go:126] Scanning /home/jenkins/minikube-integration/19038-279835/.minikube/files for local assets ...
I0606 21:39:44.371143 490214 filesync.go:149] local asset: /home/jenkins/minikube-integration/19038-279835/.minikube/files/etc/ssl/certs/2852232.pem -> 2852232.pem in /etc/ssl/certs
I0606 21:39:44.371252 490214 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0606 21:39:44.379751 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/files/etc/ssl/certs/2852232.pem --> /etc/ssl/certs/2852232.pem (1708 bytes)
I0606 21:39:44.403356 490214 start.go:296] duration metric: took 154.354288ms for postStartSetup
I0606 21:39:44.403763 490214 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-242181
I0606 21:39:44.422693 490214 profile.go:143] Saving config to /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/config.json ...
I0606 21:39:44.422990 490214 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0606 21:39:44.423038 490214 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-242181
I0606 21:39:44.438569 490214 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33447 SSHKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/embed-certs-242181/id_rsa Username:docker}
I0606 21:39:44.531567 490214 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0606 21:39:44.535924 490214 start.go:128] duration metric: took 8.347730065s to createHost
I0606 21:39:44.535953 490214 start.go:83] releasing machines lock for "embed-certs-242181", held for 8.34787422s
I0606 21:39:44.536029 490214 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-242181
I0606 21:39:44.557117 490214 ssh_runner.go:195] Run: cat /version.json
I0606 21:39:44.557130 490214 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0606 21:39:44.557171 490214 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-242181
I0606 21:39:44.557203 490214 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-242181
I0606 21:39:44.585732 490214 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33447 SSHKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/embed-certs-242181/id_rsa Username:docker}
I0606 21:39:44.592504 490214 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33447 SSHKeyPath:/home/jenkins/minikube-integration/19038-279835/.minikube/machines/embed-certs-242181/id_rsa Username:docker}
I0606 21:39:44.802211 490214 ssh_runner.go:195] Run: systemctl --version
I0606 21:39:44.806363 490214 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0606 21:39:44.810169 490214 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0606 21:39:44.833885 490214 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0606 21:39:44.833964 490214 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0606 21:39:44.864271 490214 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0606 21:39:44.864341 490214 start.go:494] detecting cgroup driver to use...
I0606 21:39:44.864390 490214 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0606 21:39:44.864478 490214 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0606 21:39:44.876813 490214 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0606 21:39:44.888513 490214 docker.go:217] disabling cri-docker service (if available) ...
I0606 21:39:44.888580 490214 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0606 21:39:44.902312 490214 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0606 21:39:44.917769 490214 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0606 21:39:45.014536 490214 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0606 21:39:45.148618 490214 docker.go:233] disabling docker service ...
I0606 21:39:45.148766 490214 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0606 21:39:45.176109 490214 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0606 21:39:45.193520 490214 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0606 21:39:45.327027 490214 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0606 21:39:45.423675 490214 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0606 21:39:45.436461 490214 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0606 21:39:45.457097 490214 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0606 21:39:45.467732 490214 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0606 21:39:45.478055 490214 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0606 21:39:45.478169 490214 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0606 21:39:45.488816 490214 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0606 21:39:45.498792 490214 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0606 21:39:45.508630 490214 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0606 21:39:45.519059 490214 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0606 21:39:45.532192 490214 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0606 21:39:45.543485 490214 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0606 21:39:45.555399 490214 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0606 21:39:45.566263 490214 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0606 21:39:45.575550 490214 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0606 21:39:45.591180 490214 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0606 21:39:45.679579 490214 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0606 21:39:45.821055 490214 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0606 21:39:45.821166 490214 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0606 21:39:45.825014 490214 start.go:562] Will wait 60s for crictl version
I0606 21:39:45.825094 490214 ssh_runner.go:195] Run: which crictl
I0606 21:39:45.828525 490214 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0606 21:39:45.872713 490214 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.33
RuntimeApiVersion: v1
I0606 21:39:45.872784 490214 ssh_runner.go:195] Run: containerd --version
I0606 21:39:45.897476 490214 ssh_runner.go:195] Run: containerd --version
I0606 21:39:45.922922 490214 out.go:177] * Preparing Kubernetes v1.30.1 on containerd 1.6.33 ...
I0606 21:39:45.925037 490214 cli_runner.go:164] Run: docker network inspect embed-certs-242181 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0606 21:39:45.940288 490214 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0606 21:39:45.944076 490214 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0606 21:39:42.622132 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:45.124514 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:45.955347 490214 kubeadm.go:877] updating cluster {Name:embed-certs-242181 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-242181 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0606 21:39:45.957510 490214 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime containerd
I0606 21:39:45.957601 490214 ssh_runner.go:195] Run: sudo crictl images --output json
I0606 21:39:46.007458 490214 containerd.go:627] all images are preloaded for containerd runtime.
I0606 21:39:46.007484 490214 containerd.go:534] Images already preloaded, skipping extraction
I0606 21:39:46.007549 490214 ssh_runner.go:195] Run: sudo crictl images --output json
I0606 21:39:46.044556 490214 containerd.go:627] all images are preloaded for containerd runtime.
I0606 21:39:46.044579 490214 cache_images.go:84] Images are preloaded, skipping loading
I0606 21:39:46.044588 490214 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.30.1 containerd true true} ...
I0606 21:39:46.044697 490214 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-242181 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.30.1 ClusterName:embed-certs-242181 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0606 21:39:46.044768 490214 ssh_runner.go:195] Run: sudo crictl info
I0606 21:39:46.082218 490214 cni.go:84] Creating CNI manager for ""
I0606 21:39:46.082241 490214 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0606 21:39:46.082257 490214 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0606 21:39:46.082300 490214 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.30.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-242181 NodeName:embed-certs-242181 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0606 21:39:46.082513 490214 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "embed-certs-242181"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0606 21:39:46.082585 490214 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.1
I0606 21:39:46.091596 490214 binaries.go:44] Found k8s binaries, skipping transfer
I0606 21:39:46.091666 490214 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0606 21:39:46.106906 490214 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
I0606 21:39:46.135515 490214 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0606 21:39:46.160516 490214 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes)
I0606 21:39:46.181792 490214 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0606 21:39:46.188194 490214 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0606 21:39:46.201465 490214 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0606 21:39:46.290230 490214 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0606 21:39:46.304323 490214 certs.go:68] Setting up /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181 for IP: 192.168.76.2
I0606 21:39:46.304344 490214 certs.go:194] generating shared ca certs ...
I0606 21:39:46.304361 490214 certs.go:226] acquiring lock for ca certs: {Name:mkc759f49abe4f4f96b3e66fc6cad3282470b17e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0606 21:39:46.304514 490214 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19038-279835/.minikube/ca.key
I0606 21:39:46.304561 490214 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19038-279835/.minikube/proxy-client-ca.key
I0606 21:39:46.304572 490214 certs.go:256] generating profile certs ...
I0606 21:39:46.304634 490214 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/client.key
I0606 21:39:46.304659 490214 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/client.crt with IP's: []
I0606 21:39:47.035770 490214 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/client.crt ...
I0606 21:39:47.035875 490214 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/client.crt: {Name:mk98f6008d2030353a764972e9deed24ee13b8fc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0606 21:39:47.036978 490214 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/client.key ...
I0606 21:39:47.037027 490214 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/client.key: {Name:mk3590a43dd34ba8f7b8e3034a50c3166699a4c0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0606 21:39:47.037695 490214 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/apiserver.key.51b2bfda
I0606 21:39:47.037754 490214 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/apiserver.crt.51b2bfda with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.76.2]
I0606 21:39:47.795491 490214 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/apiserver.crt.51b2bfda ...
I0606 21:39:47.795523 490214 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/apiserver.crt.51b2bfda: {Name:mk7cc356774cacf1c83d08e1bb44ec6c30f361d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0606 21:39:47.796275 490214 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/apiserver.key.51b2bfda ...
I0606 21:39:47.796301 490214 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/apiserver.key.51b2bfda: {Name:mk4ef7e6a316abdd604612df1f02f1b8efce9763 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0606 21:39:47.796456 490214 certs.go:381] copying /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/apiserver.crt.51b2bfda -> /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/apiserver.crt
I0606 21:39:47.796578 490214 certs.go:385] copying /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/apiserver.key.51b2bfda -> /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/apiserver.key
I0606 21:39:47.796670 490214 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/proxy-client.key
I0606 21:39:47.796704 490214 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/proxy-client.crt with IP's: []
I0606 21:39:48.463304 490214 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/proxy-client.crt ...
I0606 21:39:48.463335 490214 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/proxy-client.crt: {Name:mk9714add75b91ba544fb2b718ae53ba77fcd922 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0606 21:39:48.463521 490214 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/proxy-client.key ...
I0606 21:39:48.463535 490214 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/proxy-client.key: {Name:mk0d1a30553a071b6c1bb9f85fa346268df828bc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0606 21:39:48.464151 490214 certs.go:484] found cert: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/285223.pem (1338 bytes)
W0606 21:39:48.464214 490214 certs.go:480] ignoring /home/jenkins/minikube-integration/19038-279835/.minikube/certs/285223_empty.pem, impossibly tiny 0 bytes
I0606 21:39:48.464229 490214 certs.go:484] found cert: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca-key.pem (1679 bytes)
I0606 21:39:48.464260 490214 certs.go:484] found cert: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/ca.pem (1078 bytes)
I0606 21:39:48.464292 490214 certs.go:484] found cert: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/cert.pem (1123 bytes)
I0606 21:39:48.464318 490214 certs.go:484] found cert: /home/jenkins/minikube-integration/19038-279835/.minikube/certs/key.pem (1675 bytes)
I0606 21:39:48.464365 490214 certs.go:484] found cert: /home/jenkins/minikube-integration/19038-279835/.minikube/files/etc/ssl/certs/2852232.pem (1708 bytes)
I0606 21:39:48.465076 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0606 21:39:48.491261 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0606 21:39:48.517423 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0606 21:39:48.544457 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0606 21:39:48.569287 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0606 21:39:48.594748 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0606 21:39:48.621215 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0606 21:39:48.647202 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/profiles/embed-certs-242181/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0606 21:39:48.672285 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/files/etc/ssl/certs/2852232.pem --> /usr/share/ca-certificates/2852232.pem (1708 bytes)
I0606 21:39:48.696095 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0606 21:39:48.721648 490214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19038-279835/.minikube/certs/285223.pem --> /usr/share/ca-certificates/285223.pem (1338 bytes)
I0606 21:39:48.747737 490214 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0606 21:39:48.766102 490214 ssh_runner.go:195] Run: openssl version
I0606 21:39:48.771512 490214 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2852232.pem && ln -fs /usr/share/ca-certificates/2852232.pem /etc/ssl/certs/2852232.pem"
I0606 21:39:48.780811 490214 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2852232.pem
I0606 21:39:48.784242 490214 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 6 20:54 /usr/share/ca-certificates/2852232.pem
I0606 21:39:48.784319 490214 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2852232.pem
I0606 21:39:48.791217 490214 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/2852232.pem /etc/ssl/certs/3ec20f2e.0"
I0606 21:39:48.800990 490214 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0606 21:39:48.810771 490214 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0606 21:39:48.814234 490214 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 6 20:47 /usr/share/ca-certificates/minikubeCA.pem
I0606 21:39:48.814301 490214 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0606 21:39:48.821600 490214 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0606 21:39:48.830987 490214 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/285223.pem && ln -fs /usr/share/ca-certificates/285223.pem /etc/ssl/certs/285223.pem"
I0606 21:39:48.840085 490214 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/285223.pem
I0606 21:39:48.843571 490214 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 6 20:54 /usr/share/ca-certificates/285223.pem
I0606 21:39:48.843629 490214 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/285223.pem
I0606 21:39:48.850557 490214 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/285223.pem /etc/ssl/certs/51391683.0"
I0606 21:39:48.860458 490214 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0606 21:39:48.863773 490214 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0606 21:39:48.863820 490214 kubeadm.go:391] StartCluster: {Name:embed-certs-242181 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-242181 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fal
se CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0606 21:39:48.863909 490214 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0606 21:39:48.863972 490214 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0606 21:39:48.901219 490214 cri.go:89] found id: ""
I0606 21:39:48.901363 490214 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0606 21:39:48.910396 490214 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0606 21:39:48.919687 490214 kubeadm.go:213] ignoring SystemVerification for kubeadm because of docker driver
I0606 21:39:48.919784 490214 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0606 21:39:48.928882 490214 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0606 21:39:48.928902 490214 kubeadm.go:156] found existing configuration files:
I0606 21:39:48.931721 490214 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0606 21:39:48.941218 490214 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0606 21:39:48.941301 490214 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0606 21:39:48.949416 490214 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0606 21:39:48.958333 490214 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0606 21:39:48.958397 490214 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0606 21:39:48.967166 490214 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0606 21:39:48.977543 490214 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0606 21:39:48.977656 490214 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0606 21:39:48.986274 490214 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0606 21:39:48.995394 490214 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0606 21:39:48.995461 490214 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0606 21:39:49.004929 490214 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0606 21:39:49.049219 490214 kubeadm.go:309] [init] Using Kubernetes version: v1.30.1
I0606 21:39:49.049514 490214 kubeadm.go:309] [preflight] Running pre-flight checks
I0606 21:39:49.093771 490214 kubeadm.go:309] [preflight] The system verification failed. Printing the output from the verification:
I0606 21:39:49.093848 490214 kubeadm.go:309] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1062-aws[0m
I0606 21:39:49.093887 490214 kubeadm.go:309] [0;37mOS[0m: [0;32mLinux[0m
I0606 21:39:49.093937 490214 kubeadm.go:309] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0606 21:39:49.093987 490214 kubeadm.go:309] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0606 21:39:49.094037 490214 kubeadm.go:309] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0606 21:39:49.094087 490214 kubeadm.go:309] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0606 21:39:49.094137 490214 kubeadm.go:309] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0606 21:39:49.094188 490214 kubeadm.go:309] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0606 21:39:49.094235 490214 kubeadm.go:309] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0606 21:39:49.094284 490214 kubeadm.go:309] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0606 21:39:49.094335 490214 kubeadm.go:309] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0606 21:39:49.167803 490214 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0606 21:39:49.167913 490214 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0606 21:39:49.168009 490214 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0606 21:39:49.427549 490214 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0606 21:39:49.431969 490214 out.go:204] - Generating certificates and keys ...
I0606 21:39:49.432102 490214 kubeadm.go:309] [certs] Using existing ca certificate authority
I0606 21:39:49.432173 490214 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0606 21:39:50.228810 490214 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0606 21:39:50.771206 490214 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0606 21:39:47.623282 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:50.121122 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:52.124050 480289 pod_ready.go:102] pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace has status "Ready":"False"
I0606 21:39:51.028772 490214 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0606 21:39:51.423127 490214 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0606 21:39:51.958737 490214 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0606 21:39:51.959035 490214 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [embed-certs-242181 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0606 21:39:52.606948 490214 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0606 21:39:52.607339 490214 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [embed-certs-242181 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0606 21:39:53.286356 490214 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0606 21:39:53.656737 490214 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0606 21:39:53.898830 490214 kubeadm.go:309] [certs] Generating "sa" key and public key
I0606 21:39:53.898931 490214 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0606 21:39:54.416307 490214 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0606 21:39:54.654121 490214 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0606 21:39:55.519736 490214 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0606 21:39:56.229934 490214 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0606 21:39:56.586548 490214 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0606 21:39:56.587726 490214 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0606 21:39:56.590601 490214 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0606 21:39:53.624381 480289 pod_ready.go:81] duration metric: took 4m0.00948461s for pod "metrics-server-9975d5f86-g6m7v" in "kube-system" namespace to be "Ready" ...
E0606 21:39:53.624406 480289 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0606 21:39:53.624420 480289 pod_ready.go:38] duration metric: took 5m29.977947311s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0606 21:39:53.624433 480289 api_server.go:52] waiting for apiserver process to appear ...
I0606 21:39:53.624461 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0606 21:39:53.624541 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0606 21:39:53.684252 480289 cri.go:89] found id: "d92e466d4ff93db5deca41ec84d1bf7a858dcb1ce897d06575ffb06ff7a02646"
I0606 21:39:53.684284 480289 cri.go:89] found id: "3dc1c84feb8a29630e4de6f4eaaf57533c377c5e8e79a0c5e5f93e9f1b5efe09"
I0606 21:39:53.684289 480289 cri.go:89] found id: ""
I0606 21:39:53.684297 480289 logs.go:276] 2 containers: [d92e466d4ff93db5deca41ec84d1bf7a858dcb1ce897d06575ffb06ff7a02646 3dc1c84feb8a29630e4de6f4eaaf57533c377c5e8e79a0c5e5f93e9f1b5efe09]
I0606 21:39:53.684349 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.690020 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.694358 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0606 21:39:53.694471 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0606 21:39:53.754259 480289 cri.go:89] found id: "c29c288b6359fcd41bdf8a354f2e6e05fed74207851ef2e0ffa67bb314ae8d97"
I0606 21:39:53.754288 480289 cri.go:89] found id: "36c683ec52ff63ae2e147bf5c0a21d1760c6a0a30b2b13be193810c032c53f64"
I0606 21:39:53.754293 480289 cri.go:89] found id: ""
I0606 21:39:53.754311 480289 logs.go:276] 2 containers: [c29c288b6359fcd41bdf8a354f2e6e05fed74207851ef2e0ffa67bb314ae8d97 36c683ec52ff63ae2e147bf5c0a21d1760c6a0a30b2b13be193810c032c53f64]
I0606 21:39:53.754379 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.759346 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.764148 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0606 21:39:53.764249 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0606 21:39:53.833615 480289 cri.go:89] found id: "e55f208de822b91f62dda76170dbc6e8bb26fdbfb117d19eb64f22bd0d14ab55"
I0606 21:39:53.833654 480289 cri.go:89] found id: "77ca58fcab3e446b291be4f6754268bd76dc2fee93422a432640c65fdededbfc"
I0606 21:39:53.833660 480289 cri.go:89] found id: ""
I0606 21:39:53.833667 480289 logs.go:276] 2 containers: [e55f208de822b91f62dda76170dbc6e8bb26fdbfb117d19eb64f22bd0d14ab55 77ca58fcab3e446b291be4f6754268bd76dc2fee93422a432640c65fdededbfc]
I0606 21:39:53.833751 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.840546 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.844055 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0606 21:39:53.844159 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0606 21:39:53.923206 480289 cri.go:89] found id: "17ca7fba4a93bd767c4b56ec20b283ba33353ff205a9275aa8211ba3ebcf8d7b"
I0606 21:39:53.923234 480289 cri.go:89] found id: "cc0c393556c3d6da8e41b24e8de1e4c2b58dce0feafdd92f3b8db91825500060"
I0606 21:39:53.923239 480289 cri.go:89] found id: ""
I0606 21:39:53.923246 480289 logs.go:276] 2 containers: [17ca7fba4a93bd767c4b56ec20b283ba33353ff205a9275aa8211ba3ebcf8d7b cc0c393556c3d6da8e41b24e8de1e4c2b58dce0feafdd92f3b8db91825500060]
I0606 21:39:53.923344 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.930946 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:53.936853 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0606 21:39:53.936952 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0606 21:39:54.029021 480289 cri.go:89] found id: "61364cca06a11106b4dcdbc01c72349914e26bf7dc1c81e5a8387007830c6bdb"
I0606 21:39:54.029045 480289 cri.go:89] found id: "bee54e91e1fb25a822ac99adb4f1c0003ae7aaefa4107cf384d7143a74247580"
I0606 21:39:54.029051 480289 cri.go:89] found id: ""
I0606 21:39:54.029061 480289 logs.go:276] 2 containers: [61364cca06a11106b4dcdbc01c72349914e26bf7dc1c81e5a8387007830c6bdb bee54e91e1fb25a822ac99adb4f1c0003ae7aaefa4107cf384d7143a74247580]
I0606 21:39:54.029149 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.035889 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.042391 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0606 21:39:54.042554 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0606 21:39:54.107479 480289 cri.go:89] found id: "95c850c794fedde40e049f91f9d0e75abf2d7d82c91b38c39e991dd5e3b8af49"
I0606 21:39:54.107508 480289 cri.go:89] found id: "52a1b7afe7153c756f497d76cdf3b2515aea9392d68afd3ffec265ed78e8a2d5"
I0606 21:39:54.107514 480289 cri.go:89] found id: ""
I0606 21:39:54.107536 480289 logs.go:276] 2 containers: [95c850c794fedde40e049f91f9d0e75abf2d7d82c91b38c39e991dd5e3b8af49 52a1b7afe7153c756f497d76cdf3b2515aea9392d68afd3ffec265ed78e8a2d5]
I0606 21:39:54.107605 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.113407 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.118592 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0606 21:39:54.118776 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0606 21:39:54.181856 480289 cri.go:89] found id: "2dac5b249cb881732b5741ed39817b7c23b3f4df26b536557815b70abf3e1d6b"
I0606 21:39:54.181949 480289 cri.go:89] found id: "988b3d43deecf64d1b76c87a6b2549293b95791fc4c680f5648c990beb49af24"
I0606 21:39:54.181968 480289 cri.go:89] found id: ""
I0606 21:39:54.181999 480289 logs.go:276] 2 containers: [2dac5b249cb881732b5741ed39817b7c23b3f4df26b536557815b70abf3e1d6b 988b3d43deecf64d1b76c87a6b2549293b95791fc4c680f5648c990beb49af24]
I0606 21:39:54.182125 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.187147 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.192155 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0606 21:39:54.192293 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0606 21:39:54.253744 480289 cri.go:89] found id: "f8800ceac902950a4fea28153008bc5a3a52171eb8f28a7e5c4b7b3c9727b18b"
I0606 21:39:54.253831 480289 cri.go:89] found id: ""
I0606 21:39:54.253854 480289 logs.go:276] 1 containers: [f8800ceac902950a4fea28153008bc5a3a52171eb8f28a7e5c4b7b3c9727b18b]
I0606 21:39:54.253963 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.258563 480289 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0606 21:39:54.258731 480289 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0606 21:39:54.323175 480289 cri.go:89] found id: "802abe80141bb9cd9e88dcb018e0323b18eaaa57079e90e1dc9a942c85f05355"
I0606 21:39:54.323248 480289 cri.go:89] found id: "19aaaaf394190c60194c94cf96c5f7a3d7ed7868bf9470d83ccd49ceeb94b496"
I0606 21:39:54.323268 480289 cri.go:89] found id: ""
I0606 21:39:54.323288 480289 logs.go:276] 2 containers: [802abe80141bb9cd9e88dcb018e0323b18eaaa57079e90e1dc9a942c85f05355 19aaaaf394190c60194c94cf96c5f7a3d7ed7868bf9470d83ccd49ceeb94b496]
I0606 21:39:54.323387 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.329403 480289 ssh_runner.go:195] Run: which crictl
I0606 21:39:54.336888 480289 logs.go:123] Gathering logs for kubelet ...
I0606 21:39:54.336970 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0606 21:39:54.417179 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:25 old-k8s-version-635133 kubelet[665]: E0606 21:34:25.288944 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0606 21:39:54.417402 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:25 old-k8s-version-635133 kubelet[665]: E0606 21:34:25.505444 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.420288 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:38 old-k8s-version-635133 kubelet[665]: E0606 21:34:38.133050 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0606 21:39:54.422433 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:47 old-k8s-version-635133 kubelet[665]: E0606 21:34:47.615284 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.426848 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:48 old-k8s-version-635133 kubelet[665]: E0606 21:34:48.618275 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.427233 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:52 old-k8s-version-635133 kubelet[665]: E0606 21:34:52.239024 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.427440 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:53 old-k8s-version-635133 kubelet[665]: E0606 21:34:53.127032 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.428233 480289 logs.go:138] Found kubelet problem: Jun 06 21:34:56 old-k8s-version-635133 kubelet[665]: E0606 21:34:56.647302 665 pod_workers.go:191] Error syncing pod c63c8f50-421c-482f-92bc-d85adc05f868 ("storage-provisioner_kube-system(c63c8f50-421c-482f-92bc-d85adc05f868)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(c63c8f50-421c-482f-92bc-d85adc05f868)"
W0606 21:39:54.431217 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:05 old-k8s-version-635133 kubelet[665]: E0606 21:35:05.158334 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0606 21:39:54.431760 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:05 old-k8s-version-635133 kubelet[665]: E0606 21:35:05.663396 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.432219 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:12 old-k8s-version-635133 kubelet[665]: E0606 21:35:12.235777 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.432413 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:18 old-k8s-version-635133 kubelet[665]: E0606 21:35:18.126778 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.432737 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:23 old-k8s-version-635133 kubelet[665]: E0606 21:35:23.128320 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.432923 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:31 old-k8s-version-635133 kubelet[665]: E0606 21:35:31.138734 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.433504 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:38 old-k8s-version-635133 kubelet[665]: E0606 21:35:38.731622 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.433684 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:42 old-k8s-version-635133 kubelet[665]: E0606 21:35:42.126805 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.434006 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:42 old-k8s-version-635133 kubelet[665]: E0606 21:35:42.235385 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.436456 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:53 old-k8s-version-635133 kubelet[665]: E0606 21:35:53.138355 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0606 21:39:54.436781 480289 logs.go:138] Found kubelet problem: Jun 06 21:35:56 old-k8s-version-635133 kubelet[665]: E0606 21:35:56.125964 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.436962 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:04 old-k8s-version-635133 kubelet[665]: E0606 21:36:04.126648 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.437284 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:08 old-k8s-version-635133 kubelet[665]: E0606 21:36:08.126063 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.437464 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:15 old-k8s-version-635133 kubelet[665]: E0606 21:36:15.136574 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.438049 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:21 old-k8s-version-635133 kubelet[665]: E0606 21:36:21.817649 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.438373 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:22 old-k8s-version-635133 kubelet[665]: E0606 21:36:22.820427 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.442666 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:28 old-k8s-version-635133 kubelet[665]: E0606 21:36:28.126190 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.443038 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:36 old-k8s-version-635133 kubelet[665]: E0606 21:36:36.126087 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.443245 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:43 old-k8s-version-635133 kubelet[665]: E0606 21:36:43.133902 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.443595 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:48 old-k8s-version-635133 kubelet[665]: E0606 21:36:48.126041 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.443800 480289 logs.go:138] Found kubelet problem: Jun 06 21:36:58 old-k8s-version-635133 kubelet[665]: E0606 21:36:58.126341 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.444158 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:02 old-k8s-version-635133 kubelet[665]: E0606 21:37:02.126150 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.444362 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:09 old-k8s-version-635133 kubelet[665]: E0606 21:37:09.126426 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.444714 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:17 old-k8s-version-635133 kubelet[665]: E0606 21:37:17.126552 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.447402 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:21 old-k8s-version-635133 kubelet[665]: E0606 21:37:21.135241 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0606 21:39:54.447798 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:31 old-k8s-version-635133 kubelet[665]: E0606 21:37:31.125964 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.448044 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:35 old-k8s-version-635133 kubelet[665]: E0606 21:37:35.126779 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.448982 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:43 old-k8s-version-635133 kubelet[665]: E0606 21:37:43.971305 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.449378 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:47 old-k8s-version-635133 kubelet[665]: E0606 21:37:47.127768 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.449738 480289 logs.go:138] Found kubelet problem: Jun 06 21:37:52 old-k8s-version-635133 kubelet[665]: E0606 21:37:52.235958 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.449944 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:00 old-k8s-version-635133 kubelet[665]: E0606 21:38:00.129638 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.450302 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:03 old-k8s-version-635133 kubelet[665]: E0606 21:38:03.129877 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.450519 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:14 old-k8s-version-635133 kubelet[665]: E0606 21:38:14.126311 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.451121 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:17 old-k8s-version-635133 kubelet[665]: E0606 21:38:17.126684 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.451338 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:29 old-k8s-version-635133 kubelet[665]: E0606 21:38:29.129822 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.451688 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:32 old-k8s-version-635133 kubelet[665]: E0606 21:38:32.125998 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.451908 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:42 old-k8s-version-635133 kubelet[665]: E0606 21:38:42.127143 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.452254 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:44 old-k8s-version-635133 kubelet[665]: E0606 21:38:44.126008 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.452459 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:53 old-k8s-version-635133 kubelet[665]: E0606 21:38:53.127225 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.452816 480289 logs.go:138] Found kubelet problem: Jun 06 21:38:58 old-k8s-version-635133 kubelet[665]: E0606 21:38:58.126016 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.453005 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:06 old-k8s-version-635133 kubelet[665]: E0606 21:39:06.126631 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.453383 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:09 old-k8s-version-635133 kubelet[665]: E0606 21:39:09.135005 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.453573 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:18 old-k8s-version-635133 kubelet[665]: E0606 21:39:18.126566 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.453907 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:20 old-k8s-version-635133 kubelet[665]: E0606 21:39:20.127031 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.454096 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:30 old-k8s-version-635133 kubelet[665]: E0606 21:39:30.126719 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.454424 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:33 old-k8s-version-635133 kubelet[665]: E0606 21:39:33.126559 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:54.454637 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:44 old-k8s-version-635133 kubelet[665]: E0606 21:39:44.126752 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:54.455006 480289 logs.go:138] Found kubelet problem: Jun 06 21:39:46 old-k8s-version-635133 kubelet[665]: E0606 21:39:46.127359 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
I0606 21:39:54.455020 480289 logs.go:123] Gathering logs for describe nodes ...
I0606 21:39:54.455046 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0606 21:39:54.653019 480289 logs.go:123] Gathering logs for kindnet [2dac5b249cb881732b5741ed39817b7c23b3f4df26b536557815b70abf3e1d6b] ...
I0606 21:39:54.653051 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2dac5b249cb881732b5741ed39817b7c23b3f4df26b536557815b70abf3e1d6b"
I0606 21:39:54.711514 480289 logs.go:123] Gathering logs for kubernetes-dashboard [f8800ceac902950a4fea28153008bc5a3a52171eb8f28a7e5c4b7b3c9727b18b] ...
I0606 21:39:54.711589 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f8800ceac902950a4fea28153008bc5a3a52171eb8f28a7e5c4b7b3c9727b18b"
I0606 21:39:54.760669 480289 logs.go:123] Gathering logs for storage-provisioner [802abe80141bb9cd9e88dcb018e0323b18eaaa57079e90e1dc9a942c85f05355] ...
I0606 21:39:54.760742 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 802abe80141bb9cd9e88dcb018e0323b18eaaa57079e90e1dc9a942c85f05355"
I0606 21:39:54.816319 480289 logs.go:123] Gathering logs for container status ...
I0606 21:39:54.816389 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0606 21:39:54.921026 480289 logs.go:123] Gathering logs for etcd [36c683ec52ff63ae2e147bf5c0a21d1760c6a0a30b2b13be193810c032c53f64] ...
I0606 21:39:54.921108 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 36c683ec52ff63ae2e147bf5c0a21d1760c6a0a30b2b13be193810c032c53f64"
I0606 21:39:54.988960 480289 logs.go:123] Gathering logs for coredns [77ca58fcab3e446b291be4f6754268bd76dc2fee93422a432640c65fdededbfc] ...
I0606 21:39:54.989032 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 77ca58fcab3e446b291be4f6754268bd76dc2fee93422a432640c65fdededbfc"
I0606 21:39:55.039920 480289 logs.go:123] Gathering logs for kube-proxy [61364cca06a11106b4dcdbc01c72349914e26bf7dc1c81e5a8387007830c6bdb] ...
I0606 21:39:55.039993 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 61364cca06a11106b4dcdbc01c72349914e26bf7dc1c81e5a8387007830c6bdb"
I0606 21:39:55.088587 480289 logs.go:123] Gathering logs for kube-proxy [bee54e91e1fb25a822ac99adb4f1c0003ae7aaefa4107cf384d7143a74247580] ...
I0606 21:39:55.088663 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bee54e91e1fb25a822ac99adb4f1c0003ae7aaefa4107cf384d7143a74247580"
I0606 21:39:55.151433 480289 logs.go:123] Gathering logs for kube-controller-manager [95c850c794fedde40e049f91f9d0e75abf2d7d82c91b38c39e991dd5e3b8af49] ...
I0606 21:39:55.151509 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 95c850c794fedde40e049f91f9d0e75abf2d7d82c91b38c39e991dd5e3b8af49"
I0606 21:39:55.224840 480289 logs.go:123] Gathering logs for kube-controller-manager [52a1b7afe7153c756f497d76cdf3b2515aea9392d68afd3ffec265ed78e8a2d5] ...
I0606 21:39:55.224911 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 52a1b7afe7153c756f497d76cdf3b2515aea9392d68afd3ffec265ed78e8a2d5"
I0606 21:39:55.385698 480289 logs.go:123] Gathering logs for kindnet [988b3d43deecf64d1b76c87a6b2549293b95791fc4c680f5648c990beb49af24] ...
I0606 21:39:55.385773 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 988b3d43deecf64d1b76c87a6b2549293b95791fc4c680f5648c990beb49af24"
I0606 21:39:55.458695 480289 logs.go:123] Gathering logs for dmesg ...
I0606 21:39:55.458765 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0606 21:39:55.481741 480289 logs.go:123] Gathering logs for kube-apiserver [d92e466d4ff93db5deca41ec84d1bf7a858dcb1ce897d06575ffb06ff7a02646] ...
I0606 21:39:55.481814 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d92e466d4ff93db5deca41ec84d1bf7a858dcb1ce897d06575ffb06ff7a02646"
I0606 21:39:55.553346 480289 logs.go:123] Gathering logs for coredns [e55f208de822b91f62dda76170dbc6e8bb26fdbfb117d19eb64f22bd0d14ab55] ...
I0606 21:39:55.553419 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e55f208de822b91f62dda76170dbc6e8bb26fdbfb117d19eb64f22bd0d14ab55"
I0606 21:39:55.610369 480289 logs.go:123] Gathering logs for kube-scheduler [cc0c393556c3d6da8e41b24e8de1e4c2b58dce0feafdd92f3b8db91825500060] ...
I0606 21:39:55.610440 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cc0c393556c3d6da8e41b24e8de1e4c2b58dce0feafdd92f3b8db91825500060"
I0606 21:39:55.666342 480289 logs.go:123] Gathering logs for storage-provisioner [19aaaaf394190c60194c94cf96c5f7a3d7ed7868bf9470d83ccd49ceeb94b496] ...
I0606 21:39:55.666417 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 19aaaaf394190c60194c94cf96c5f7a3d7ed7868bf9470d83ccd49ceeb94b496"
I0606 21:39:55.716641 480289 logs.go:123] Gathering logs for kube-apiserver [3dc1c84feb8a29630e4de6f4eaaf57533c377c5e8e79a0c5e5f93e9f1b5efe09] ...
I0606 21:39:55.716664 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3dc1c84feb8a29630e4de6f4eaaf57533c377c5e8e79a0c5e5f93e9f1b5efe09"
I0606 21:39:55.793626 480289 logs.go:123] Gathering logs for etcd [c29c288b6359fcd41bdf8a354f2e6e05fed74207851ef2e0ffa67bb314ae8d97] ...
I0606 21:39:55.793659 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c29c288b6359fcd41bdf8a354f2e6e05fed74207851ef2e0ffa67bb314ae8d97"
I0606 21:39:55.857600 480289 logs.go:123] Gathering logs for kube-scheduler [17ca7fba4a93bd767c4b56ec20b283ba33353ff205a9275aa8211ba3ebcf8d7b] ...
I0606 21:39:55.857675 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 17ca7fba4a93bd767c4b56ec20b283ba33353ff205a9275aa8211ba3ebcf8d7b"
I0606 21:39:55.906016 480289 logs.go:123] Gathering logs for containerd ...
I0606 21:39:55.906088 480289 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0606 21:39:55.972112 480289 out.go:304] Setting ErrFile to fd 2...
I0606 21:39:55.972181 480289 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0606 21:39:55.972264 480289 out.go:239] X Problems detected in kubelet:
W0606 21:39:55.972390 480289 out.go:239] Jun 06 21:39:20 old-k8s-version-635133 kubelet[665]: E0606 21:39:20.127031 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:55.972465 480289 out.go:239] Jun 06 21:39:30 old-k8s-version-635133 kubelet[665]: E0606 21:39:30.126719 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:55.972501 480289 out.go:239] Jun 06 21:39:33 old-k8s-version-635133 kubelet[665]: E0606 21:39:33.126559 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
W0606 21:39:55.972530 480289 out.go:239] Jun 06 21:39:44 old-k8s-version-635133 kubelet[665]: E0606 21:39:44.126752 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0606 21:39:55.972569 480289 out.go:239] Jun 06 21:39:46 old-k8s-version-635133 kubelet[665]: E0606 21:39:46.127359 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
I0606 21:39:55.972603 480289 out.go:304] Setting ErrFile to fd 2...
I0606 21:39:55.972623 480289 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0606 21:39:56.592982 490214 out.go:204] - Booting up control plane ...
I0606 21:39:56.593098 490214 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0606 21:39:56.593187 490214 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0606 21:39:56.594300 490214 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0606 21:39:56.610432 490214 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0606 21:39:56.611135 490214 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0606 21:39:56.611188 490214 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0606 21:39:56.712193 490214 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0606 21:39:56.712293 490214 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
I0606 21:39:57.713874 490214 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 1.00193306s
I0606 21:39:57.713962 490214 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0606 21:40:04.215873 490214 kubeadm.go:309] [api-check] The API server is healthy after 6.502192932s
I0606 21:40:04.237585 490214 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0606 21:40:04.256481 490214 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0606 21:40:04.282001 490214 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0606 21:40:04.282234 490214 kubeadm.go:309] [mark-control-plane] Marking the node embed-certs-242181 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0606 21:40:04.293485 490214 kubeadm.go:309] [bootstrap-token] Using token: dxcrvd.yjamvbri7eblrf1c
I0606 21:40:04.295987 490214 out.go:204] - Configuring RBAC rules ...
I0606 21:40:04.296110 490214 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0606 21:40:04.302988 490214 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0606 21:40:04.312823 490214 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0606 21:40:04.317366 490214 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0606 21:40:04.321401 490214 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0606 21:40:04.325662 490214 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0606 21:40:04.624819 490214 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0606 21:40:05.062120 490214 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0606 21:40:05.624969 490214 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0606 21:40:05.626237 490214 kubeadm.go:309]
I0606 21:40:05.626316 490214 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0606 21:40:05.626329 490214 kubeadm.go:309]
I0606 21:40:05.626404 490214 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0606 21:40:05.626413 490214 kubeadm.go:309]
I0606 21:40:05.626437 490214 kubeadm.go:309] mkdir -p $HOME/.kube
I0606 21:40:05.626530 490214 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0606 21:40:05.626582 490214 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0606 21:40:05.626591 490214 kubeadm.go:309]
I0606 21:40:05.626643 490214 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0606 21:40:05.626651 490214 kubeadm.go:309]
I0606 21:40:05.626697 490214 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0606 21:40:05.626705 490214 kubeadm.go:309]
I0606 21:40:05.626755 490214 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0606 21:40:05.626854 490214 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0606 21:40:05.626923 490214 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0606 21:40:05.626951 490214 kubeadm.go:309]
I0606 21:40:05.627037 490214 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0606 21:40:05.627114 490214 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0606 21:40:05.627122 490214 kubeadm.go:309]
I0606 21:40:05.627202 490214 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token dxcrvd.yjamvbri7eblrf1c \
I0606 21:40:05.627313 490214 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:ee280d018d30ec297eb3f26fba6a2addd550dc7ae998c8164de378d25eaa5423 \
I0606 21:40:05.627337 490214 kubeadm.go:309] --control-plane
I0606 21:40:05.627344 490214 kubeadm.go:309]
I0606 21:40:05.627426 490214 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0606 21:40:05.627434 490214 kubeadm.go:309]
I0606 21:40:05.627512 490214 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token dxcrvd.yjamvbri7eblrf1c \
I0606 21:40:05.627614 490214 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:ee280d018d30ec297eb3f26fba6a2addd550dc7ae998c8164de378d25eaa5423
I0606 21:40:05.631801 490214 kubeadm.go:309] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1062-aws\n", err: exit status 1
I0606 21:40:05.631930 490214 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0606 21:40:05.631954 490214 cni.go:84] Creating CNI manager for ""
I0606 21:40:05.631963 490214 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0606 21:40:05.634839 490214 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0606 21:40:05.637739 490214 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0606 21:40:05.641655 490214 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.1/kubectl ...
I0606 21:40:05.641673 490214 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
I0606 21:40:05.662138 490214 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0606 21:40:05.973906 480289 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0606 21:40:05.990738 480289 api_server.go:72] duration metric: took 6m0.921423886s to wait for apiserver process to appear ...
I0606 21:40:05.990759 480289 api_server.go:88] waiting for apiserver healthz status ...
I0606 21:40:05.993081 480289 out.go:177]
W0606 21:40:05.996206 480289 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W0606 21:40:05.996227 480289 out.go:239] *
W0606 21:40:05.997460 480289 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0606 21:40:06.002151 480289 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
784c581c3dc7b 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 9f898c4e3fe6d dashboard-metrics-scraper-8d5bb5db8-grsrn
802abe80141bb ba04bb24b9575 4 minutes ago Running storage-provisioner 3 ebd2f947ea314 storage-provisioner
f8800ceac9029 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 b846b0eea95f9 kubernetes-dashboard-cd95d586-9s26k
e55f208de822b db91994f4ee8f 5 minutes ago Running coredns 1 1b1aa3eccbaaa coredns-74ff55c5b-k84pg
f2ef2d27f26fd 1611cd07b61d5 5 minutes ago Running busybox 1 553214299ceb7 busybox
19aaaaf394190 ba04bb24b9575 5 minutes ago Exited storage-provisioner 2 ebd2f947ea314 storage-provisioner
61364cca06a11 25a5233254979 5 minutes ago Running kube-proxy 1 3b486836f4099 kube-proxy-7wjhq
2dac5b249cb88 89d73d416b992 5 minutes ago Running kindnet-cni 1 7371b28392f64 kindnet-jbj77
17ca7fba4a93b e7605f88f17d6 5 minutes ago Running kube-scheduler 1 ccc223e702ee5 kube-scheduler-old-k8s-version-635133
d92e466d4ff93 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 fdc77e4cbab84 kube-apiserver-old-k8s-version-635133
c29c288b6359f 05b738aa1bc63 5 minutes ago Running etcd 1 6bf5d830c5628 etcd-old-k8s-version-635133
95c850c794fed 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 3f4fe8de12787 kube-controller-manager-old-k8s-version-635133
7cac05336f322 1611cd07b61d5 6 minutes ago Exited busybox 0 1d5967056644f busybox
77ca58fcab3e4 db91994f4ee8f 8 minutes ago Exited coredns 0 7a3d228173838 coredns-74ff55c5b-k84pg
988b3d43deecf 89d73d416b992 8 minutes ago Exited kindnet-cni 0 98146c2d810a9 kindnet-jbj77
bee54e91e1fb2 25a5233254979 8 minutes ago Exited kube-proxy 0 816767d57adac kube-proxy-7wjhq
36c683ec52ff6 05b738aa1bc63 8 minutes ago Exited etcd 0 be46d98508dba etcd-old-k8s-version-635133
3dc1c84feb8a2 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 45982d74d07f8 kube-apiserver-old-k8s-version-635133
52a1b7afe7153 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 91550f37597ad kube-controller-manager-old-k8s-version-635133
cc0c393556c3d e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 4f7b0cc69e90c kube-scheduler-old-k8s-version-635133
==> containerd <==
Jun 06 21:35:53 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:35:53.135295188Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Jun 06 21:35:53 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:35:53.137378676Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jun 06 21:36:21 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:36:21.129015003Z" level=info msg="CreateContainer within sandbox \"9f898c4e3fe6dfd7bbba7e0559fc3e2088f54677cb297b186cc6e69bf8d85737\" for container &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:4,}"
Jun 06 21:36:21 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:36:21.153520201Z" level=info msg="CreateContainer within sandbox \"9f898c4e3fe6dfd7bbba7e0559fc3e2088f54677cb297b186cc6e69bf8d85737\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:4,} returns container id \"ecd89b1db1690e8c1d4349a34718e40e385a1f2e8f3175564f3c532b854b9cb3\""
Jun 06 21:36:21 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:36:21.154168448Z" level=info msg="StartContainer for \"ecd89b1db1690e8c1d4349a34718e40e385a1f2e8f3175564f3c532b854b9cb3\""
Jun 06 21:36:21 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:36:21.238663164Z" level=info msg="StartContainer for \"ecd89b1db1690e8c1d4349a34718e40e385a1f2e8f3175564f3c532b854b9cb3\" returns successfully"
Jun 06 21:36:21 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:36:21.266370830Z" level=info msg="shim disconnected" id=ecd89b1db1690e8c1d4349a34718e40e385a1f2e8f3175564f3c532b854b9cb3
Jun 06 21:36:21 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:36:21.267064427Z" level=warning msg="cleaning up after shim disconnected" id=ecd89b1db1690e8c1d4349a34718e40e385a1f2e8f3175564f3c532b854b9cb3 namespace=k8s.io
Jun 06 21:36:21 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:36:21.267094014Z" level=info msg="cleaning up dead shim"
Jun 06 21:36:21 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:36:21.275243949Z" level=warning msg="cleanup warnings time=\"2024-06-06T21:36:21Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2930 runtime=io.containerd.runc.v2\n"
Jun 06 21:36:21 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:36:21.818255190Z" level=info msg="RemoveContainer for \"a4c66e9d4b78bd94a02c24b70a0daaccfc23a01c34c7a0bac589529e9d198b1d\""
Jun 06 21:36:21 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:36:21.824588611Z" level=info msg="RemoveContainer for \"a4c66e9d4b78bd94a02c24b70a0daaccfc23a01c34c7a0bac589529e9d198b1d\" returns successfully"
Jun 06 21:37:21 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:37:21.127237454Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 06 21:37:21 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:37:21.132725753Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Jun 06 21:37:21 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:37:21.134554010Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jun 06 21:37:43 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:37:43.132346458Z" level=info msg="CreateContainer within sandbox \"9f898c4e3fe6dfd7bbba7e0559fc3e2088f54677cb297b186cc6e69bf8d85737\" for container &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,}"
Jun 06 21:37:43 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:37:43.147262902Z" level=info msg="CreateContainer within sandbox \"9f898c4e3fe6dfd7bbba7e0559fc3e2088f54677cb297b186cc6e69bf8d85737\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,} returns container id \"784c581c3dc7b788767e3b8929a8add4a5134b974914f050b6fcd35d23dd3a0a\""
Jun 06 21:37:43 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:37:43.147998132Z" level=info msg="StartContainer for \"784c581c3dc7b788767e3b8929a8add4a5134b974914f050b6fcd35d23dd3a0a\""
Jun 06 21:37:43 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:37:43.208995959Z" level=info msg="StartContainer for \"784c581c3dc7b788767e3b8929a8add4a5134b974914f050b6fcd35d23dd3a0a\" returns successfully"
Jun 06 21:37:43 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:37:43.232534779Z" level=info msg="shim disconnected" id=784c581c3dc7b788767e3b8929a8add4a5134b974914f050b6fcd35d23dd3a0a
Jun 06 21:37:43 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:37:43.232594355Z" level=warning msg="cleaning up after shim disconnected" id=784c581c3dc7b788767e3b8929a8add4a5134b974914f050b6fcd35d23dd3a0a namespace=k8s.io
Jun 06 21:37:43 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:37:43.232606950Z" level=info msg="cleaning up dead shim"
Jun 06 21:37:43 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:37:43.241085138Z" level=warning msg="cleanup warnings time=\"2024-06-06T21:37:43Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3164 runtime=io.containerd.runc.v2\n"
Jun 06 21:37:43 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:37:43.972220435Z" level=info msg="RemoveContainer for \"ecd89b1db1690e8c1d4349a34718e40e385a1f2e8f3175564f3c532b854b9cb3\""
Jun 06 21:37:43 old-k8s-version-635133 containerd[570]: time="2024-06-06T21:37:43.977238480Z" level=info msg="RemoveContainer for \"ecd89b1db1690e8c1d4349a34718e40e385a1f2e8f3175564f3c532b854b9cb3\" returns successfully"
==> coredns [77ca58fcab3e446b291be4f6754268bd76dc2fee93422a432640c65fdededbfc] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:59844 - 2810 "HINFO IN 5204260609964251244.67778910971192957. udp 55 false 512" NXDOMAIN qr,rd,ra 55 0.011979372s
==> coredns [e55f208de822b91f62dda76170dbc6e8bb26fdbfb117d19eb64f22bd0d14ab55] <==
[INFO] plugin/ready: Still waiting on: "kubernetes"
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:60095 - 12698 "HINFO IN 2387876309221086133.4002433358869557853. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.034199813s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0606 21:34:56.031457 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-06 21:34:26.029935562 +0000 UTC m=+0.030039043) (total time: 30.001418567s):
Trace[2019727887]: [30.001418567s] [30.001418567s] END
E0606 21:34:56.031564 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0606 21:34:56.031663 1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-06 21:34:26.029943882 +0000 UTC m=+0.030047371) (total time: 30.001456983s):
Trace[1427131847]: [30.001456983s] [30.001456983s] END
E0606 21:34:56.031727 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0606 21:34:56.031923 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-06 21:34:26.029997075 +0000 UTC m=+0.030100564) (total time: 30.001912928s):
Trace[911902081]: [30.001912928s] [30.001912928s] END
E0606 21:34:56.032051 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> describe nodes <==
Name: old-k8s-version-635133
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-635133
kubernetes.io/os=linux
minikube.k8s.io/commit=1d3094f03029ab5769708fc728f21ba50166772b
minikube.k8s.io/name=old-k8s-version-635133
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_06_06T21_31_20_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 06 Jun 2024 21:31:16 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-635133
AcquireTime: <unset>
RenewTime: Thu, 06 Jun 2024 21:40:06 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 06 Jun 2024 21:35:14 +0000 Thu, 06 Jun 2024 21:31:10 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 06 Jun 2024 21:35:14 +0000 Thu, 06 Jun 2024 21:31:10 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 06 Jun 2024 21:35:14 +0000 Thu, 06 Jun 2024 21:31:10 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 06 Jun 2024 21:35:14 +0000 Thu, 06 Jun 2024 21:31:35 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-635133
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022444Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022444Ki
pods: 110
System Info:
Machine ID: 688eb81533d7446884c04771b722cff9
System UUID: 6ee4e585-ef9e-437d-81cc-39ff848355e9
Boot ID: de3a23d4-4f46-4969-803c-b6db61869a6e
Kernel Version: 5.15.0-1062-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.6.33
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m34s
kube-system coredns-74ff55c5b-k84pg 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m33s
kube-system etcd-old-k8s-version-635133 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m39s
kube-system kindnet-jbj77 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m32s
kube-system kube-apiserver-old-k8s-version-635133 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m39s
kube-system kube-controller-manager-old-k8s-version-635133 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m39s
kube-system kube-proxy-7wjhq 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m32s
kube-system kube-scheduler-old-k8s-version-635133 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m39s
kube-system metrics-server-9975d5f86-g6m7v 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m22s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m31s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-grsrn 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m26s
kubernetes-dashboard kubernetes-dashboard-cd95d586-9s26k 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m26s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m58s (x4 over 8m58s) kubelet Node old-k8s-version-635133 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m58s (x4 over 8m58s) kubelet Node old-k8s-version-635133 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m58s (x3 over 8m58s) kubelet Node old-k8s-version-635133 status is now: NodeHasSufficientPID
Normal Starting 8m40s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m39s kubelet Node old-k8s-version-635133 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m39s kubelet Node old-k8s-version-635133 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m39s kubelet Node old-k8s-version-635133 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m39s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m32s kubelet Node old-k8s-version-635133 status is now: NodeReady
Normal Starting 8m30s kube-proxy Starting kube-proxy.
Normal Starting 5m55s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m54s (x8 over 5m54s) kubelet Node old-k8s-version-635133 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m54s (x8 over 5m54s) kubelet Node old-k8s-version-635133 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m54s (x7 over 5m54s) kubelet Node old-k8s-version-635133 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m54s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m41s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000675] FS-Cache: N-cookie c=0000001e [p=00000015 fl=2 nc=0 na=1]
[ +0.000927] FS-Cache: N-cookie d=00000000a925e2b1{9p.inode} n=00000000fe4988dd
[ +0.000996] FS-Cache: N-key=[8] 'da3a5c0100000000'
[ +0.003282] FS-Cache: Duplicate cookie detected
[ +0.000655] FS-Cache: O-cookie c=00000018 [p=00000015 fl=226 nc=0 na=1]
[ +0.000923] FS-Cache: O-cookie d=00000000a925e2b1{9p.inode} n=000000001b7eba98
[ +0.001009] FS-Cache: O-key=[8] 'da3a5c0100000000'
[ +0.000723] FS-Cache: N-cookie c=0000001f [p=00000015 fl=2 nc=0 na=1]
[ +0.000890] FS-Cache: N-cookie d=00000000a925e2b1{9p.inode} n=00000000b6a521c9
[ +0.001000] FS-Cache: N-key=[8] 'da3a5c0100000000'
[ +1.570342] FS-Cache: Duplicate cookie detected
[ +0.000673] FS-Cache: O-cookie c=00000016 [p=00000015 fl=226 nc=0 na=1]
[ +0.000916] FS-Cache: O-cookie d=00000000a925e2b1{9p.inode} n=000000001ee1b167
[ +0.000999] FS-Cache: O-key=[8] 'd93a5c0100000000'
[ +0.000673] FS-Cache: N-cookie c=00000021 [p=00000015 fl=2 nc=0 na=1]
[ +0.000961] FS-Cache: N-cookie d=00000000a925e2b1{9p.inode} n=00000000daa9d68a
[ +0.001024] FS-Cache: N-key=[8] 'd93a5c0100000000'
[ +0.274697] FS-Cache: Duplicate cookie detected
[ +0.000696] FS-Cache: O-cookie c=0000001b [p=00000015 fl=226 nc=0 na=1]
[ +0.000925] FS-Cache: O-cookie d=00000000a925e2b1{9p.inode} n=00000000d01855e1
[ +0.001022] FS-Cache: O-key=[8] 'df3a5c0100000000'
[ +0.000682] FS-Cache: N-cookie c=00000022 [p=00000015 fl=2 nc=0 na=1]
[ +0.000924] FS-Cache: N-cookie d=00000000a925e2b1{9p.inode} n=00000000823ace91
[ +0.001001] FS-Cache: N-key=[8] 'df3a5c0100000000'
[Jun 6 21:33] systemd-journald[222]: Failed to send WATCHDOG=1 notification message: Connection refused
==> etcd [36c683ec52ff63ae2e147bf5c0a21d1760c6a0a30b2b13be193810c032c53f64] <==
raft2024/06/06 21:31:10 INFO: 9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2
raft2024/06/06 21:31:10 INFO: 9f0758e1c58a86ed became leader at term 2
raft2024/06/06 21:31:10 INFO: raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2
2024-06-06 21:31:10.790862 I | etcdserver: published {Name:old-k8s-version-635133 ClientURLs:[https://192.168.85.2:2379]} to cluster 68eaea490fab4e05
2024-06-06 21:31:10.791062 I | embed: ready to serve client requests
2024-06-06 21:31:10.791318 I | embed: ready to serve client requests
2024-06-06 21:31:10.791486 I | etcdserver: setting up the initial cluster version to 3.4
2024-06-06 21:31:10.793730 N | etcdserver/membership: set the initial cluster version to 3.4
2024-06-06 21:31:10.793840 I | etcdserver/api: enabled capabilities for version 3.4
2024-06-06 21:31:10.795189 I | embed: serving client requests on 192.168.85.2:2379
2024-06-06 21:31:10.834378 I | embed: serving client requests on 127.0.0.1:2379
2024-06-06 21:31:29.872005 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:31:39.522764 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:31:49.522848 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:31:59.522719 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:32:09.522732 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:32:19.522746 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:32:29.522744 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:32:39.522798 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:32:49.522733 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:32:59.522892 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:33:09.524374 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:33:19.522937 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:33:29.522868 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:33:39.522766 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [c29c288b6359fcd41bdf8a354f2e6e05fed74207851ef2e0ffa67bb314ae8d97] <==
2024-06-06 21:36:00.024493 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:36:10.017096 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:36:20.016850 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:36:30.021552 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:36:40.017035 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:36:50.016836 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:37:00.019377 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:37:10.017006 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:37:20.016972 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:37:30.020851 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:37:40.017374 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:37:50.016943 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:38:00.020311 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:38:10.017069 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:38:20.017082 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:38:30.018412 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:38:40.017091 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:38:50.016958 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:39:00.024210 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:39:10.017008 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:39:20.016900 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:39:30.021100 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:39:40.020052 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:39:50.016972 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-06 21:40:00.027064 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
21:40:07 up 2:22, 0 users, load average: 1.84, 1.70, 2.26
Linux old-k8s-version-635133 5.15.0-1062-aws #68~20.04.1-Ubuntu SMP Tue May 7 11:50:35 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [2dac5b249cb881732b5741ed39817b7c23b3f4df26b536557815b70abf3e1d6b] <==
I0606 21:38:06.145554 1 main.go:227] handling current node
I0606 21:38:16.159945 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:38:16.159975 1 main.go:227] handling current node
I0606 21:38:26.167062 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:38:26.167094 1 main.go:227] handling current node
I0606 21:38:36.180322 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:38:36.180349 1 main.go:227] handling current node
I0606 21:38:46.188895 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:38:46.188923 1 main.go:227] handling current node
I0606 21:38:56.194950 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:38:56.194978 1 main.go:227] handling current node
I0606 21:39:06.208355 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:39:06.208559 1 main.go:227] handling current node
I0606 21:39:16.220541 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:39:16.220570 1 main.go:227] handling current node
I0606 21:39:26.226240 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:39:26.226267 1 main.go:227] handling current node
I0606 21:39:36.238789 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:39:36.238909 1 main.go:227] handling current node
I0606 21:39:46.252121 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:39:46.252305 1 main.go:227] handling current node
I0606 21:39:56.282659 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:39:56.282848 1 main.go:227] handling current node
I0606 21:40:06.438719 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:40:06.438745 1 main.go:227] handling current node
==> kindnet [988b3d43deecf64d1b76c87a6b2549293b95791fc4c680f5648c990beb49af24] <==
I0606 21:31:38.730709 1 main.go:227] handling current node
I0606 21:31:48.755227 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:31:48.755459 1 main.go:227] handling current node
I0606 21:31:58.763119 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:31:58.763145 1 main.go:227] handling current node
I0606 21:32:08.771902 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:32:08.771927 1 main.go:227] handling current node
I0606 21:32:18.789147 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:32:18.789181 1 main.go:227] handling current node
I0606 21:32:28.806732 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:32:28.806814 1 main.go:227] handling current node
I0606 21:32:38.815975 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:32:38.816009 1 main.go:227] handling current node
I0606 21:32:48.832946 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:32:48.832973 1 main.go:227] handling current node
I0606 21:32:58.845347 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:32:58.845382 1 main.go:227] handling current node
I0606 21:33:08.862272 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:33:08.862299 1 main.go:227] handling current node
I0606 21:33:18.883184 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:33:18.883210 1 main.go:227] handling current node
I0606 21:33:28.899784 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:33:28.899826 1 main.go:227] handling current node
I0606 21:33:38.910829 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0606 21:33:38.910857 1 main.go:227] handling current node
==> kube-apiserver [3dc1c84feb8a29630e4de6f4eaaf57533c377c5e8e79a0c5e5f93e9f1b5efe09] <==
I0606 21:31:17.399809 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0606 21:31:17.846646 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0606 21:31:17.898972 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0606 21:31:18.054151 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
I0606 21:31:18.055455 1 controller.go:606] quota admission added evaluator for: endpoints
I0606 21:31:18.067327 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0606 21:31:19.011701 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0606 21:31:19.545112 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0606 21:31:19.619288 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0606 21:31:28.004846 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0606 21:31:34.948422 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0606 21:31:35.148329 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0606 21:31:54.203563 1 client.go:360] parsed scheme: "passthrough"
I0606 21:31:54.203606 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0606 21:31:54.203615 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0606 21:32:27.140994 1 client.go:360] parsed scheme: "passthrough"
I0606 21:32:27.141157 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0606 21:32:27.141270 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0606 21:33:03.203495 1 client.go:360] parsed scheme: "passthrough"
I0606 21:33:03.203564 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0606 21:33:03.203573 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0606 21:33:40.083762 1 client.go:360] parsed scheme: "passthrough"
I0606 21:33:40.083807 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0606 21:33:40.083816 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
E0606 21:33:44.497883 1 available_controller.go:508] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again
==> kube-apiserver [d92e466d4ff93db5deca41ec84d1bf7a858dcb1ce897d06575ffb06ff7a02646] <==
I0606 21:36:41.531813 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0606 21:36:41.531821 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0606 21:37:14.844252 1 client.go:360] parsed scheme: "passthrough"
I0606 21:37:14.844297 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0606 21:37:14.844307 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0606 21:37:26.499708 1 handler_proxy.go:102] no RequestInfo found in the context
E0606 21:37:26.499852 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0606 21:37:26.499869 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0606 21:37:50.729841 1 client.go:360] parsed scheme: "passthrough"
I0606 21:37:50.729906 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0606 21:37:50.729915 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0606 21:38:24.580146 1 client.go:360] parsed scheme: "passthrough"
I0606 21:38:24.580187 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0606 21:38:24.580197 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0606 21:39:02.570569 1 client.go:360] parsed scheme: "passthrough"
I0606 21:39:02.570616 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0606 21:39:02.570624 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0606 21:39:24.687031 1 handler_proxy.go:102] no RequestInfo found in the context
E0606 21:39:24.687244 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0606 21:39:24.687261 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0606 21:39:47.251264 1 client.go:360] parsed scheme: "passthrough"
I0606 21:39:47.251477 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0606 21:39:47.251580 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [52a1b7afe7153c756f497d76cdf3b2515aea9392d68afd3ffec265ed78e8a2d5] <==
I0606 21:31:35.120685 1 shared_informer.go:247] Caches are synced for taint
I0606 21:31:35.126601 1 node_lifecycle_controller.go:1429] Initializing eviction metric for zone:
W0606 21:31:35.126696 1 node_lifecycle_controller.go:1044] Missing timestamp for Node old-k8s-version-635133. Assuming now as a timestamp.
I0606 21:31:35.126735 1 node_lifecycle_controller.go:1245] Controller detected that zone is now in state Normal.
I0606 21:31:35.127055 1 shared_informer.go:247] Caches are synced for attach detach
I0606 21:31:35.141051 1 taint_manager.go:187] Starting NoExecuteTaintManager
I0606 21:31:35.141472 1 event.go:291] "Event occurred" object="old-k8s-version-635133" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-635133 event: Registered Node old-k8s-version-635133 in Controller"
I0606 21:31:35.162845 1 shared_informer.go:247] Caches are synced for persistent volume
I0606 21:31:35.179123 1 shared_informer.go:247] Caches are synced for PV protection
I0606 21:31:35.184133 1 shared_informer.go:247] Caches are synced for expand
I0606 21:31:35.199390 1 request.go:655] Throttling request took 1.01548445s, request: GET:https://192.168.85.2:8443/apis/rbac.authorization.k8s.io/v1?timeout=32s
I0606 21:31:35.244898 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-jbj77"
I0606 21:31:35.256072 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-7wjhq"
I0606 21:31:35.291350 1 shared_informer.go:247] Caches are synced for resource quota
E0606 21:31:35.307456 1 daemon_controller.go:320] kube-system/kindnet failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kindnet", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"9d11cbdf-e022-46a9-b49a-bf76bc4b8abb", ResourceVersion:"273", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63853306280, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"},\"name\":\"kindnet\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"app\":\"k
indnet\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"}},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"HOST_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.hostIP\"}}},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"POD_SUBNET\",\"value\":\"10.244.0.0/16\"}],\"image\":\"docker.io/kindest/kindnetd:v20240513-cd2ac642\",\"name\":\"kindnet-cni\",\"resources\":{\"limits\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"}},\"securityContext\":{\"capabilities\":{\"add\":[\"NET_RAW\",\"NET_ADMIN\"]},\"privileged\":false},\"volumeMounts\":[{\"mountPath\":\"/etc/cni/net.d\",\"name\":\"cni-cfg\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\",\"readOnly\":false},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\",\"readOnly\":true}]}],\"hostNetwork\":true,\"serviceAccountName\":\"kindnet\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\
":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/etc/cni/net.d\",\"type\":\"DirectoryOrCreate\"},\"name\":\"cni-cfg\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"}]}}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001afdd60), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001afdd80)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4001afdda0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string
{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"cni-cfg", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001afddc0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil),
FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001afdde0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Glust
erfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001afde00), EmptyDi
r:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil),
PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kindnet-cni", Image:"docker.io/kindest/kindnetd:v20240513-cd2ac642", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOST_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001afde20)}, v1.EnvVar{Name:"POD_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001afde60)}, v1.EnvVar{Name:"POD_SUBNET", Value:"10.244.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:
0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-cfg", ReadOnly:false, MountPath:"/etc/cni/net.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:
(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001bd0420), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4001bd8608), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"kindnet", DeprecatedServiceAccount:"kindnet", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40004df0a0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}},
HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x4000114388)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4001bd8650)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kindnet": the object has been modified; please apply your changes to the latest version and try again
E0606 21:31:35.311470 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"a4492dfa-f00a-4cdb-b836-25085dc02d51", ResourceVersion:"260", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63853306279, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001afdc40), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001afdc60)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0x4001afdc80), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x4001af7980), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001afd
ca0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001afdcc0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001afdd00)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001bd03c0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4001bd83b8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40004df030), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x4000114380)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4001bd8408)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
I0606 21:31:35.336933 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0606 21:31:35.637122 1 shared_informer.go:247] Caches are synced for garbage collector
I0606 21:31:35.662040 1 shared_informer.go:247] Caches are synced for garbage collector
I0606 21:31:35.662071 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0606 21:31:36.034702 1 shared_informer.go:240] Waiting for caches to sync for resource quota
I0606 21:31:36.034738 1 shared_informer.go:247] Caches are synced for resource quota
I0606 21:31:36.475264 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0606 21:31:36.541617 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-8lrhs"
I0606 21:33:44.160862 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
==> kube-controller-manager [95c850c794fedde40e049f91f9d0e75abf2d7d82c91b38c39e991dd5e3b8af49] <==
W0606 21:35:47.337472 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0606 21:36:13.385489 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0606 21:36:18.987921 1 request.go:655] Throttling request took 1.048311032s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0606 21:36:19.839284 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0606 21:36:43.887421 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0606 21:36:51.489695 1 request.go:655] Throttling request took 1.048496096s, request: GET:https://192.168.85.2:8443/apis/authentication.k8s.io/v1beta1?timeout=32s
W0606 21:36:52.341071 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0606 21:37:14.389487 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0606 21:37:23.991475 1 request.go:655] Throttling request took 1.048173783s, request: GET:https://192.168.85.2:8443/apis/scheduling.k8s.io/v1beta1?timeout=32s
W0606 21:37:24.884729 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0606 21:37:44.891349 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0606 21:37:56.535208 1 request.go:655] Throttling request took 1.048225379s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0606 21:37:57.386945 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0606 21:38:15.393170 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0606 21:38:29.038010 1 request.go:655] Throttling request took 1.049132839s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0606 21:38:29.888708 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0606 21:38:45.895137 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0606 21:39:01.539231 1 request.go:655] Throttling request took 1.047818729s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0606 21:39:02.390614 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0606 21:39:16.396967 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0606 21:39:34.041000 1 request.go:655] Throttling request took 1.040049969s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0606 21:39:34.892409 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0606 21:39:46.898943 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0606 21:40:06.543077 1 request.go:655] Throttling request took 1.047990355s, request: GET:https://192.168.85.2:8443/apis/policy/v1beta1?timeout=32s
W0606 21:40:07.394570 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [61364cca06a11106b4dcdbc01c72349914e26bf7dc1c81e5a8387007830c6bdb] <==
I0606 21:34:26.084165 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0606 21:34:26.084231 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0606 21:34:26.104466 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0606 21:34:26.104554 1 server_others.go:185] Using iptables Proxier.
I0606 21:34:26.104775 1 server.go:650] Version: v1.20.0
I0606 21:34:26.105373 1 config.go:224] Starting endpoint slice config controller
I0606 21:34:26.105545 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0606 21:34:26.105745 1 config.go:315] Starting service config controller
I0606 21:34:26.105839 1 shared_informer.go:240] Waiting for caches to sync for service config
I0606 21:34:26.205771 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0606 21:34:26.207087 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [bee54e91e1fb25a822ac99adb4f1c0003ae7aaefa4107cf384d7143a74247580] <==
I0606 21:31:36.992305 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0606 21:31:36.992391 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0606 21:31:37.023312 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0606 21:31:37.023411 1 server_others.go:185] Using iptables Proxier.
I0606 21:31:37.023667 1 server.go:650] Version: v1.20.0
I0606 21:31:37.024317 1 config.go:315] Starting service config controller
I0606 21:31:37.024335 1 shared_informer.go:240] Waiting for caches to sync for service config
I0606 21:31:37.024356 1 config.go:224] Starting endpoint slice config controller
I0606 21:31:37.024360 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0606 21:31:37.124713 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0606 21:31:37.124974 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [17ca7fba4a93bd767c4b56ec20b283ba33353ff205a9275aa8211ba3ebcf8d7b] <==
I0606 21:34:17.164933 1 serving.go:331] Generated self-signed cert in-memory
W0606 21:34:23.766401 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0606 21:34:23.768286 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0606 21:34:23.768298 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0606 21:34:23.768305 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0606 21:34:24.143048 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0606 21:34:24.146608 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0606 21:34:24.154210 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0606 21:34:24.154291 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0606 21:34:24.279171 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [cc0c393556c3d6da8e41b24e8de1e4c2b58dce0feafdd92f3b8db91825500060] <==
I0606 21:31:16.585516 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0606 21:31:16.585528 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0606 21:31:16.585563 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0606 21:31:16.588674 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0606 21:31:16.589117 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0606 21:31:16.594384 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0606 21:31:16.594899 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0606 21:31:16.595142 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0606 21:31:16.595336 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0606 21:31:16.595531 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0606 21:31:16.595751 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0606 21:31:16.595991 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0606 21:31:16.596210 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0606 21:31:16.603628 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0606 21:31:16.603882 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0606 21:31:17.414533 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0606 21:31:17.437313 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0606 21:31:17.473459 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0606 21:31:17.503586 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0606 21:31:17.506120 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0606 21:31:17.590736 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0606 21:31:17.670591 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0606 21:31:17.670833 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0606 21:31:17.677613 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
I0606 21:31:20.785668 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Jun 06 21:38:17 old-k8s-version-635133 kubelet[665]: E0606 21:38:17.126684 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
Jun 06 21:38:29 old-k8s-version-635133 kubelet[665]: E0606 21:38:29.129822 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 06 21:38:32 old-k8s-version-635133 kubelet[665]: I0606 21:38:32.125654 665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 784c581c3dc7b788767e3b8929a8add4a5134b974914f050b6fcd35d23dd3a0a
Jun 06 21:38:32 old-k8s-version-635133 kubelet[665]: E0606 21:38:32.125998 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
Jun 06 21:38:42 old-k8s-version-635133 kubelet[665]: E0606 21:38:42.127143 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 06 21:38:44 old-k8s-version-635133 kubelet[665]: I0606 21:38:44.125674 665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 784c581c3dc7b788767e3b8929a8add4a5134b974914f050b6fcd35d23dd3a0a
Jun 06 21:38:44 old-k8s-version-635133 kubelet[665]: E0606 21:38:44.126008 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
Jun 06 21:38:53 old-k8s-version-635133 kubelet[665]: E0606 21:38:53.127225 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 06 21:38:58 old-k8s-version-635133 kubelet[665]: I0606 21:38:58.125668 665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 784c581c3dc7b788767e3b8929a8add4a5134b974914f050b6fcd35d23dd3a0a
Jun 06 21:38:58 old-k8s-version-635133 kubelet[665]: E0606 21:38:58.126016 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
Jun 06 21:39:06 old-k8s-version-635133 kubelet[665]: E0606 21:39:06.126631 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 06 21:39:09 old-k8s-version-635133 kubelet[665]: I0606 21:39:09.129535 665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 784c581c3dc7b788767e3b8929a8add4a5134b974914f050b6fcd35d23dd3a0a
Jun 06 21:39:09 old-k8s-version-635133 kubelet[665]: E0606 21:39:09.135005 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
Jun 06 21:39:18 old-k8s-version-635133 kubelet[665]: E0606 21:39:18.126566 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 06 21:39:20 old-k8s-version-635133 kubelet[665]: I0606 21:39:20.126664 665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 784c581c3dc7b788767e3b8929a8add4a5134b974914f050b6fcd35d23dd3a0a
Jun 06 21:39:20 old-k8s-version-635133 kubelet[665]: E0606 21:39:20.127031 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
Jun 06 21:39:30 old-k8s-version-635133 kubelet[665]: E0606 21:39:30.126719 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 06 21:39:33 old-k8s-version-635133 kubelet[665]: I0606 21:39:33.126140 665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 784c581c3dc7b788767e3b8929a8add4a5134b974914f050b6fcd35d23dd3a0a
Jun 06 21:39:33 old-k8s-version-635133 kubelet[665]: E0606 21:39:33.126559 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
Jun 06 21:39:44 old-k8s-version-635133 kubelet[665]: E0606 21:39:44.126752 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 06 21:39:46 old-k8s-version-635133 kubelet[665]: I0606 21:39:46.125861 665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 784c581c3dc7b788767e3b8929a8add4a5134b974914f050b6fcd35d23dd3a0a
Jun 06 21:39:46 old-k8s-version-635133 kubelet[665]: E0606 21:39:46.127359 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
Jun 06 21:39:59 old-k8s-version-635133 kubelet[665]: E0606 21:39:59.126186 665 pod_workers.go:191] Error syncing pod d259585e-64d2-41c7-b2ca-3e89b02e8fa4 ("metrics-server-9975d5f86-g6m7v_kube-system(d259585e-64d2-41c7-b2ca-3e89b02e8fa4)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 06 21:40:00 old-k8s-version-635133 kubelet[665]: I0606 21:40:00.126064 665 scope.go:95] [topologymanager] RemoveContainer - Container ID: 784c581c3dc7b788767e3b8929a8add4a5134b974914f050b6fcd35d23dd3a0a
Jun 06 21:40:00 old-k8s-version-635133 kubelet[665]: E0606 21:40:00.127309 665 pod_workers.go:191] Error syncing pod 38be0037-e895-4e10-9518-0492285a84e7 ("dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-grsrn_kubernetes-dashboard(38be0037-e895-4e10-9518-0492285a84e7)"
==> kubernetes-dashboard [f8800ceac902950a4fea28153008bc5a3a52171eb8f28a7e5c4b7b3c9727b18b] <==
2024/06/06 21:34:49 Starting overwatch
2024/06/06 21:34:49 Using namespace: kubernetes-dashboard
2024/06/06 21:34:49 Using in-cluster config to connect to apiserver
2024/06/06 21:34:49 Using secret token for csrf signing
2024/06/06 21:34:49 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/06/06 21:34:49 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/06/06 21:34:49 Successful initial request to the apiserver, version: v1.20.0
2024/06/06 21:34:49 Generating JWE encryption key
2024/06/06 21:34:49 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/06/06 21:34:49 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/06/06 21:34:50 Initializing JWE encryption key from synchronized object
2024/06/06 21:34:50 Creating in-cluster Sidecar client
2024/06/06 21:34:50 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/06 21:34:50 Serving insecurely on HTTP port: 9090
2024/06/06 21:35:20 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/06 21:35:50 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/06 21:36:20 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/06 21:36:50 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/06 21:37:20 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/06 21:37:50 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/06 21:38:20 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/06 21:38:50 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/06 21:39:20 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/06 21:39:50 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
==> storage-provisioner [19aaaaf394190c60194c94cf96c5f7a3d7ed7868bf9470d83ccd49ceeb94b496] <==
I0606 21:34:26.088026 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0606 21:34:56.090941 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [802abe80141bb9cd9e88dcb018e0323b18eaaa57079e90e1dc9a942c85f05355] <==
I0606 21:35:11.245882 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0606 21:35:11.260280 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0606 21:35:11.260844 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0606 21:35:28.740166 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0606 21:35:28.740508 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"612e2e76-fa68-40c1-926e-e14cdb786c06", APIVersion:"v1", ResourceVersion:"840", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-635133_8ea7924c-f2d8-44cc-b90a-46ef823ec2cc became leader
I0606 21:35:28.740798 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-635133_8ea7924c-f2d8-44cc-b90a-46ef823ec2cc!
I0606 21:35:28.841206 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-635133_8ea7924c-f2d8-44cc-b90a-46ef823ec2cc!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-635133 -n old-k8s-version-635133
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-635133 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-g6m7v
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-635133 describe pod metrics-server-9975d5f86-g6m7v
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-635133 describe pod metrics-server-9975d5f86-g6m7v: exit status 1 (94.570993ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-g6m7v" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-635133 describe pod metrics-server-9975d5f86-g6m7v: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (372.15s)