=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-920941 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-920941 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 80 (6m8.702360762s)
-- stdout --
* [old-k8s-version-920941] minikube v1.34.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19740
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19740-1745120/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19740-1745120/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.31.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.1
* Using the docker driver based on existing profile
* Starting "old-k8s-version-920941" primary control-plane node in "old-k8s-version-920941" cluster
* Pulling base image v0.0.45-1727731891-master ...
* Restarting existing docker container for "old-k8s-version-920941" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.22 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-920941 addons enable metrics-server
* Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
-- /stdout --
** stderr **
I1002 00:34:29.359696 1957595 out.go:345] Setting OutFile to fd 1 ...
I1002 00:34:29.359904 1957595 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1002 00:34:29.359930 1957595 out.go:358] Setting ErrFile to fd 2...
I1002 00:34:29.359949 1957595 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1002 00:34:29.360208 1957595 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19740-1745120/.minikube/bin
I1002 00:34:29.360675 1957595 out.go:352] Setting JSON to false
I1002 00:34:29.361566 1957595 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":29817,"bootTime":1727799453,"procs":171,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I1002 00:34:29.361657 1957595 start.go:139] virtualization:
I1002 00:34:29.364807 1957595 out.go:177] * [old-k8s-version-920941] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I1002 00:34:29.367964 1957595 out.go:177] - MINIKUBE_LOCATION=19740
I1002 00:34:29.368029 1957595 notify.go:220] Checking for updates...
I1002 00:34:29.376805 1957595 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1002 00:34:29.380511 1957595 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19740-1745120/kubeconfig
I1002 00:34:29.383742 1957595 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19740-1745120/.minikube
I1002 00:34:29.387837 1957595 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I1002 00:34:29.391063 1957595 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1002 00:34:29.394099 1957595 config.go:182] Loaded profile config "old-k8s-version-920941": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I1002 00:34:29.397619 1957595 out.go:177] * Kubernetes 1.31.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.1
I1002 00:34:29.400172 1957595 driver.go:394] Setting default libvirt URI to qemu:///system
I1002 00:34:29.438867 1957595 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I1002 00:34:29.438989 1957595 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 00:34:29.523070 1957595 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:39 OomKillDisable:true NGoroutines:43 SystemTime:2024-10-02 00:34:29.504929527 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I1002 00:34:29.523179 1957595 docker.go:318] overlay module found
I1002 00:34:29.527441 1957595 out.go:177] * Using the docker driver based on existing profile
I1002 00:34:29.530634 1957595 start.go:297] selected driver: docker
I1002 00:34:29.530655 1957595 start.go:901] validating driver "docker" against &{Name:old-k8s-version-920941 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-920941 Namespace:default APIServerHAVIP: A
PIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:f
alse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 00:34:29.530776 1957595 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1002 00:34:29.531384 1957595 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 00:34:29.623235 1957595 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:46 OomKillDisable:true NGoroutines:43 SystemTime:2024-10-02 00:34:29.609070889 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I1002 00:34:29.623649 1957595 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1002 00:34:29.623674 1957595 cni.go:84] Creating CNI manager for ""
I1002 00:34:29.623720 1957595 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1002 00:34:29.623758 1957595 start.go:340] cluster config:
{Name:old-k8s-version-920941 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-920941 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loca
l ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:d
ocker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 00:34:29.630852 1957595 out.go:177] * Starting "old-k8s-version-920941" primary control-plane node in "old-k8s-version-920941" cluster
I1002 00:34:29.633079 1957595 cache.go:121] Beginning downloading kic base image for docker with containerd
I1002 00:34:29.634942 1957595 out.go:177] * Pulling base image v0.0.45-1727731891-master ...
I1002 00:34:29.637414 1957595 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I1002 00:34:29.637475 1957595 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I1002 00:34:29.637486 1957595 cache.go:56] Caching tarball of preloaded images
I1002 00:34:29.637579 1957595 preload.go:172] Found /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I1002 00:34:29.637594 1957595 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I1002 00:34:29.637721 1957595 profile.go:143] Saving config to /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/old-k8s-version-920941/config.json ...
I1002 00:34:29.637933 1957595 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 in local docker daemon
I1002 00:34:29.660549 1957595 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 in local docker daemon, skipping pull
I1002 00:34:29.660582 1957595 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 exists in daemon, skipping load
I1002 00:34:29.660601 1957595 cache.go:194] Successfully downloaded all kic artifacts
I1002 00:34:29.660630 1957595 start.go:360] acquireMachinesLock for old-k8s-version-920941: {Name:mkc21fdd2a9657931b17eac94b6039e94c8c11d8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 00:34:29.660698 1957595 start.go:364] duration metric: took 44.889µs to acquireMachinesLock for "old-k8s-version-920941"
I1002 00:34:29.660721 1957595 start.go:96] Skipping create...Using existing machine configuration
I1002 00:34:29.660730 1957595 fix.go:54] fixHost starting:
I1002 00:34:29.660995 1957595 cli_runner.go:164] Run: docker container inspect old-k8s-version-920941 --format={{.State.Status}}
I1002 00:34:29.678222 1957595 fix.go:112] recreateIfNeeded on old-k8s-version-920941: state=Stopped err=<nil>
W1002 00:34:29.678252 1957595 fix.go:138] unexpected machine state, will restart: <nil>
I1002 00:34:29.682877 1957595 out.go:177] * Restarting existing docker container for "old-k8s-version-920941" ...
I1002 00:34:29.685662 1957595 cli_runner.go:164] Run: docker start old-k8s-version-920941
I1002 00:34:30.089642 1957595 cli_runner.go:164] Run: docker container inspect old-k8s-version-920941 --format={{.State.Status}}
I1002 00:34:30.116480 1957595 kic.go:430] container "old-k8s-version-920941" state is running.
I1002 00:34:30.116897 1957595 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-920941
I1002 00:34:30.177730 1957595 profile.go:143] Saving config to /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/old-k8s-version-920941/config.json ...
I1002 00:34:30.177963 1957595 machine.go:93] provisionDockerMachine start ...
I1002 00:34:30.178031 1957595 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-920941
I1002 00:34:30.222854 1957595 main.go:141] libmachine: Using SSH client type: native
I1002 00:34:30.223421 1957595 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 34955 <nil> <nil>}
I1002 00:34:30.223488 1957595 main.go:141] libmachine: About to run SSH command:
hostname
I1002 00:34:30.224138 1957595 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:56044->127.0.0.1:34955: read: connection reset by peer
I1002 00:34:33.364046 1957595 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-920941
I1002 00:34:33.364075 1957595 ubuntu.go:169] provisioning hostname "old-k8s-version-920941"
I1002 00:34:33.364145 1957595 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-920941
I1002 00:34:33.385514 1957595 main.go:141] libmachine: Using SSH client type: native
I1002 00:34:33.385769 1957595 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 34955 <nil> <nil>}
I1002 00:34:33.385781 1957595 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-920941 && echo "old-k8s-version-920941" | sudo tee /etc/hostname
I1002 00:34:33.540971 1957595 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-920941
I1002 00:34:33.541066 1957595 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-920941
I1002 00:34:33.566600 1957595 main.go:141] libmachine: Using SSH client type: native
I1002 00:34:33.566897 1957595 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 34955 <nil> <nil>}
I1002 00:34:33.566924 1957595 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-920941' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-920941/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-920941' | sudo tee -a /etc/hosts;
fi
fi
I1002 00:34:33.712533 1957595 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1002 00:34:33.712567 1957595 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19740-1745120/.minikube CaCertPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19740-1745120/.minikube}
I1002 00:34:33.712609 1957595 ubuntu.go:177] setting up certificates
I1002 00:34:33.712619 1957595 provision.go:84] configureAuth start
I1002 00:34:33.712690 1957595 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-920941
I1002 00:34:33.738146 1957595 provision.go:143] copyHostCerts
I1002 00:34:33.738217 1957595 exec_runner.go:144] found /home/jenkins/minikube-integration/19740-1745120/.minikube/ca.pem, removing ...
I1002 00:34:33.738240 1957595 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19740-1745120/.minikube/ca.pem
I1002 00:34:33.738299 1957595 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19740-1745120/.minikube/ca.pem (1082 bytes)
I1002 00:34:33.738408 1957595 exec_runner.go:144] found /home/jenkins/minikube-integration/19740-1745120/.minikube/cert.pem, removing ...
I1002 00:34:33.738419 1957595 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19740-1745120/.minikube/cert.pem
I1002 00:34:33.738442 1957595 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19740-1745120/.minikube/cert.pem (1123 bytes)
I1002 00:34:33.738511 1957595 exec_runner.go:144] found /home/jenkins/minikube-integration/19740-1745120/.minikube/key.pem, removing ...
I1002 00:34:33.738521 1957595 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19740-1745120/.minikube/key.pem
I1002 00:34:33.738543 1957595 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19740-1745120/.minikube/key.pem (1675 bytes)
I1002 00:34:33.738639 1957595 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-920941 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-920941]
I1002 00:34:34.039519 1957595 provision.go:177] copyRemoteCerts
I1002 00:34:34.039613 1957595 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1002 00:34:34.039674 1957595 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-920941
I1002 00:34:34.062126 1957595 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34955 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/old-k8s-version-920941/id_rsa Username:docker}
I1002 00:34:34.166187 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1002 00:34:34.195602 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I1002 00:34:34.224423 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1002 00:34:34.263381 1957595 provision.go:87] duration metric: took 550.740825ms to configureAuth
I1002 00:34:34.263405 1957595 ubuntu.go:193] setting minikube options for container-runtime
I1002 00:34:34.263599 1957595 config.go:182] Loaded profile config "old-k8s-version-920941": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I1002 00:34:34.263607 1957595 machine.go:96] duration metric: took 4.085637035s to provisionDockerMachine
I1002 00:34:34.263614 1957595 start.go:293] postStartSetup for "old-k8s-version-920941" (driver="docker")
I1002 00:34:34.263625 1957595 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1002 00:34:34.263680 1957595 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1002 00:34:34.263724 1957595 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-920941
I1002 00:34:34.282285 1957595 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34955 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/old-k8s-version-920941/id_rsa Username:docker}
I1002 00:34:34.379269 1957595 ssh_runner.go:195] Run: cat /etc/os-release
I1002 00:34:34.382715 1957595 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1002 00:34:34.382751 1957595 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I1002 00:34:34.382815 1957595 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I1002 00:34:34.382832 1957595 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I1002 00:34:34.382843 1957595 filesync.go:126] Scanning /home/jenkins/minikube-integration/19740-1745120/.minikube/addons for local assets ...
I1002 00:34:34.382902 1957595 filesync.go:126] Scanning /home/jenkins/minikube-integration/19740-1745120/.minikube/files for local assets ...
I1002 00:34:34.383016 1957595 filesync.go:149] local asset: /home/jenkins/minikube-integration/19740-1745120/.minikube/files/etc/ssl/certs/17505052.pem -> 17505052.pem in /etc/ssl/certs
I1002 00:34:34.383184 1957595 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1002 00:34:34.402249 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/files/etc/ssl/certs/17505052.pem --> /etc/ssl/certs/17505052.pem (1708 bytes)
I1002 00:34:34.437010 1957595 start.go:296] duration metric: took 173.380925ms for postStartSetup
I1002 00:34:34.437154 1957595 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1002 00:34:34.437221 1957595 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-920941
I1002 00:34:34.459043 1957595 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34955 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/old-k8s-version-920941/id_rsa Username:docker}
I1002 00:34:34.553851 1957595 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1002 00:34:34.558437 1957595 fix.go:56] duration metric: took 4.897700305s for fixHost
I1002 00:34:34.558502 1957595 start.go:83] releasing machines lock for "old-k8s-version-920941", held for 4.89779161s
I1002 00:34:34.558584 1957595 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-920941
I1002 00:34:34.575631 1957595 ssh_runner.go:195] Run: cat /version.json
I1002 00:34:34.575687 1957595 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-920941
I1002 00:34:34.575973 1957595 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1002 00:34:34.576044 1957595 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-920941
I1002 00:34:34.601034 1957595 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34955 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/old-k8s-version-920941/id_rsa Username:docker}
I1002 00:34:34.610006 1957595 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34955 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/old-k8s-version-920941/id_rsa Username:docker}
I1002 00:34:34.840401 1957595 ssh_runner.go:195] Run: systemctl --version
I1002 00:34:34.846127 1957595 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1002 00:34:34.851726 1957595 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I1002 00:34:34.887514 1957595 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I1002 00:34:34.887620 1957595 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1002 00:34:34.897640 1957595 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1002 00:34:34.897669 1957595 start.go:495] detecting cgroup driver to use...
I1002 00:34:34.897727 1957595 detect.go:187] detected "cgroupfs" cgroup driver on host os
I1002 00:34:34.897809 1957595 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1002 00:34:34.913896 1957595 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1002 00:34:34.933071 1957595 docker.go:217] disabling cri-docker service (if available) ...
I1002 00:34:34.933167 1957595 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1002 00:34:34.951017 1957595 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1002 00:34:34.965010 1957595 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1002 00:34:35.066549 1957595 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1002 00:34:35.176072 1957595 docker.go:233] disabling docker service ...
I1002 00:34:35.176161 1957595 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1002 00:34:35.190492 1957595 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1002 00:34:35.203417 1957595 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1002 00:34:35.315610 1957595 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1002 00:34:35.416316 1957595 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1002 00:34:35.430982 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1002 00:34:35.450942 1957595 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I1002 00:34:35.462343 1957595 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1002 00:34:35.473511 1957595 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I1002 00:34:35.473629 1957595 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I1002 00:34:35.485404 1957595 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1002 00:34:35.495288 1957595 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1002 00:34:35.514007 1957595 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1002 00:34:35.530074 1957595 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1002 00:34:35.540436 1957595 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1002 00:34:35.550822 1957595 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1002 00:34:35.560282 1957595 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1002 00:34:35.569782 1957595 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 00:34:35.692954 1957595 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1002 00:34:35.910725 1957595 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I1002 00:34:35.910796 1957595 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I1002 00:34:35.915487 1957595 start.go:563] Will wait 60s for crictl version
I1002 00:34:35.915542 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:34:35.921190 1957595 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1002 00:34:35.960952 1957595 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I1002 00:34:35.961023 1957595 ssh_runner.go:195] Run: containerd --version
I1002 00:34:35.987667 1957595 ssh_runner.go:195] Run: containerd --version
I1002 00:34:36.014002 1957595 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.22 ...
I1002 00:34:36.015998 1957595 cli_runner.go:164] Run: docker network inspect old-k8s-version-920941 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1002 00:34:36.030564 1957595 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I1002 00:34:36.034288 1957595 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1002 00:34:36.045315 1957595 kubeadm.go:883] updating cluster {Name:old-k8s-version-920941 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-920941 Namespace:default APIServerHAVIP: APIServerName:mini
kubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:
/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1002 00:34:36.045435 1957595 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I1002 00:34:36.045512 1957595 ssh_runner.go:195] Run: sudo crictl images --output json
I1002 00:34:36.094420 1957595 containerd.go:627] all images are preloaded for containerd runtime.
I1002 00:34:36.094445 1957595 containerd.go:534] Images already preloaded, skipping extraction
I1002 00:34:36.094506 1957595 ssh_runner.go:195] Run: sudo crictl images --output json
I1002 00:34:36.132023 1957595 containerd.go:627] all images are preloaded for containerd runtime.
I1002 00:34:36.132048 1957595 cache_images.go:84] Images are preloaded, skipping loading
I1002 00:34:36.132056 1957595 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I1002 00:34:36.132178 1957595 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-920941 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-920941 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1002 00:34:36.132252 1957595 ssh_runner.go:195] Run: sudo crictl info
I1002 00:34:36.171005 1957595 cni.go:84] Creating CNI manager for ""
I1002 00:34:36.171028 1957595 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1002 00:34:36.171039 1957595 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I1002 00:34:36.171059 1957595 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-920941 NodeName:old-k8s-version-920941 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I1002 00:34:36.171185 1957595 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-920941"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1002 00:34:36.171258 1957595 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I1002 00:34:36.180769 1957595 binaries.go:44] Found k8s binaries, skipping transfer
I1002 00:34:36.180844 1957595 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1002 00:34:36.189910 1957595 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I1002 00:34:36.208616 1957595 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1002 00:34:36.227094 1957595 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I1002 00:34:36.245376 1957595 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I1002 00:34:36.248927 1957595 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1002 00:34:36.259473 1957595 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 00:34:36.352186 1957595 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1002 00:34:36.370496 1957595 certs.go:68] Setting up /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/old-k8s-version-920941 for IP: 192.168.76.2
I1002 00:34:36.370556 1957595 certs.go:194] generating shared ca certs ...
I1002 00:34:36.370586 1957595 certs.go:226] acquiring lock for ca certs: {Name:mkeb93c689dc39169cb991acba6d63d702f9e0e6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 00:34:36.370746 1957595 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/ca.key
I1002 00:34:36.370816 1957595 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/proxy-client-ca.key
I1002 00:34:36.370840 1957595 certs.go:256] generating profile certs ...
I1002 00:34:36.370958 1957595 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/old-k8s-version-920941/client.key
I1002 00:34:36.371056 1957595 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/old-k8s-version-920941/apiserver.key.f2b253d6
I1002 00:34:36.371135 1957595 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/old-k8s-version-920941/proxy-client.key
I1002 00:34:36.371275 1957595 certs.go:484] found cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/1750505.pem (1338 bytes)
W1002 00:34:36.371342 1957595 certs.go:480] ignoring /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/1750505_empty.pem, impossibly tiny 0 bytes
I1002 00:34:36.371371 1957595 certs.go:484] found cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca-key.pem (1679 bytes)
I1002 00:34:36.371419 1957595 certs.go:484] found cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca.pem (1082 bytes)
I1002 00:34:36.371471 1957595 certs.go:484] found cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/cert.pem (1123 bytes)
I1002 00:34:36.371529 1957595 certs.go:484] found cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/key.pem (1675 bytes)
I1002 00:34:36.371600 1957595 certs.go:484] found cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/files/etc/ssl/certs/17505052.pem (1708 bytes)
I1002 00:34:36.372235 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1002 00:34:36.436170 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I1002 00:34:36.513182 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1002 00:34:36.597626 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I1002 00:34:36.641610 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/old-k8s-version-920941/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I1002 00:34:36.676897 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/old-k8s-version-920941/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1002 00:34:36.705026 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/old-k8s-version-920941/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1002 00:34:36.741404 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/old-k8s-version-920941/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1002 00:34:36.780857 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1002 00:34:36.815083 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/1750505.pem --> /usr/share/ca-certificates/1750505.pem (1338 bytes)
I1002 00:34:36.851373 1957595 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/files/etc/ssl/certs/17505052.pem --> /usr/share/ca-certificates/17505052.pem (1708 bytes)
I1002 00:34:36.893545 1957595 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1002 00:34:36.918779 1957595 ssh_runner.go:195] Run: openssl version
I1002 00:34:36.926565 1957595 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1002 00:34:36.938372 1957595 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1002 00:34:36.942921 1957595 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 1 23:43 /usr/share/ca-certificates/minikubeCA.pem
I1002 00:34:36.943044 1957595 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1002 00:34:36.953974 1957595 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1002 00:34:36.963312 1957595 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1750505.pem && ln -fs /usr/share/ca-certificates/1750505.pem /etc/ssl/certs/1750505.pem"
I1002 00:34:36.979932 1957595 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1750505.pem
I1002 00:34:36.984317 1957595 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 1 23:54 /usr/share/ca-certificates/1750505.pem
I1002 00:34:36.984418 1957595 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1750505.pem
I1002 00:34:36.998156 1957595 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1750505.pem /etc/ssl/certs/51391683.0"
I1002 00:34:37.011536 1957595 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/17505052.pem && ln -fs /usr/share/ca-certificates/17505052.pem /etc/ssl/certs/17505052.pem"
I1002 00:34:37.026415 1957595 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/17505052.pem
I1002 00:34:37.036159 1957595 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 1 23:54 /usr/share/ca-certificates/17505052.pem
I1002 00:34:37.036279 1957595 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/17505052.pem
I1002 00:34:37.046397 1957595 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/17505052.pem /etc/ssl/certs/3ec20f2e.0"
I1002 00:34:37.058313 1957595 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1002 00:34:37.064493 1957595 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1002 00:34:37.071965 1957595 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1002 00:34:37.081187 1957595 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1002 00:34:37.092821 1957595 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1002 00:34:37.101307 1957595 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1002 00:34:37.109500 1957595 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1002 00:34:37.117225 1957595 kubeadm.go:392] StartCluster: {Name:old-k8s-version-920941 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-920941 Namespace:default APIServerHAVIP: APIServerName:minikub
eCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/ho
me/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 00:34:37.117372 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I1002 00:34:37.117459 1957595 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1002 00:34:37.170174 1957595 cri.go:89] found id: "8518536c30aef09017c911aee769571a3ca250e88cc9853905c824c874626cac"
I1002 00:34:37.170249 1957595 cri.go:89] found id: "1051ac83c993493af1544df235a7ec482b2588f13293c80a3af3112eff956a41"
I1002 00:34:37.170268 1957595 cri.go:89] found id: "5702ec783ecf1a85e9910ecad76d933e604429ad4ebb11df0f6537272ea91557"
I1002 00:34:37.170288 1957595 cri.go:89] found id: "7d0046a7ae8533f8fe5ca98c95ba71a7292736d0effab8db2b682672e751ab5f"
I1002 00:34:37.170313 1957595 cri.go:89] found id: "9882de920e5952a14a2e090a9a310cf476deae60c93e9ecd7f4384e8d6012f04"
I1002 00:34:37.170331 1957595 cri.go:89] found id: "19bd9ef04d15a6dccf5970eea7159536699fa21c02ae6b578cb94fb5a6c7af6a"
I1002 00:34:37.170349 1957595 cri.go:89] found id: "11ec001392bd7c1b6e1804233a847099114357802451cb3dfc4f819481c9eac5"
I1002 00:34:37.170367 1957595 cri.go:89] found id: "8c7992aa581c091fd0ff51c777b72d5212ca433204a6a429359b1bf731b055f4"
I1002 00:34:37.170385 1957595 cri.go:89] found id: ""
I1002 00:34:37.170458 1957595 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I1002 00:34:37.186709 1957595 cri.go:116] JSON = null
W1002 00:34:37.186798 1957595 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I1002 00:34:37.186882 1957595 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1002 00:34:37.197993 1957595 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I1002 00:34:37.198064 1957595 kubeadm.go:593] restartPrimaryControlPlane start ...
I1002 00:34:37.198133 1957595 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1002 00:34:37.208581 1957595 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1002 00:34:37.209060 1957595 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-920941" does not appear in /home/jenkins/minikube-integration/19740-1745120/kubeconfig
I1002 00:34:37.209257 1957595 kubeconfig.go:62] /home/jenkins/minikube-integration/19740-1745120/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-920941" cluster setting kubeconfig missing "old-k8s-version-920941" context setting]
I1002 00:34:37.209564 1957595 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19740-1745120/kubeconfig: {Name:mk014bd742e0b0f4a72d987c0fd643ed22274647 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 00:34:37.210906 1957595 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1002 00:34:37.228808 1957595 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I1002 00:34:37.228881 1957595 kubeadm.go:597] duration metric: took 30.795345ms to restartPrimaryControlPlane
I1002 00:34:37.228906 1957595 kubeadm.go:394] duration metric: took 111.68984ms to StartCluster
I1002 00:34:37.228941 1957595 settings.go:142] acquiring lock: {Name:mk200f8894606b147c1230e7434ca41f474a2cee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 00:34:37.229015 1957595 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19740-1745120/kubeconfig
I1002 00:34:37.229662 1957595 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19740-1745120/kubeconfig: {Name:mk014bd742e0b0f4a72d987c0fd643ed22274647 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 00:34:37.229927 1957595 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I1002 00:34:37.230277 1957595 config.go:182] Loaded profile config "old-k8s-version-920941": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I1002 00:34:37.230347 1957595 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1002 00:34:37.230434 1957595 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-920941"
I1002 00:34:37.230448 1957595 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-920941"
W1002 00:34:37.230455 1957595 addons.go:243] addon storage-provisioner should already be in state true
I1002 00:34:37.230484 1957595 host.go:66] Checking if "old-k8s-version-920941" exists ...
I1002 00:34:37.230500 1957595 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-920941"
I1002 00:34:37.230536 1957595 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-920941"
I1002 00:34:37.230829 1957595 cli_runner.go:164] Run: docker container inspect old-k8s-version-920941 --format={{.State.Status}}
I1002 00:34:37.230980 1957595 cli_runner.go:164] Run: docker container inspect old-k8s-version-920941 --format={{.State.Status}}
I1002 00:34:37.232702 1957595 addons.go:69] Setting dashboard=true in profile "old-k8s-version-920941"
I1002 00:34:37.232763 1957595 addons.go:234] Setting addon dashboard=true in "old-k8s-version-920941"
W1002 00:34:37.232787 1957595 addons.go:243] addon dashboard should already be in state true
I1002 00:34:37.232830 1957595 host.go:66] Checking if "old-k8s-version-920941" exists ...
I1002 00:34:37.233316 1957595 cli_runner.go:164] Run: docker container inspect old-k8s-version-920941 --format={{.State.Status}}
I1002 00:34:37.233714 1957595 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-920941"
I1002 00:34:37.233918 1957595 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-920941"
W1002 00:34:37.233929 1957595 addons.go:243] addon metrics-server should already be in state true
I1002 00:34:37.233959 1957595 host.go:66] Checking if "old-k8s-version-920941" exists ...
I1002 00:34:37.243059 1957595 out.go:177] * Verifying Kubernetes components...
I1002 00:34:37.243363 1957595 cli_runner.go:164] Run: docker container inspect old-k8s-version-920941 --format={{.State.Status}}
I1002 00:34:37.245225 1957595 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 00:34:37.295053 1957595 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-920941"
W1002 00:34:37.295076 1957595 addons.go:243] addon default-storageclass should already be in state true
I1002 00:34:37.295102 1957595 host.go:66] Checking if "old-k8s-version-920941" exists ...
I1002 00:34:37.295518 1957595 cli_runner.go:164] Run: docker container inspect old-k8s-version-920941 --format={{.State.Status}}
I1002 00:34:37.331635 1957595 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1002 00:34:37.331636 1957595 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I1002 00:34:37.334208 1957595 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I1002 00:34:37.334277 1957595 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I1002 00:34:37.334288 1957595 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I1002 00:34:37.334301 1957595 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1002 00:34:37.334315 1957595 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1002 00:34:37.334348 1957595 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-920941
I1002 00:34:37.334366 1957595 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-920941
I1002 00:34:37.341423 1957595 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1002 00:34:37.343355 1957595 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1002 00:34:37.343381 1957595 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1002 00:34:37.343468 1957595 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-920941
I1002 00:34:37.377186 1957595 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I1002 00:34:37.377207 1957595 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1002 00:34:37.377270 1957595 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-920941
I1002 00:34:37.397875 1957595 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34955 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/old-k8s-version-920941/id_rsa Username:docker}
I1002 00:34:37.415341 1957595 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34955 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/old-k8s-version-920941/id_rsa Username:docker}
I1002 00:34:37.432126 1957595 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34955 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/old-k8s-version-920941/id_rsa Username:docker}
I1002 00:34:37.452656 1957595 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34955 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/old-k8s-version-920941/id_rsa Username:docker}
I1002 00:34:37.481426 1957595 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1002 00:34:37.530608 1957595 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-920941" to be "Ready" ...
I1002 00:34:37.621757 1957595 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I1002 00:34:37.621785 1957595 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I1002 00:34:37.689304 1957595 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I1002 00:34:37.689371 1957595 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I1002 00:34:37.695112 1957595 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1002 00:34:37.695174 1957595 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1002 00:34:37.721281 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1002 00:34:37.758582 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1002 00:34:37.774155 1957595 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I1002 00:34:37.774291 1957595 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I1002 00:34:37.787071 1957595 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1002 00:34:37.787147 1957595 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1002 00:34:37.886456 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1002 00:34:37.896487 1957595 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1002 00:34:37.896564 1957595 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1002 00:34:38.001379 1957595 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1002 00:34:38.001460 1957595 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1002 00:34:38.148899 1957595 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I1002 00:34:38.148973 1957595 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W1002 00:34:38.157923 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:38.158001 1957595 retry.go:31] will retry after 311.67596ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1002 00:34:38.158074 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:38.158101 1957595 retry.go:31] will retry after 352.540311ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:38.198989 1957595 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1002 00:34:38.199065 1957595 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W1002 00:34:38.264384 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:38.264418 1957595 retry.go:31] will retry after 261.658089ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:38.291511 1957595 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1002 00:34:38.291536 1957595 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1002 00:34:38.324376 1957595 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1002 00:34:38.324396 1957595 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1002 00:34:38.358075 1957595 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1002 00:34:38.358096 1957595 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1002 00:34:38.403909 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1002 00:34:38.470952 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1002 00:34:38.511619 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1002 00:34:38.527147 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1002 00:34:38.872968 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:38.873010 1957595 retry.go:31] will retry after 233.133749ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1002 00:34:38.924183 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:38.924212 1957595 retry.go:31] will retry after 420.041322ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1002 00:34:38.924257 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:38.924264 1957595 retry.go:31] will retry after 538.48756ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1002 00:34:38.924300 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:38.924306 1957595 retry.go:31] will retry after 311.145767ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:39.107162 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1002 00:34:39.224188 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:39.224217 1957595 retry.go:31] will retry after 446.602758ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:39.235586 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1002 00:34:39.345117 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1002 00:34:39.388135 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:39.388164 1957595 retry.go:31] will retry after 570.521176ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:39.463442 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1002 00:34:39.472707 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:39.472738 1957595 retry.go:31] will retry after 297.084492ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:39.531222 1957595 node_ready.go:53] error getting node "old-k8s-version-920941": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-920941": dial tcp 192.168.76.2:8443: connect: connection refused
W1002 00:34:39.562743 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:39.562787 1957595 retry.go:31] will retry after 551.113231ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:39.671191 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1002 00:34:39.753161 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:39.753193 1957595 retry.go:31] will retry after 780.514599ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:39.770325 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1002 00:34:39.848416 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:39.848444 1957595 retry.go:31] will retry after 549.573525ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:39.959851 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1002 00:34:40.068765 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:40.068798 1957595 retry.go:31] will retry after 1.208291191s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:40.115062 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1002 00:34:40.212072 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:40.212119 1957595 retry.go:31] will retry after 486.853729ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:40.398533 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1002 00:34:40.479185 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:40.479217 1957595 retry.go:31] will retry after 1.685783426s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:40.533932 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1002 00:34:40.617648 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:40.617730 1957595 retry.go:31] will retry after 1.218678114s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:40.699931 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1002 00:34:40.794537 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:40.794564 1957595 retry.go:31] will retry after 1.448244116s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:41.277663 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1002 00:34:41.374150 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:41.374183 1957595 retry.go:31] will retry after 1.019261294s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:41.531819 1957595 node_ready.go:53] error getting node "old-k8s-version-920941": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-920941": dial tcp 192.168.76.2:8443: connect: connection refused
I1002 00:34:41.837063 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1002 00:34:41.930907 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:41.930943 1957595 retry.go:31] will retry after 1.43325621s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:42.165780 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1002 00:34:42.243141 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1002 00:34:42.253567 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:42.253603 1957595 retry.go:31] will retry after 1.352829079s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1002 00:34:42.350375 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:42.350410 1957595 retry.go:31] will retry after 1.704102754s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:42.393639 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1002 00:34:42.493791 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:42.493825 1957595 retry.go:31] will retry after 1.047605072s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:43.364667 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1002 00:34:43.459844 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:43.459877 1957595 retry.go:31] will retry after 2.107033014s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:43.541626 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1002 00:34:43.607009 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1002 00:34:43.644539 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:43.644567 1957595 retry.go:31] will retry after 1.676537137s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1002 00:34:43.738297 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:43.738325 1957595 retry.go:31] will retry after 3.790318088s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:44.032110 1957595 node_ready.go:53] error getting node "old-k8s-version-920941": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-920941": dial tcp 192.168.76.2:8443: connect: connection refused
I1002 00:34:44.055421 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1002 00:34:44.143418 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:44.143445 1957595 retry.go:31] will retry after 4.011530551s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:45.321693 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1002 00:34:45.410121 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:45.410153 1957595 retry.go:31] will retry after 4.257310115s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:45.568054 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1002 00:34:45.805251 1957595 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:45.805280 1957595 retry.go:31] will retry after 2.684361463s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1002 00:34:46.532028 1957595 node_ready.go:53] error getting node "old-k8s-version-920941": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-920941": dial tcp 192.168.76.2:8443: connect: connection refused
I1002 00:34:47.528897 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1002 00:34:48.155956 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1002 00:34:48.490543 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1002 00:34:49.668032 1957595 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1002 00:34:57.032664 1957595 node_ready.go:53] error getting node "old-k8s-version-920941": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-920941": net/http: TLS handshake timeout
I1002 00:34:58.705029 1957595 node_ready.go:49] node "old-k8s-version-920941" has status "Ready":"True"
I1002 00:34:58.705052 1957595 node_ready.go:38] duration metric: took 21.174360824s for node "old-k8s-version-920941" to be "Ready" ...
I1002 00:34:58.705078 1957595 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1002 00:34:58.956117 1957595 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-nbdkx" in "kube-system" namespace to be "Ready" ...
I1002 00:34:59.142654 1957595 pod_ready.go:93] pod "coredns-74ff55c5b-nbdkx" in "kube-system" namespace has status "Ready":"True"
I1002 00:34:59.142731 1957595 pod_ready.go:82] duration metric: took 186.504716ms for pod "coredns-74ff55c5b-nbdkx" in "kube-system" namespace to be "Ready" ...
I1002 00:34:59.142767 1957595 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-920941" in "kube-system" namespace to be "Ready" ...
I1002 00:34:59.202790 1957595 pod_ready.go:93] pod "etcd-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"True"
I1002 00:34:59.202867 1957595 pod_ready.go:82] duration metric: took 60.062033ms for pod "etcd-old-k8s-version-920941" in "kube-system" namespace to be "Ready" ...
I1002 00:34:59.202897 1957595 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-920941" in "kube-system" namespace to be "Ready" ...
I1002 00:35:00.178362 1957595 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (12.649420585s)
I1002 00:35:00.178428 1957595 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (12.022453265s)
I1002 00:35:01.238815 1957595 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:01.465631 1957595 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (11.797558811s)
I1002 00:35:01.465709 1957595 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-920941"
I1002 00:35:01.465792 1957595 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (12.975200431s)
I1002 00:35:01.467435 1957595 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-920941 addons enable metrics-server
I1002 00:35:01.469163 1957595 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
I1002 00:35:01.471027 1957595 addons.go:510] duration metric: took 24.2406829s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server dashboard]
I1002 00:35:03.710240 1957595 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:06.209554 1957595 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:08.212366 1957595 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:10.210749 1957595 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"True"
I1002 00:35:10.210843 1957595 pod_ready.go:82] duration metric: took 11.007913487s for pod "kube-apiserver-old-k8s-version-920941" in "kube-system" namespace to be "Ready" ...
I1002 00:35:10.210869 1957595 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace to be "Ready" ...
I1002 00:35:12.217991 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:14.717670 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:17.216889 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:19.217566 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:21.722504 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:24.218636 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:26.720086 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:29.216755 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:31.217548 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:33.719149 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:36.216336 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:38.216639 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:40.217681 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:42.717978 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:44.718174 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:47.217331 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:49.718351 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:52.217857 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:54.717353 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:57.217769 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:35:59.716913 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:01.717482 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:03.718388 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:06.217010 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:08.775943 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:11.217838 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:13.217946 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:15.219050 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:17.223403 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:19.717704 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:21.216971 1957595 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"True"
I1002 00:36:21.216996 1957595 pod_ready.go:82] duration metric: took 1m11.006105841s for pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace to be "Ready" ...
I1002 00:36:21.217007 1957595 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-42b7q" in "kube-system" namespace to be "Ready" ...
I1002 00:36:21.221776 1957595 pod_ready.go:93] pod "kube-proxy-42b7q" in "kube-system" namespace has status "Ready":"True"
I1002 00:36:21.221801 1957595 pod_ready.go:82] duration metric: took 4.785683ms for pod "kube-proxy-42b7q" in "kube-system" namespace to be "Ready" ...
I1002 00:36:21.221814 1957595 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-920941" in "kube-system" namespace to be "Ready" ...
I1002 00:36:23.227502 1957595 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:25.228486 1957595 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:26.228584 1957595 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"True"
I1002 00:36:26.228662 1957595 pod_ready.go:82] duration metric: took 5.006839188s for pod "kube-scheduler-old-k8s-version-920941" in "kube-system" namespace to be "Ready" ...
I1002 00:36:26.228688 1957595 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace to be "Ready" ...
I1002 00:36:28.234816 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:30.236092 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:32.736345 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:35.234991 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:37.235434 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:39.236103 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:41.236546 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:43.735666 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:46.235955 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:48.734957 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:50.735615 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:52.735648 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:55.236733 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:57.239178 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:59.734959 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:01.735219 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:04.237345 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:06.735087 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:08.735842 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:11.235348 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:13.735763 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:16.234810 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:18.235343 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:20.735050 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:23.235940 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:25.735045 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:28.234568 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:30.235503 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:32.735295 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:35.235317 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:37.734651 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:40.235325 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:42.235666 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:44.735462 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:47.234819 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:49.235228 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:51.734924 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:53.735129 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:56.234708 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:58.735319 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:01.234117 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:03.235524 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:05.735867 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:08.235269 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:10.235566 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:12.735472 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:14.737310 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:17.234735 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:19.735217 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:21.735317 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:24.235157 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:26.734605 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:28.734860 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:30.735008 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:33.234148 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:35.234909 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:37.735168 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:39.735540 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:41.735835 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:44.235027 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:46.734386 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:48.735126 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:50.736039 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:53.234472 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:55.234593 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:57.235198 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:59.235364 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:01.235569 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:03.735110 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:06.235324 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:08.734702 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:10.736790 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:13.235130 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:15.235733 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:17.734764 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:19.734977 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:21.735890 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:24.235463 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:26.235565 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:28.735069 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:30.735329 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:32.736129 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:35.235603 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:37.734912 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:39.736246 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:42.235540 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:44.735190 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:47.236303 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:49.736213 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:52.235593 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:54.735856 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:57.235708 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:59.735217 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:02.235341 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:04.235464 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:06.752875 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:09.235497 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:11.739045 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:14.234873 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:16.734971 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:18.735025 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:21.234561 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:23.735307 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:25.735630 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:26.235407 1957595 pod_ready.go:82] duration metric: took 4m0.006692573s for pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace to be "Ready" ...
E1002 00:40:26.235429 1957595 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I1002 00:40:26.235438 1957595 pod_ready.go:39] duration metric: took 5m27.530349402s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1002 00:40:26.235452 1957595 api_server.go:52] waiting for apiserver process to appear ...
I1002 00:40:26.235482 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I1002 00:40:26.235571 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1002 00:40:26.281727 1957595 cri.go:89] found id: "0a25b599263d779d6664295d455c78ad67aae1ea393696c88eb6887fedc9bf29"
I1002 00:40:26.281798 1957595 cri.go:89] found id: "11ec001392bd7c1b6e1804233a847099114357802451cb3dfc4f819481c9eac5"
I1002 00:40:26.281808 1957595 cri.go:89] found id: ""
I1002 00:40:26.281817 1957595 logs.go:282] 2 containers: [0a25b599263d779d6664295d455c78ad67aae1ea393696c88eb6887fedc9bf29 11ec001392bd7c1b6e1804233a847099114357802451cb3dfc4f819481c9eac5]
I1002 00:40:26.281883 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.285748 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.289204 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I1002 00:40:26.289276 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1002 00:40:26.330580 1957595 cri.go:89] found id: "ab6cea850151c0b10687176375d47fb249199d273efd44a9c5d6a1d39e3f623a"
I1002 00:40:26.330601 1957595 cri.go:89] found id: "8c7992aa581c091fd0ff51c777b72d5212ca433204a6a429359b1bf731b055f4"
I1002 00:40:26.330606 1957595 cri.go:89] found id: ""
I1002 00:40:26.330613 1957595 logs.go:282] 2 containers: [ab6cea850151c0b10687176375d47fb249199d273efd44a9c5d6a1d39e3f623a 8c7992aa581c091fd0ff51c777b72d5212ca433204a6a429359b1bf731b055f4]
I1002 00:40:26.330687 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.334426 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.338199 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I1002 00:40:26.338294 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1002 00:40:26.383276 1957595 cri.go:89] found id: "9f4ef323c339f7d0dd395ca641e6b83c6ee625242e1e405bcb230f0280f833f9"
I1002 00:40:26.383301 1957595 cri.go:89] found id: "8518536c30aef09017c911aee769571a3ca250e88cc9853905c824c874626cac"
I1002 00:40:26.383306 1957595 cri.go:89] found id: ""
I1002 00:40:26.383323 1957595 logs.go:282] 2 containers: [9f4ef323c339f7d0dd395ca641e6b83c6ee625242e1e405bcb230f0280f833f9 8518536c30aef09017c911aee769571a3ca250e88cc9853905c824c874626cac]
I1002 00:40:26.383404 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.387099 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.390623 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I1002 00:40:26.390695 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1002 00:40:26.427645 1957595 cri.go:89] found id: "87d3a4aa9e474d9d563b52794771a880f456688ecc28b5c9391254d7e388d601"
I1002 00:40:26.427672 1957595 cri.go:89] found id: "19bd9ef04d15a6dccf5970eea7159536699fa21c02ae6b578cb94fb5a6c7af6a"
I1002 00:40:26.427683 1957595 cri.go:89] found id: ""
I1002 00:40:26.427691 1957595 logs.go:282] 2 containers: [87d3a4aa9e474d9d563b52794771a880f456688ecc28b5c9391254d7e388d601 19bd9ef04d15a6dccf5970eea7159536699fa21c02ae6b578cb94fb5a6c7af6a]
I1002 00:40:26.427749 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.431220 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.434462 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I1002 00:40:26.434533 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1002 00:40:26.474025 1957595 cri.go:89] found id: "8ff3cc680606db52e7aec936aa5a3da89b1f05ec9c72362a02657eefc93740a6"
I1002 00:40:26.474046 1957595 cri.go:89] found id: "7d0046a7ae8533f8fe5ca98c95ba71a7292736d0effab8db2b682672e751ab5f"
I1002 00:40:26.474051 1957595 cri.go:89] found id: ""
I1002 00:40:26.474058 1957595 logs.go:282] 2 containers: [8ff3cc680606db52e7aec936aa5a3da89b1f05ec9c72362a02657eefc93740a6 7d0046a7ae8533f8fe5ca98c95ba71a7292736d0effab8db2b682672e751ab5f]
I1002 00:40:26.474118 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.478508 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.482063 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I1002 00:40:26.482131 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1002 00:40:26.529778 1957595 cri.go:89] found id: "ad357c0209d969730c7b744d5c2fbad0a7c610d618ddddb9a2fc771ce023b605"
I1002 00:40:26.529803 1957595 cri.go:89] found id: "9882de920e5952a14a2e090a9a310cf476deae60c93e9ecd7f4384e8d6012f04"
I1002 00:40:26.529809 1957595 cri.go:89] found id: ""
I1002 00:40:26.529817 1957595 logs.go:282] 2 containers: [ad357c0209d969730c7b744d5c2fbad0a7c610d618ddddb9a2fc771ce023b605 9882de920e5952a14a2e090a9a310cf476deae60c93e9ecd7f4384e8d6012f04]
I1002 00:40:26.529877 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.533446 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.536980 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I1002 00:40:26.537109 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1002 00:40:26.578079 1957595 cri.go:89] found id: "a767e421df83a00b32383377cc55e4151e7bd6f66d1066e2c265fd0d78172cac"
I1002 00:40:26.578103 1957595 cri.go:89] found id: "1051ac83c993493af1544df235a7ec482b2588f13293c80a3af3112eff956a41"
I1002 00:40:26.578108 1957595 cri.go:89] found id: ""
I1002 00:40:26.578116 1957595 logs.go:282] 2 containers: [a767e421df83a00b32383377cc55e4151e7bd6f66d1066e2c265fd0d78172cac 1051ac83c993493af1544df235a7ec482b2588f13293c80a3af3112eff956a41]
I1002 00:40:26.578172 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.581929 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.585716 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I1002 00:40:26.585837 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I1002 00:40:26.634661 1957595 cri.go:89] found id: "287dac3a47db438435ee5f4915263ed26e3f6eae852bb618365b6490d95b4453"
I1002 00:40:26.634692 1957595 cri.go:89] found id: "4a7d63ad64058ab8a816f95771113a6646e7f49235241d0b9c99ee631cdf7f38"
I1002 00:40:26.634697 1957595 cri.go:89] found id: ""
I1002 00:40:26.634704 1957595 logs.go:282] 2 containers: [287dac3a47db438435ee5f4915263ed26e3f6eae852bb618365b6490d95b4453 4a7d63ad64058ab8a816f95771113a6646e7f49235241d0b9c99ee631cdf7f38]
I1002 00:40:26.634769 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.638476 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.641979 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I1002 00:40:26.642082 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I1002 00:40:26.684232 1957595 cri.go:89] found id: "6d607cf4c97f9850c9226c3b461edd448574512ffe663325bf684f333c1bef50"
I1002 00:40:26.684295 1957595 cri.go:89] found id: ""
I1002 00:40:26.684318 1957595 logs.go:282] 1 containers: [6d607cf4c97f9850c9226c3b461edd448574512ffe663325bf684f333c1bef50]
I1002 00:40:26.684407 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.688115 1957595 logs.go:123] Gathering logs for describe nodes ...
I1002 00:40:26.688142 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I1002 00:40:26.840427 1957595 logs.go:123] Gathering logs for kube-apiserver [0a25b599263d779d6664295d455c78ad67aae1ea393696c88eb6887fedc9bf29] ...
I1002 00:40:26.840617 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0a25b599263d779d6664295d455c78ad67aae1ea393696c88eb6887fedc9bf29"
I1002 00:40:26.907015 1957595 logs.go:123] Gathering logs for etcd [ab6cea850151c0b10687176375d47fb249199d273efd44a9c5d6a1d39e3f623a] ...
I1002 00:40:26.907065 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ab6cea850151c0b10687176375d47fb249199d273efd44a9c5d6a1d39e3f623a"
I1002 00:40:26.952130 1957595 logs.go:123] Gathering logs for coredns [9f4ef323c339f7d0dd395ca641e6b83c6ee625242e1e405bcb230f0280f833f9] ...
I1002 00:40:26.952161 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9f4ef323c339f7d0dd395ca641e6b83c6ee625242e1e405bcb230f0280f833f9"
I1002 00:40:26.993101 1957595 logs.go:123] Gathering logs for coredns [8518536c30aef09017c911aee769571a3ca250e88cc9853905c824c874626cac] ...
I1002 00:40:26.993131 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8518536c30aef09017c911aee769571a3ca250e88cc9853905c824c874626cac"
I1002 00:40:27.051452 1957595 logs.go:123] Gathering logs for kube-proxy [8ff3cc680606db52e7aec936aa5a3da89b1f05ec9c72362a02657eefc93740a6] ...
I1002 00:40:27.051531 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8ff3cc680606db52e7aec936aa5a3da89b1f05ec9c72362a02657eefc93740a6"
I1002 00:40:27.101863 1957595 logs.go:123] Gathering logs for kubelet ...
I1002 00:40:27.101891 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W1002 00:40:27.165499 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.403474 657 reflector.go:138] object-"kube-system"/"kube-proxy-token-72v75": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-72v75" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.165767 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.403634 657 reflector.go:138] object-"kube-system"/"kindnet-token-drxz7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-drxz7" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.165977 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.403804 657 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.166190 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.403951 657 reflector.go:138] object-"kube-system"/"coredns-token-p2g4h": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-p2g4h" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.166401 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.406263 657 reflector.go:138] object-"default"/"default-token-lmpgm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-lmpgm" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.166604 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.406638 657 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.166826 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.406794 657 reflector.go:138] object-"kube-system"/"metrics-server-token-x2fml": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-x2fml" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.167052 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.406955 657 reflector.go:138] object-"kube-system"/"storage-provisioner-token-2v6pp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-2v6pp" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.175955 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:02 old-k8s-version-920941 kubelet[657]: E1002 00:35:02.816096 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1002 00:40:27.176152 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:03 old-k8s-version-920941 kubelet[657]: E1002 00:35:03.404518 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.179250 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:17 old-k8s-version-920941 kubelet[657]: E1002 00:35:17.054839 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1002 00:40:27.180905 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:24 old-k8s-version-920941 kubelet[657]: E1002 00:35:24.463670 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.181701 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:25 old-k8s-version-920941 kubelet[657]: E1002 00:35:25.467856 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.181887 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:28 old-k8s-version-920941 kubelet[657]: E1002 00:35:28.036655 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.182213 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:32 old-k8s-version-920941 kubelet[657]: E1002 00:35:32.484516 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.182651 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:32 old-k8s-version-920941 kubelet[657]: E1002 00:35:32.507888 657 pod_workers.go:191] Error syncing pod 4cf65c92-656f-422a-952b-05891b36cb68 ("storage-provisioner_kube-system(4cf65c92-656f-422a-952b-05891b36cb68)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(4cf65c92-656f-422a-952b-05891b36cb68)"
W1002 00:40:27.185453 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:39 old-k8s-version-920941 kubelet[657]: E1002 00:35:39.045417 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1002 00:40:27.186187 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:46 old-k8s-version-920941 kubelet[657]: E1002 00:35:46.553569 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.186376 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:50 old-k8s-version-920941 kubelet[657]: E1002 00:35:50.037065 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.186705 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:52 old-k8s-version-920941 kubelet[657]: E1002 00:35:52.484920 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.186890 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:01 old-k8s-version-920941 kubelet[657]: E1002 00:36:01.036920 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.187229 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:05 old-k8s-version-920941 kubelet[657]: E1002 00:36:05.038238 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.187413 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:14 old-k8s-version-920941 kubelet[657]: E1002 00:36:14.037429 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.187999 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:17 old-k8s-version-920941 kubelet[657]: E1002 00:36:17.639596 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.188326 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:22 old-k8s-version-920941 kubelet[657]: E1002 00:36:22.485499 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.190840 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:25 old-k8s-version-920941 kubelet[657]: E1002 00:36:25.067982 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1002 00:40:27.191173 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:36 old-k8s-version-920941 kubelet[657]: E1002 00:36:36.036206 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.191359 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:37 old-k8s-version-920941 kubelet[657]: E1002 00:36:37.038810 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.191686 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:49 old-k8s-version-920941 kubelet[657]: E1002 00:36:49.045805 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.191870 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:50 old-k8s-version-920941 kubelet[657]: E1002 00:36:50.037091 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.192053 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:03 old-k8s-version-920941 kubelet[657]: E1002 00:37:03.040054 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.192644 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:04 old-k8s-version-920941 kubelet[657]: E1002 00:37:04.765096 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.192971 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:12 old-k8s-version-920941 kubelet[657]: E1002 00:37:12.484569 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.193163 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:17 old-k8s-version-920941 kubelet[657]: E1002 00:37:17.036843 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.193488 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:27 old-k8s-version-920941 kubelet[657]: E1002 00:37:27.037002 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.193671 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:28 old-k8s-version-920941 kubelet[657]: E1002 00:37:28.036803 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.193857 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:40 old-k8s-version-920941 kubelet[657]: E1002 00:37:40.036708 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.194183 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:42 old-k8s-version-920941 kubelet[657]: E1002 00:37:42.036260 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.194508 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:54 old-k8s-version-920941 kubelet[657]: E1002 00:37:54.036836 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.196937 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:54 old-k8s-version-920941 kubelet[657]: E1002 00:37:54.044847 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1002 00:40:27.197264 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:05 old-k8s-version-920941 kubelet[657]: E1002 00:38:05.036582 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.197450 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:07 old-k8s-version-920941 kubelet[657]: E1002 00:38:07.040872 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.197779 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:17 old-k8s-version-920941 kubelet[657]: E1002 00:38:17.036860 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.197964 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:21 old-k8s-version-920941 kubelet[657]: E1002 00:38:21.036821 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.198554 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:29 old-k8s-version-920941 kubelet[657]: E1002 00:38:29.977771 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.198882 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:32 old-k8s-version-920941 kubelet[657]: E1002 00:38:32.484422 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.199066 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:36 old-k8s-version-920941 kubelet[657]: E1002 00:38:36.036591 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.199394 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:46 old-k8s-version-920941 kubelet[657]: E1002 00:38:46.036189 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.199582 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:50 old-k8s-version-920941 kubelet[657]: E1002 00:38:50.036961 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.199907 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:59 old-k8s-version-920941 kubelet[657]: E1002 00:38:59.040242 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.200091 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:04 old-k8s-version-920941 kubelet[657]: E1002 00:39:04.036603 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.200416 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:11 old-k8s-version-920941 kubelet[657]: E1002 00:39:11.036751 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.200607 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:17 old-k8s-version-920941 kubelet[657]: E1002 00:39:17.036726 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.200935 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:26 old-k8s-version-920941 kubelet[657]: E1002 00:39:26.036140 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.201122 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:28 old-k8s-version-920941 kubelet[657]: E1002 00:39:28.036705 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.201447 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:37 old-k8s-version-920941 kubelet[657]: E1002 00:39:37.039880 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.201635 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:42 old-k8s-version-920941 kubelet[657]: E1002 00:39:42.037320 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.201962 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:48 old-k8s-version-920941 kubelet[657]: E1002 00:39:48.036281 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.202147 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:55 old-k8s-version-920941 kubelet[657]: E1002 00:39:55.037598 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.202508 1957595 logs.go:138] Found kubelet problem: Oct 02 00:40:02 old-k8s-version-920941 kubelet[657]: E1002 00:40:02.036402 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.202694 1957595 logs.go:138] Found kubelet problem: Oct 02 00:40:08 old-k8s-version-920941 kubelet[657]: E1002 00:40:08.036742 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.203020 1957595 logs.go:138] Found kubelet problem: Oct 02 00:40:15 old-k8s-version-920941 kubelet[657]: E1002 00:40:15.037929 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.203205 1957595 logs.go:138] Found kubelet problem: Oct 02 00:40:20 old-k8s-version-920941 kubelet[657]: E1002 00:40:20.036677 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.203530 1957595 logs.go:138] Found kubelet problem: Oct 02 00:40:27 old-k8s-version-920941 kubelet[657]: E1002 00:40:27.036953 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
I1002 00:40:27.203544 1957595 logs.go:123] Gathering logs for kube-scheduler [19bd9ef04d15a6dccf5970eea7159536699fa21c02ae6b578cb94fb5a6c7af6a] ...
I1002 00:40:27.203559 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 19bd9ef04d15a6dccf5970eea7159536699fa21c02ae6b578cb94fb5a6c7af6a"
I1002 00:40:27.270245 1957595 logs.go:123] Gathering logs for kindnet [a767e421df83a00b32383377cc55e4151e7bd6f66d1066e2c265fd0d78172cac] ...
I1002 00:40:27.270278 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a767e421df83a00b32383377cc55e4151e7bd6f66d1066e2c265fd0d78172cac"
I1002 00:40:27.330354 1957595 logs.go:123] Gathering logs for kubernetes-dashboard [6d607cf4c97f9850c9226c3b461edd448574512ffe663325bf684f333c1bef50] ...
I1002 00:40:27.330384 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6d607cf4c97f9850c9226c3b461edd448574512ffe663325bf684f333c1bef50"
I1002 00:40:27.377052 1957595 logs.go:123] Gathering logs for dmesg ...
I1002 00:40:27.377080 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1002 00:40:27.396038 1957595 logs.go:123] Gathering logs for kube-scheduler [87d3a4aa9e474d9d563b52794771a880f456688ecc28b5c9391254d7e388d601] ...
I1002 00:40:27.396069 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 87d3a4aa9e474d9d563b52794771a880f456688ecc28b5c9391254d7e388d601"
I1002 00:40:27.434135 1957595 logs.go:123] Gathering logs for kube-controller-manager [ad357c0209d969730c7b744d5c2fbad0a7c610d618ddddb9a2fc771ce023b605] ...
I1002 00:40:27.434161 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ad357c0209d969730c7b744d5c2fbad0a7c610d618ddddb9a2fc771ce023b605"
I1002 00:40:27.489634 1957595 logs.go:123] Gathering logs for kube-controller-manager [9882de920e5952a14a2e090a9a310cf476deae60c93e9ecd7f4384e8d6012f04] ...
I1002 00:40:27.489667 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9882de920e5952a14a2e090a9a310cf476deae60c93e9ecd7f4384e8d6012f04"
I1002 00:40:27.551020 1957595 logs.go:123] Gathering logs for containerd ...
I1002 00:40:27.551058 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I1002 00:40:27.615278 1957595 logs.go:123] Gathering logs for kube-apiserver [11ec001392bd7c1b6e1804233a847099114357802451cb3dfc4f819481c9eac5] ...
I1002 00:40:27.615315 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 11ec001392bd7c1b6e1804233a847099114357802451cb3dfc4f819481c9eac5"
I1002 00:40:27.699876 1957595 logs.go:123] Gathering logs for etcd [8c7992aa581c091fd0ff51c777b72d5212ca433204a6a429359b1bf731b055f4] ...
I1002 00:40:27.699910 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8c7992aa581c091fd0ff51c777b72d5212ca433204a6a429359b1bf731b055f4"
I1002 00:40:27.745907 1957595 logs.go:123] Gathering logs for kube-proxy [7d0046a7ae8533f8fe5ca98c95ba71a7292736d0effab8db2b682672e751ab5f] ...
I1002 00:40:27.745938 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7d0046a7ae8533f8fe5ca98c95ba71a7292736d0effab8db2b682672e751ab5f"
I1002 00:40:27.790931 1957595 logs.go:123] Gathering logs for kindnet [1051ac83c993493af1544df235a7ec482b2588f13293c80a3af3112eff956a41] ...
I1002 00:40:27.790957 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1051ac83c993493af1544df235a7ec482b2588f13293c80a3af3112eff956a41"
I1002 00:40:27.841399 1957595 logs.go:123] Gathering logs for storage-provisioner [287dac3a47db438435ee5f4915263ed26e3f6eae852bb618365b6490d95b4453] ...
I1002 00:40:27.841438 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 287dac3a47db438435ee5f4915263ed26e3f6eae852bb618365b6490d95b4453"
I1002 00:40:27.882342 1957595 logs.go:123] Gathering logs for storage-provisioner [4a7d63ad64058ab8a816f95771113a6646e7f49235241d0b9c99ee631cdf7f38] ...
I1002 00:40:27.882368 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4a7d63ad64058ab8a816f95771113a6646e7f49235241d0b9c99ee631cdf7f38"
I1002 00:40:27.925417 1957595 logs.go:123] Gathering logs for container status ...
I1002 00:40:27.925443 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1002 00:40:27.970197 1957595 out.go:358] Setting ErrFile to fd 2...
I1002 00:40:27.970228 1957595 out.go:392] TERM=,COLORTERM=, which probably does not support color
W1002 00:40:27.970391 1957595 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W1002 00:40:27.970409 1957595 out.go:270] Oct 02 00:40:02 old-k8s-version-920941 kubelet[657]: E1002 00:40:02.036402 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
Oct 02 00:40:02 old-k8s-version-920941 kubelet[657]: E1002 00:40:02.036402 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.970430 1957595 out.go:270] Oct 02 00:40:08 old-k8s-version-920941 kubelet[657]: E1002 00:40:08.036742 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 02 00:40:08 old-k8s-version-920941 kubelet[657]: E1002 00:40:08.036742 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.970447 1957595 out.go:270] Oct 02 00:40:15 old-k8s-version-920941 kubelet[657]: E1002 00:40:15.037929 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
Oct 02 00:40:15 old-k8s-version-920941 kubelet[657]: E1002 00:40:15.037929 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.970454 1957595 out.go:270] Oct 02 00:40:20 old-k8s-version-920941 kubelet[657]: E1002 00:40:20.036677 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 02 00:40:20 old-k8s-version-920941 kubelet[657]: E1002 00:40:20.036677 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.970464 1957595 out.go:270] Oct 02 00:40:27 old-k8s-version-920941 kubelet[657]: E1002 00:40:27.036953 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
Oct 02 00:40:27 old-k8s-version-920941 kubelet[657]: E1002 00:40:27.036953 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
I1002 00:40:27.970475 1957595 out.go:358] Setting ErrFile to fd 2...
I1002 00:40:27.970482 1957595 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1002 00:40:37.971296 1957595 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1002 00:40:37.984057 1957595 api_server.go:72] duration metric: took 6m0.754066339s to wait for apiserver process to appear ...
I1002 00:40:37.984081 1957595 api_server.go:88] waiting for apiserver healthz status ...
I1002 00:40:37.986391 1957595 out.go:201]
W1002 00:40:37.988342 1957595 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W1002 00:40:37.988362 1957595 out.go:270] *
*
W1002 00:40:37.990636 1957595 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1002 00:40:37.993660 1957595 out.go:201]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-920941 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-920941
helpers_test.go:235: (dbg) docker inspect old-k8s-version-920941:
-- stdout --
[
{
"Id": "2e4739c43a663a03a580e4c0a06ade93199a8e08b579ae89b9ddb6a28069fcfd",
"Created": "2024-10-02T00:31:52.317877874Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1957841,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-10-02T00:34:29.880574444Z",
"FinishedAt": "2024-10-02T00:34:28.805138361Z"
},
"Image": "sha256:b5f10d57944829de859b6363a7c57065ccc6b1805dabb3bce283aaecb83f3acc",
"ResolvConfPath": "/var/lib/docker/containers/2e4739c43a663a03a580e4c0a06ade93199a8e08b579ae89b9ddb6a28069fcfd/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/2e4739c43a663a03a580e4c0a06ade93199a8e08b579ae89b9ddb6a28069fcfd/hostname",
"HostsPath": "/var/lib/docker/containers/2e4739c43a663a03a580e4c0a06ade93199a8e08b579ae89b9ddb6a28069fcfd/hosts",
"LogPath": "/var/lib/docker/containers/2e4739c43a663a03a580e4c0a06ade93199a8e08b579ae89b9ddb6a28069fcfd/2e4739c43a663a03a580e4c0a06ade93199a8e08b579ae89b9ddb6a28069fcfd-json.log",
"Name": "/old-k8s-version-920941",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-920941:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-920941",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/b27fc6b18db023e896bcc76a659701aae10b656608703466a3718034425266cc-init/diff:/var/lib/docker/overlay2/f36fd63656976433bbd6b304cfd5552e0c71ee74203e3ec14aaa10779b0a0aa6/diff",
"MergedDir": "/var/lib/docker/overlay2/b27fc6b18db023e896bcc76a659701aae10b656608703466a3718034425266cc/merged",
"UpperDir": "/var/lib/docker/overlay2/b27fc6b18db023e896bcc76a659701aae10b656608703466a3718034425266cc/diff",
"WorkDir": "/var/lib/docker/overlay2/b27fc6b18db023e896bcc76a659701aae10b656608703466a3718034425266cc/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-920941",
"Source": "/var/lib/docker/volumes/old-k8s-version-920941/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-920941",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-920941",
"name.minikube.sigs.k8s.io": "old-k8s-version-920941",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "b11eac41911539573af28daa1cc44899d38a0fd2008fb94c1df8f6f201d17579",
"SandboxKey": "/var/run/docker/netns/b11eac419115",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34955"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34956"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34959"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34957"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34958"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-920941": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null,
"NetworkID": "8f85093bb2a5c243641274272235510daba8fccf2850e4cdeb2fb2978b0f1271",
"EndpointID": "333e363ce59735470d618de13586caa26a7b6577ba9f4df95dcb23c4b87c1d55",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-920941",
"2e4739c43a66"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-920941 -n old-k8s-version-920941
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-920941 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-920941 logs -n 25: (1.991684294s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| start | -p force-systemd-env-378598 | force-systemd-env-378598 | jenkins | v1.34.0 | 02 Oct 24 00:30 UTC | 02 Oct 24 00:31 UTC |
| | --memory=2048 | | | | | |
| | --alsologtostderr | | | | | |
| | -v=5 --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| pause | -p pause-489543 | pause-489543 | jenkins | v1.34.0 | 02 Oct 24 00:30 UTC | 02 Oct 24 00:30 UTC |
| | --alsologtostderr -v=5 | | | | | |
| unpause | -p pause-489543 | pause-489543 | jenkins | v1.34.0 | 02 Oct 24 00:30 UTC | 02 Oct 24 00:30 UTC |
| | --alsologtostderr -v=5 | | | | | |
| pause | -p pause-489543 | pause-489543 | jenkins | v1.34.0 | 02 Oct 24 00:30 UTC | 02 Oct 24 00:30 UTC |
| | --alsologtostderr -v=5 | | | | | |
| delete | -p pause-489543 | pause-489543 | jenkins | v1.34.0 | 02 Oct 24 00:30 UTC | 02 Oct 24 00:30 UTC |
| | --alsologtostderr -v=5 | | | | | |
| delete | -p pause-489543 | pause-489543 | jenkins | v1.34.0 | 02 Oct 24 00:30 UTC | 02 Oct 24 00:30 UTC |
| start | -p cert-expiration-603955 | cert-expiration-603955 | jenkins | v1.34.0 | 02 Oct 24 00:30 UTC | 02 Oct 24 00:31 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-378598 | force-systemd-env-378598 | jenkins | v1.34.0 | 02 Oct 24 00:31 UTC | 02 Oct 24 00:31 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-378598 | force-systemd-env-378598 | jenkins | v1.34.0 | 02 Oct 24 00:31 UTC | 02 Oct 24 00:31 UTC |
| start | -p cert-options-043656 | cert-options-043656 | jenkins | v1.34.0 | 02 Oct 24 00:31 UTC | 02 Oct 24 00:31 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-043656 ssh | cert-options-043656 | jenkins | v1.34.0 | 02 Oct 24 00:31 UTC | 02 Oct 24 00:31 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-043656 -- sudo | cert-options-043656 | jenkins | v1.34.0 | 02 Oct 24 00:31 UTC | 02 Oct 24 00:31 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-043656 | cert-options-043656 | jenkins | v1.34.0 | 02 Oct 24 00:31 UTC | 02 Oct 24 00:31 UTC |
| start | -p old-k8s-version-920941 | old-k8s-version-920941 | jenkins | v1.34.0 | 02 Oct 24 00:31 UTC | 02 Oct 24 00:34 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-920941 | old-k8s-version-920941 | jenkins | v1.34.0 | 02 Oct 24 00:34 UTC | 02 Oct 24 00:34 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-920941 | old-k8s-version-920941 | jenkins | v1.34.0 | 02 Oct 24 00:34 UTC | 02 Oct 24 00:34 UTC |
| | --alsologtostderr -v=3 | | | | | |
| start | -p cert-expiration-603955 | cert-expiration-603955 | jenkins | v1.34.0 | 02 Oct 24 00:34 UTC | 02 Oct 24 00:34 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-603955 | cert-expiration-603955 | jenkins | v1.34.0 | 02 Oct 24 00:34 UTC | 02 Oct 24 00:34 UTC |
| addons | enable dashboard -p old-k8s-version-920941 | old-k8s-version-920941 | jenkins | v1.34.0 | 02 Oct 24 00:34 UTC | 02 Oct 24 00:34 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-920941 | old-k8s-version-920941 | jenkins | v1.34.0 | 02 Oct 24 00:34 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p no-preload-643266 | no-preload-643266 | jenkins | v1.34.0 | 02 Oct 24 00:34 UTC | 02 Oct 24 00:35 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| addons | enable metrics-server -p no-preload-643266 | no-preload-643266 | jenkins | v1.34.0 | 02 Oct 24 00:35 UTC | 02 Oct 24 00:35 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-643266 | no-preload-643266 | jenkins | v1.34.0 | 02 Oct 24 00:35 UTC | 02 Oct 24 00:36 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-643266 | no-preload-643266 | jenkins | v1.34.0 | 02 Oct 24 00:36 UTC | 02 Oct 24 00:36 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-643266 | no-preload-643266 | jenkins | v1.34.0 | 02 Oct 24 00:36 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/10/02 00:36:03
Running on machine: ip-172-31-30-239
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1002 00:36:03.012083 1964993 out.go:345] Setting OutFile to fd 1 ...
I1002 00:36:03.012257 1964993 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1002 00:36:03.012287 1964993 out.go:358] Setting ErrFile to fd 2...
I1002 00:36:03.012311 1964993 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1002 00:36:03.012630 1964993 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19740-1745120/.minikube/bin
I1002 00:36:03.013100 1964993 out.go:352] Setting JSON to false
I1002 00:36:03.014388 1964993 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":29910,"bootTime":1727799453,"procs":232,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I1002 00:36:03.014474 1964993 start.go:139] virtualization:
I1002 00:36:03.017767 1964993 out.go:177] * [no-preload-643266] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I1002 00:36:03.019801 1964993 out.go:177] - MINIKUBE_LOCATION=19740
I1002 00:36:03.019869 1964993 notify.go:220] Checking for updates...
I1002 00:36:03.024496 1964993 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1002 00:36:03.026854 1964993 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19740-1745120/kubeconfig
I1002 00:36:03.029244 1964993 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19740-1745120/.minikube
I1002 00:36:03.031557 1964993 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I1002 00:36:03.033819 1964993 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1002 00:36:03.040196 1964993 config.go:182] Loaded profile config "no-preload-643266": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I1002 00:36:03.040787 1964993 driver.go:394] Setting default libvirt URI to qemu:///system
I1002 00:36:03.069802 1964993 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I1002 00:36:03.069937 1964993 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 00:36:03.127957 1964993 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:40 OomKillDisable:true NGoroutines:52 SystemTime:2024-10-02 00:36:03.116885482 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I1002 00:36:03.128076 1964993 docker.go:318] overlay module found
I1002 00:36:03.130835 1964993 out.go:177] * Using the docker driver based on existing profile
I1002 00:36:03.133066 1964993 start.go:297] selected driver: docker
I1002 00:36:03.133085 1964993 start.go:901] validating driver "docker" against &{Name:no-preload-643266 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-643266 Namespace:default APIServerHAVIP: APIServerN
ame:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false Moun
tString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 00:36:03.133196 1964993 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1002 00:36:03.133870 1964993 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 00:36:03.193480 1964993 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:40 OomKillDisable:true NGoroutines:52 SystemTime:2024-10-02 00:36:03.183554042 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I1002 00:36:03.193888 1964993 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1002 00:36:03.193918 1964993 cni.go:84] Creating CNI manager for ""
I1002 00:36:03.193963 1964993 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1002 00:36:03.194008 1964993 start.go:340] cluster config:
{Name:no-preload-643266 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-643266 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mou
ntIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 00:36:03.197302 1964993 out.go:177] * Starting "no-preload-643266" primary control-plane node in "no-preload-643266" cluster
I1002 00:36:03.199404 1964993 cache.go:121] Beginning downloading kic base image for docker with containerd
I1002 00:36:03.201267 1964993 out.go:177] * Pulling base image v0.0.45-1727731891-master ...
I1002 00:36:03.203447 1964993 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I1002 00:36:03.203558 1964993 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 in local docker daemon
I1002 00:36:03.203590 1964993 profile.go:143] Saving config to /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/no-preload-643266/config.json ...
I1002 00:36:03.203889 1964993 cache.go:107] acquiring lock: {Name:mk954e43b89743f42b2de507ef841acc0ca39d6c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 00:36:03.203972 1964993 cache.go:115] /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I1002 00:36:03.203986 1964993 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 110.193µs
I1002 00:36:03.203994 1964993 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I1002 00:36:03.204011 1964993 cache.go:107] acquiring lock: {Name:mk9bb3871f3086783b64ae807438df1fba64e594 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 00:36:03.204048 1964993 cache.go:115] /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.1 exists
I1002 00:36:03.204058 1964993 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.1" -> "/home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.1" took 49.156µs
I1002 00:36:03.204064 1964993 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.1 -> /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.1 succeeded
I1002 00:36:03.204074 1964993 cache.go:107] acquiring lock: {Name:mk4c51eaf8981d34d6598e6b8db8db3dd288a37a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 00:36:03.204102 1964993 cache.go:115] /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.1 exists
I1002 00:36:03.204111 1964993 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.1" -> "/home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.1" took 38.26µs
I1002 00:36:03.204118 1964993 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.1 -> /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.1 succeeded
I1002 00:36:03.204128 1964993 cache.go:107] acquiring lock: {Name:mkf2bf7103c8cfa890588d699e478e04e3da1e42 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 00:36:03.204164 1964993 cache.go:115] /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.1 exists
I1002 00:36:03.204174 1964993 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.1" -> "/home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.1" took 47.153µs
I1002 00:36:03.204180 1964993 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.1 -> /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.1 succeeded
I1002 00:36:03.204189 1964993 cache.go:107] acquiring lock: {Name:mk2fc743a4b7e5a56565f05839bd833f22721f05 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 00:36:03.204220 1964993 cache.go:115] /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.1 exists
I1002 00:36:03.204229 1964993 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.1" -> "/home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.1" took 41.468µs
I1002 00:36:03.204236 1964993 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.1 -> /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.1 succeeded
I1002 00:36:03.204245 1964993 cache.go:107] acquiring lock: {Name:mkaad64734fc1f6a80290eb17797507eac33c257 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 00:36:03.204282 1964993 cache.go:115] /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
I1002 00:36:03.204364 1964993 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 88.236µs
I1002 00:36:03.204379 1964993 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
I1002 00:36:03.204405 1964993 cache.go:107] acquiring lock: {Name:mkb1d087e33a18944023127d63db103ec03d9d82 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 00:36:03.204496 1964993 cache.go:115] /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 exists
I1002 00:36:03.204509 1964993 cache.go:96] cache image "registry.k8s.io/etcd:3.5.15-0" -> "/home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0" took 118.127µs
I1002 00:36:03.204532 1964993 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.15-0 -> /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 succeeded
I1002 00:36:03.204556 1964993 cache.go:107] acquiring lock: {Name:mk184f44675ab76a6f5b3df430dcbfedf4db9cdf Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 00:36:03.204597 1964993 cache.go:115] /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3 exists
I1002 00:36:03.204607 1964993 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.3" -> "/home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3" took 53.439µs
I1002 00:36:03.204613 1964993 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.3 -> /home/jenkins/minikube-integration/19740-1745120/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3 succeeded
I1002 00:36:03.204631 1964993 cache.go:87] Successfully saved all images to host disk.
I1002 00:36:03.228593 1964993 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 in local docker daemon, skipping pull
I1002 00:36:03.228613 1964993 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 exists in daemon, skipping load
I1002 00:36:03.228633 1964993 cache.go:194] Successfully downloaded all kic artifacts
I1002 00:36:03.228664 1964993 start.go:360] acquireMachinesLock for no-preload-643266: {Name:mk2ae7d5f7b92344b0265dafab4f316472219fd7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 00:36:03.228727 1964993 start.go:364] duration metric: took 47.909µs to acquireMachinesLock for "no-preload-643266"
I1002 00:36:03.228748 1964993 start.go:96] Skipping create...Using existing machine configuration
I1002 00:36:03.228754 1964993 fix.go:54] fixHost starting:
I1002 00:36:03.229109 1964993 cli_runner.go:164] Run: docker container inspect no-preload-643266 --format={{.State.Status}}
I1002 00:36:03.246840 1964993 fix.go:112] recreateIfNeeded on no-preload-643266: state=Stopped err=<nil>
W1002 00:36:03.246883 1964993 fix.go:138] unexpected machine state, will restart: <nil>
I1002 00:36:03.249430 1964993 out.go:177] * Restarting existing docker container for "no-preload-643266" ...
I1002 00:35:59.716913 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:01.717482 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:03.718388 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:03.251587 1964993 cli_runner.go:164] Run: docker start no-preload-643266
I1002 00:36:03.565967 1964993 cli_runner.go:164] Run: docker container inspect no-preload-643266 --format={{.State.Status}}
I1002 00:36:03.589683 1964993 kic.go:430] container "no-preload-643266" state is running.
I1002 00:36:03.590138 1964993 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-643266
I1002 00:36:03.615667 1964993 profile.go:143] Saving config to /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/no-preload-643266/config.json ...
I1002 00:36:03.615884 1964993 machine.go:93] provisionDockerMachine start ...
I1002 00:36:03.615949 1964993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-643266
I1002 00:36:03.637821 1964993 main.go:141] libmachine: Using SSH client type: native
I1002 00:36:03.638085 1964993 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 34965 <nil> <nil>}
I1002 00:36:03.638095 1964993 main.go:141] libmachine: About to run SSH command:
hostname
I1002 00:36:03.638854 1964993 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I1002 00:36:06.776014 1964993 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-643266
I1002 00:36:06.776038 1964993 ubuntu.go:169] provisioning hostname "no-preload-643266"
I1002 00:36:06.776156 1964993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-643266
I1002 00:36:06.794936 1964993 main.go:141] libmachine: Using SSH client type: native
I1002 00:36:06.795219 1964993 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 34965 <nil> <nil>}
I1002 00:36:06.795238 1964993 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-643266 && echo "no-preload-643266" | sudo tee /etc/hostname
I1002 00:36:06.953429 1964993 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-643266
I1002 00:36:06.953517 1964993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-643266
I1002 00:36:06.970857 1964993 main.go:141] libmachine: Using SSH client type: native
I1002 00:36:06.971123 1964993 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 34965 <nil> <nil>}
I1002 00:36:06.971147 1964993 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-643266' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-643266/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-643266' | sudo tee -a /etc/hosts;
fi
fi
I1002 00:36:07.108490 1964993 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1002 00:36:07.108517 1964993 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19740-1745120/.minikube CaCertPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19740-1745120/.minikube}
I1002 00:36:07.108549 1964993 ubuntu.go:177] setting up certificates
I1002 00:36:07.108558 1964993 provision.go:84] configureAuth start
I1002 00:36:07.108618 1964993 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-643266
I1002 00:36:07.125138 1964993 provision.go:143] copyHostCerts
I1002 00:36:07.125203 1964993 exec_runner.go:144] found /home/jenkins/minikube-integration/19740-1745120/.minikube/ca.pem, removing ...
I1002 00:36:07.125224 1964993 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19740-1745120/.minikube/ca.pem
I1002 00:36:07.125297 1964993 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19740-1745120/.minikube/ca.pem (1082 bytes)
I1002 00:36:07.125411 1964993 exec_runner.go:144] found /home/jenkins/minikube-integration/19740-1745120/.minikube/cert.pem, removing ...
I1002 00:36:07.125422 1964993 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19740-1745120/.minikube/cert.pem
I1002 00:36:07.125449 1964993 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19740-1745120/.minikube/cert.pem (1123 bytes)
I1002 00:36:07.125518 1964993 exec_runner.go:144] found /home/jenkins/minikube-integration/19740-1745120/.minikube/key.pem, removing ...
I1002 00:36:07.125527 1964993 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19740-1745120/.minikube/key.pem
I1002 00:36:07.125554 1964993 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19740-1745120/.minikube/key.pem (1675 bytes)
I1002 00:36:07.125606 1964993 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca-key.pem org=jenkins.no-preload-643266 san=[127.0.0.1 192.168.94.2 localhost minikube no-preload-643266]
I1002 00:36:07.502004 1964993 provision.go:177] copyRemoteCerts
I1002 00:36:07.502076 1964993 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1002 00:36:07.502127 1964993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-643266
I1002 00:36:07.519074 1964993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34965 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/no-preload-643266/id_rsa Username:docker}
I1002 00:36:07.618148 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1002 00:36:07.645121 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I1002 00:36:07.671758 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1002 00:36:07.698778 1964993 provision.go:87] duration metric: took 590.196986ms to configureAuth
I1002 00:36:07.698848 1964993 ubuntu.go:193] setting minikube options for container-runtime
I1002 00:36:07.699078 1964993 config.go:182] Loaded profile config "no-preload-643266": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I1002 00:36:07.699093 1964993 machine.go:96] duration metric: took 4.083201255s to provisionDockerMachine
I1002 00:36:07.699102 1964993 start.go:293] postStartSetup for "no-preload-643266" (driver="docker")
I1002 00:36:07.699113 1964993 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1002 00:36:07.699170 1964993 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1002 00:36:07.699219 1964993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-643266
I1002 00:36:07.721268 1964993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34965 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/no-preload-643266/id_rsa Username:docker}
I1002 00:36:07.824821 1964993 ssh_runner.go:195] Run: cat /etc/os-release
I1002 00:36:07.829260 1964993 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1002 00:36:07.829331 1964993 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I1002 00:36:07.829349 1964993 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I1002 00:36:07.829372 1964993 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I1002 00:36:07.829387 1964993 filesync.go:126] Scanning /home/jenkins/minikube-integration/19740-1745120/.minikube/addons for local assets ...
I1002 00:36:07.829460 1964993 filesync.go:126] Scanning /home/jenkins/minikube-integration/19740-1745120/.minikube/files for local assets ...
I1002 00:36:07.829565 1964993 filesync.go:149] local asset: /home/jenkins/minikube-integration/19740-1745120/.minikube/files/etc/ssl/certs/17505052.pem -> 17505052.pem in /etc/ssl/certs
I1002 00:36:07.829705 1964993 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1002 00:36:07.838575 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/files/etc/ssl/certs/17505052.pem --> /etc/ssl/certs/17505052.pem (1708 bytes)
I1002 00:36:07.863950 1964993 start.go:296] duration metric: took 164.830894ms for postStartSetup
I1002 00:36:07.864034 1964993 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1002 00:36:07.864075 1964993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-643266
I1002 00:36:07.881094 1964993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34965 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/no-preload-643266/id_rsa Username:docker}
I1002 00:36:07.974091 1964993 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1002 00:36:07.978822 1964993 fix.go:56] duration metric: took 4.750054323s for fixHost
I1002 00:36:07.978847 1964993 start.go:83] releasing machines lock for "no-preload-643266", held for 4.750111691s
I1002 00:36:07.978920 1964993 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-643266
I1002 00:36:07.994918 1964993 ssh_runner.go:195] Run: cat /version.json
I1002 00:36:07.994989 1964993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-643266
I1002 00:36:07.995261 1964993 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1002 00:36:07.995320 1964993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-643266
I1002 00:36:08.017266 1964993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34965 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/no-preload-643266/id_rsa Username:docker}
I1002 00:36:08.026641 1964993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34965 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/no-preload-643266/id_rsa Username:docker}
I1002 00:36:08.111759 1964993 ssh_runner.go:195] Run: systemctl --version
I1002 00:36:08.259449 1964993 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1002 00:36:08.264118 1964993 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I1002 00:36:08.283453 1964993 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I1002 00:36:08.283535 1964993 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1002 00:36:08.292611 1964993 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1002 00:36:08.292638 1964993 start.go:495] detecting cgroup driver to use...
I1002 00:36:08.292672 1964993 detect.go:187] detected "cgroupfs" cgroup driver on host os
I1002 00:36:08.292723 1964993 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1002 00:36:08.306650 1964993 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1002 00:36:08.318562 1964993 docker.go:217] disabling cri-docker service (if available) ...
I1002 00:36:08.318632 1964993 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1002 00:36:08.332079 1964993 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1002 00:36:08.343926 1964993 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1002 00:36:08.442764 1964993 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1002 00:36:08.539357 1964993 docker.go:233] disabling docker service ...
I1002 00:36:08.539452 1964993 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1002 00:36:08.552240 1964993 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1002 00:36:08.563849 1964993 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1002 00:36:08.645932 1964993 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1002 00:36:08.761762 1964993 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1002 00:36:08.787905 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1002 00:36:08.804861 1964993 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I1002 00:36:08.821875 1964993 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1002 00:36:08.832817 1964993 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I1002 00:36:08.832931 1964993 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I1002 00:36:08.843151 1964993 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1002 00:36:08.852906 1964993 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1002 00:36:08.862683 1964993 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1002 00:36:08.872378 1964993 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1002 00:36:08.881765 1964993 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1002 00:36:08.891575 1964993 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I1002 00:36:08.901977 1964993 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I1002 00:36:08.914260 1964993 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1002 00:36:08.923423 1964993 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1002 00:36:08.932264 1964993 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 00:36:09.021911 1964993 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1002 00:36:09.175407 1964993 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I1002 00:36:09.175526 1964993 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I1002 00:36:09.179199 1964993 start.go:563] Will wait 60s for crictl version
I1002 00:36:09.179305 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:36:09.182715 1964993 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1002 00:36:09.235874 1964993 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I1002 00:36:09.236009 1964993 ssh_runner.go:195] Run: containerd --version
I1002 00:36:09.263561 1964993 ssh_runner.go:195] Run: containerd --version
I1002 00:36:09.287463 1964993 out.go:177] * Preparing Kubernetes v1.31.1 on containerd 1.7.22 ...
I1002 00:36:06.217010 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:08.775943 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:09.289624 1964993 cli_runner.go:164] Run: docker network inspect no-preload-643266 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1002 00:36:09.303638 1964993 ssh_runner.go:195] Run: grep 192.168.94.1 host.minikube.internal$ /etc/hosts
I1002 00:36:09.307360 1964993 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1002 00:36:09.318053 1964993 kubeadm.go:883] updating cluster {Name:no-preload-643266 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-643266 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jen
kins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1002 00:36:09.318185 1964993 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I1002 00:36:09.318237 1964993 ssh_runner.go:195] Run: sudo crictl images --output json
I1002 00:36:09.361704 1964993 containerd.go:627] all images are preloaded for containerd runtime.
I1002 00:36:09.361739 1964993 cache_images.go:84] Images are preloaded, skipping loading
I1002 00:36:09.361748 1964993 kubeadm.go:934] updating node { 192.168.94.2 8443 v1.31.1 containerd true true} ...
I1002 00:36:09.361854 1964993 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-643266 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:no-preload-643266 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1002 00:36:09.361929 1964993 ssh_runner.go:195] Run: sudo crictl info
I1002 00:36:09.400820 1964993 cni.go:84] Creating CNI manager for ""
I1002 00:36:09.400895 1964993 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1002 00:36:09.400918 1964993 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I1002 00:36:09.400970 1964993 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-643266 NodeName:no-preload-643266 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodP
ath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1002 00:36:09.401146 1964993 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.94.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "no-preload-643266"
kubeletExtraArgs:
node-ip: 192.168.94.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1002 00:36:09.401233 1964993 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I1002 00:36:09.410461 1964993 binaries.go:44] Found k8s binaries, skipping transfer
I1002 00:36:09.410530 1964993 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1002 00:36:09.419198 1964993 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (321 bytes)
I1002 00:36:09.437436 1964993 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1002 00:36:09.455642 1964993 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2171 bytes)
I1002 00:36:09.473653 1964993 ssh_runner.go:195] Run: grep 192.168.94.2 control-plane.minikube.internal$ /etc/hosts
I1002 00:36:09.476899 1964993 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1002 00:36:09.488140 1964993 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 00:36:09.575909 1964993 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1002 00:36:09.592527 1964993 certs.go:68] Setting up /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/no-preload-643266 for IP: 192.168.94.2
I1002 00:36:09.592551 1964993 certs.go:194] generating shared ca certs ...
I1002 00:36:09.592569 1964993 certs.go:226] acquiring lock for ca certs: {Name:mkeb93c689dc39169cb991acba6d63d702f9e0e6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 00:36:09.592720 1964993 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/ca.key
I1002 00:36:09.592774 1964993 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/proxy-client-ca.key
I1002 00:36:09.592787 1964993 certs.go:256] generating profile certs ...
I1002 00:36:09.592869 1964993 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/no-preload-643266/client.key
I1002 00:36:09.592946 1964993 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/no-preload-643266/apiserver.key.73af85a7
I1002 00:36:09.592995 1964993 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/no-preload-643266/proxy-client.key
I1002 00:36:09.593165 1964993 certs.go:484] found cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/1750505.pem (1338 bytes)
W1002 00:36:09.593235 1964993 certs.go:480] ignoring /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/1750505_empty.pem, impossibly tiny 0 bytes
I1002 00:36:09.593249 1964993 certs.go:484] found cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca-key.pem (1679 bytes)
I1002 00:36:09.593278 1964993 certs.go:484] found cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/ca.pem (1082 bytes)
I1002 00:36:09.593306 1964993 certs.go:484] found cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/cert.pem (1123 bytes)
I1002 00:36:09.593335 1964993 certs.go:484] found cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/key.pem (1675 bytes)
I1002 00:36:09.593403 1964993 certs.go:484] found cert: /home/jenkins/minikube-integration/19740-1745120/.minikube/files/etc/ssl/certs/17505052.pem (1708 bytes)
I1002 00:36:09.594032 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1002 00:36:09.624825 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I1002 00:36:09.662130 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1002 00:36:09.698284 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I1002 00:36:09.742751 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/no-preload-643266/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I1002 00:36:09.783139 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/no-preload-643266/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1002 00:36:09.827711 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/no-preload-643266/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1002 00:36:09.855644 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/profiles/no-preload-643266/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1002 00:36:09.885405 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/files/etc/ssl/certs/17505052.pem --> /usr/share/ca-certificates/17505052.pem (1708 bytes)
I1002 00:36:09.920797 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1002 00:36:09.947679 1964993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19740-1745120/.minikube/certs/1750505.pem --> /usr/share/ca-certificates/1750505.pem (1338 bytes)
I1002 00:36:09.972682 1964993 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1002 00:36:09.990802 1964993 ssh_runner.go:195] Run: openssl version
I1002 00:36:09.999196 1964993 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/17505052.pem && ln -fs /usr/share/ca-certificates/17505052.pem /etc/ssl/certs/17505052.pem"
I1002 00:36:10.011327 1964993 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/17505052.pem
I1002 00:36:10.015466 1964993 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 1 23:54 /usr/share/ca-certificates/17505052.pem
I1002 00:36:10.015596 1964993 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/17505052.pem
I1002 00:36:10.024999 1964993 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/17505052.pem /etc/ssl/certs/3ec20f2e.0"
I1002 00:36:10.035682 1964993 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1002 00:36:10.047088 1964993 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1002 00:36:10.051373 1964993 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 1 23:43 /usr/share/ca-certificates/minikubeCA.pem
I1002 00:36:10.051476 1964993 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1002 00:36:10.058839 1964993 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1002 00:36:10.068022 1964993 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1750505.pem && ln -fs /usr/share/ca-certificates/1750505.pem /etc/ssl/certs/1750505.pem"
I1002 00:36:10.077605 1964993 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1750505.pem
I1002 00:36:10.081331 1964993 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 1 23:54 /usr/share/ca-certificates/1750505.pem
I1002 00:36:10.081431 1964993 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1750505.pem
I1002 00:36:10.088670 1964993 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1750505.pem /etc/ssl/certs/51391683.0"
I1002 00:36:10.098430 1964993 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1002 00:36:10.103906 1964993 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1002 00:36:10.111348 1964993 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1002 00:36:10.118378 1964993 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1002 00:36:10.125579 1964993 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1002 00:36:10.133393 1964993 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1002 00:36:10.141093 1964993 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1002 00:36:10.148227 1964993 kubeadm.go:392] StartCluster: {Name:no-preload-643266 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-643266 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkin
s:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 00:36:10.148332 1964993 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I1002 00:36:10.148412 1964993 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1002 00:36:10.185916 1964993 cri.go:89] found id: "4135867ed4acb2d1c331b95489e27f4be2485ad15403545148d1824e5f1c4e8f"
I1002 00:36:10.185940 1964993 cri.go:89] found id: "1d500cb37211f32dd14aa83f29576fc4093384b3d5410f2ae3d57c4de3b64e1d"
I1002 00:36:10.185946 1964993 cri.go:89] found id: "d07462c96835f050f80d7a77904167c7b1f098fb86b43d54b2a294050dc35701"
I1002 00:36:10.185961 1964993 cri.go:89] found id: "a01e2f4ff5d8ed78b9df7324f5550f47a624ae296408c70204ff351a1b2e4ad0"
I1002 00:36:10.185965 1964993 cri.go:89] found id: "7cb4fe5d533b8ec48fe48950e554c6aba769ee754aa13719bdb5078978fbfeb6"
I1002 00:36:10.185968 1964993 cri.go:89] found id: "6d268abb1217cac0a576b1f76c6914b8c8d323cf46b9da078c742aeac3f2fb83"
I1002 00:36:10.185972 1964993 cri.go:89] found id: "66577b32134293bb35dd337993a9291b47071541572d1e97c391dbf01350de33"
I1002 00:36:10.185975 1964993 cri.go:89] found id: "200cc54dc91df970755d5924d60cfcdfeea81697ac0a49ddae44e074ffab6870"
I1002 00:36:10.185985 1964993 cri.go:89] found id: ""
I1002 00:36:10.186045 1964993 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I1002 00:36:10.198519 1964993 cri.go:116] JSON = null
W1002 00:36:10.198568 1964993 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I1002 00:36:10.198648 1964993 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1002 00:36:10.207584 1964993 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I1002 00:36:10.207602 1964993 kubeadm.go:593] restartPrimaryControlPlane start ...
I1002 00:36:10.207663 1964993 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1002 00:36:10.226306 1964993 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1002 00:36:10.226956 1964993 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-643266" does not appear in /home/jenkins/minikube-integration/19740-1745120/kubeconfig
I1002 00:36:10.227265 1964993 kubeconfig.go:62] /home/jenkins/minikube-integration/19740-1745120/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-643266" cluster setting kubeconfig missing "no-preload-643266" context setting]
I1002 00:36:10.227741 1964993 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19740-1745120/kubeconfig: {Name:mk014bd742e0b0f4a72d987c0fd643ed22274647 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 00:36:10.229536 1964993 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1002 00:36:10.242759 1964993 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.94.2
I1002 00:36:10.242792 1964993 kubeadm.go:597] duration metric: took 35.183679ms to restartPrimaryControlPlane
I1002 00:36:10.242802 1964993 kubeadm.go:394] duration metric: took 94.586363ms to StartCluster
I1002 00:36:10.242817 1964993 settings.go:142] acquiring lock: {Name:mk200f8894606b147c1230e7434ca41f474a2cee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 00:36:10.242901 1964993 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19740-1745120/kubeconfig
I1002 00:36:10.243921 1964993 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19740-1745120/kubeconfig: {Name:mk014bd742e0b0f4a72d987c0fd643ed22274647 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 00:36:10.244128 1964993 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I1002 00:36:10.244444 1964993 config.go:182] Loaded profile config "no-preload-643266": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I1002 00:36:10.244625 1964993 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1002 00:36:10.244693 1964993 addons.go:69] Setting storage-provisioner=true in profile "no-preload-643266"
I1002 00:36:10.244714 1964993 addons.go:234] Setting addon storage-provisioner=true in "no-preload-643266"
W1002 00:36:10.244729 1964993 addons.go:243] addon storage-provisioner should already be in state true
I1002 00:36:10.244754 1964993 host.go:66] Checking if "no-preload-643266" exists ...
I1002 00:36:10.245249 1964993 cli_runner.go:164] Run: docker container inspect no-preload-643266 --format={{.State.Status}}
I1002 00:36:10.245439 1964993 addons.go:69] Setting default-storageclass=true in profile "no-preload-643266"
I1002 00:36:10.245459 1964993 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-643266"
I1002 00:36:10.245724 1964993 cli_runner.go:164] Run: docker container inspect no-preload-643266 --format={{.State.Status}}
I1002 00:36:10.245832 1964993 addons.go:69] Setting metrics-server=true in profile "no-preload-643266"
I1002 00:36:10.245868 1964993 addons.go:234] Setting addon metrics-server=true in "no-preload-643266"
W1002 00:36:10.245906 1964993 addons.go:243] addon metrics-server should already be in state true
I1002 00:36:10.245951 1964993 host.go:66] Checking if "no-preload-643266" exists ...
I1002 00:36:10.246498 1964993 cli_runner.go:164] Run: docker container inspect no-preload-643266 --format={{.State.Status}}
I1002 00:36:10.248376 1964993 addons.go:69] Setting dashboard=true in profile "no-preload-643266"
I1002 00:36:10.249100 1964993 addons.go:234] Setting addon dashboard=true in "no-preload-643266"
W1002 00:36:10.249123 1964993 addons.go:243] addon dashboard should already be in state true
I1002 00:36:10.249158 1964993 host.go:66] Checking if "no-preload-643266" exists ...
I1002 00:36:10.249621 1964993 cli_runner.go:164] Run: docker container inspect no-preload-643266 --format={{.State.Status}}
I1002 00:36:10.249075 1964993 out.go:177] * Verifying Kubernetes components...
I1002 00:36:10.255058 1964993 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 00:36:10.290895 1964993 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1002 00:36:10.295873 1964993 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1002 00:36:10.295897 1964993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1002 00:36:10.295966 1964993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-643266
I1002 00:36:10.318758 1964993 addons.go:234] Setting addon default-storageclass=true in "no-preload-643266"
W1002 00:36:10.318783 1964993 addons.go:243] addon default-storageclass should already be in state true
I1002 00:36:10.318808 1964993 host.go:66] Checking if "no-preload-643266" exists ...
I1002 00:36:10.319234 1964993 cli_runner.go:164] Run: docker container inspect no-preload-643266 --format={{.State.Status}}
I1002 00:36:10.326350 1964993 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I1002 00:36:10.339222 1964993 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I1002 00:36:10.339265 1964993 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I1002 00:36:10.339340 1964993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-643266
I1002 00:36:10.361995 1964993 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I1002 00:36:10.363939 1964993 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1002 00:36:10.368746 1964993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34965 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/no-preload-643266/id_rsa Username:docker}
I1002 00:36:10.372656 1964993 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I1002 00:36:10.372677 1964993 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1002 00:36:10.372739 1964993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-643266
I1002 00:36:10.371528 1964993 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1002 00:36:10.372921 1964993 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1002 00:36:10.372958 1964993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-643266
I1002 00:36:10.392657 1964993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34965 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/no-preload-643266/id_rsa Username:docker}
I1002 00:36:10.412698 1964993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34965 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/no-preload-643266/id_rsa Username:docker}
I1002 00:36:10.437985 1964993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34965 SSHKeyPath:/home/jenkins/minikube-integration/19740-1745120/.minikube/machines/no-preload-643266/id_rsa Username:docker}
I1002 00:36:10.448906 1964993 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1002 00:36:10.509441 1964993 node_ready.go:35] waiting up to 6m0s for node "no-preload-643266" to be "Ready" ...
I1002 00:36:10.622826 1964993 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1002 00:36:10.670692 1964993 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1002 00:36:10.738654 1964993 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I1002 00:36:10.738699 1964993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I1002 00:36:10.800353 1964993 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1002 00:36:10.800382 1964993 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1002 00:36:10.861048 1964993 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I1002 00:36:10.861085 1964993 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I1002 00:36:10.919243 1964993 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1002 00:36:10.919278 1964993 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
W1002 00:36:10.953419 1964993 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1002 00:36:10.953460 1964993 retry.go:31] will retry after 294.487568ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1002 00:36:11.100923 1964993 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I1002 00:36:11.100951 1964993 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I1002 00:36:11.109648 1964993 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1002 00:36:11.109669 1964993 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W1002 00:36:11.195487 1964993 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1002 00:36:11.195522 1964993 retry.go:31] will retry after 249.86166ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1002 00:36:11.249088 1964993 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1002 00:36:11.252548 1964993 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1002 00:36:11.259216 1964993 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1002 00:36:11.259242 1964993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1002 00:36:11.395490 1964993 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I1002 00:36:11.395519 1964993 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1002 00:36:11.445820 1964993 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1002 00:36:11.602033 1964993 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1002 00:36:11.602071 1964993 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1002 00:36:11.829578 1964993 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1002 00:36:11.829605 1964993 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1002 00:36:11.855398 1964993 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1002 00:36:11.855447 1964993 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1002 00:36:11.903504 1964993 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1002 00:36:11.903531 1964993 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1002 00:36:11.953696 1964993 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1002 00:36:11.217838 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:13.217946 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:15.558245 1964993 node_ready.go:49] node "no-preload-643266" has status "Ready":"True"
I1002 00:36:15.558267 1964993 node_ready.go:38] duration metric: took 5.048772346s for node "no-preload-643266" to be "Ready" ...
I1002 00:36:15.558277 1964993 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1002 00:36:15.610948 1964993 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-tx6q7" in "kube-system" namespace to be "Ready" ...
I1002 00:36:15.715651 1964993 pod_ready.go:93] pod "coredns-7c65d6cfc9-tx6q7" in "kube-system" namespace has status "Ready":"True"
I1002 00:36:15.715723 1964993 pod_ready.go:82] duration metric: took 104.687286ms for pod "coredns-7c65d6cfc9-tx6q7" in "kube-system" namespace to be "Ready" ...
I1002 00:36:15.715750 1964993 pod_ready.go:79] waiting up to 6m0s for pod "etcd-no-preload-643266" in "kube-system" namespace to be "Ready" ...
I1002 00:36:15.757465 1964993 pod_ready.go:93] pod "etcd-no-preload-643266" in "kube-system" namespace has status "Ready":"True"
I1002 00:36:15.757541 1964993 pod_ready.go:82] duration metric: took 41.770308ms for pod "etcd-no-preload-643266" in "kube-system" namespace to be "Ready" ...
I1002 00:36:15.757570 1964993 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-no-preload-643266" in "kube-system" namespace to be "Ready" ...
I1002 00:36:15.811329 1964993 pod_ready.go:93] pod "kube-apiserver-no-preload-643266" in "kube-system" namespace has status "Ready":"True"
I1002 00:36:15.811389 1964993 pod_ready.go:82] duration metric: took 53.79767ms for pod "kube-apiserver-no-preload-643266" in "kube-system" namespace to be "Ready" ...
I1002 00:36:15.811414 1964993 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-no-preload-643266" in "kube-system" namespace to be "Ready" ...
I1002 00:36:15.833527 1964993 pod_ready.go:93] pod "kube-controller-manager-no-preload-643266" in "kube-system" namespace has status "Ready":"True"
I1002 00:36:15.833599 1964993 pod_ready.go:82] duration metric: took 22.164478ms for pod "kube-controller-manager-no-preload-643266" in "kube-system" namespace to be "Ready" ...
I1002 00:36:15.833626 1964993 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-n9zrc" in "kube-system" namespace to be "Ready" ...
I1002 00:36:15.840447 1964993 pod_ready.go:93] pod "kube-proxy-n9zrc" in "kube-system" namespace has status "Ready":"True"
I1002 00:36:15.840529 1964993 pod_ready.go:82] duration metric: took 6.875263ms for pod "kube-proxy-n9zrc" in "kube-system" namespace to be "Ready" ...
I1002 00:36:15.840556 1964993 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-no-preload-643266" in "kube-system" namespace to be "Ready" ...
I1002 00:36:17.848129 1964993 pod_ready.go:103] pod "kube-scheduler-no-preload-643266" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:18.757583 1964993 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.508447612s)
I1002 00:36:18.795470 1964993 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.542881507s)
I1002 00:36:18.795567 1964993 addons.go:475] Verifying addon metrics-server=true in "no-preload-643266"
I1002 00:36:18.795655 1964993 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (7.349800755s)
I1002 00:36:18.795948 1964993 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (6.842211532s)
I1002 00:36:18.798304 1964993 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-643266 addons enable metrics-server
I1002 00:36:18.804997 1964993 out.go:177] * Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
I1002 00:36:15.219050 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:17.223403 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:18.807018 1964993 addons.go:510] duration metric: took 8.562387094s for enable addons: enabled=[storage-provisioner metrics-server dashboard default-storageclass]
I1002 00:36:20.346907 1964993 pod_ready.go:103] pod "kube-scheduler-no-preload-643266" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:22.347409 1964993 pod_ready.go:103] pod "kube-scheduler-no-preload-643266" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:19.717704 1957595 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:21.216971 1957595 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"True"
I1002 00:36:21.216996 1957595 pod_ready.go:82] duration metric: took 1m11.006105841s for pod "kube-controller-manager-old-k8s-version-920941" in "kube-system" namespace to be "Ready" ...
I1002 00:36:21.217007 1957595 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-42b7q" in "kube-system" namespace to be "Ready" ...
I1002 00:36:21.221776 1957595 pod_ready.go:93] pod "kube-proxy-42b7q" in "kube-system" namespace has status "Ready":"True"
I1002 00:36:21.221801 1957595 pod_ready.go:82] duration metric: took 4.785683ms for pod "kube-proxy-42b7q" in "kube-system" namespace to be "Ready" ...
I1002 00:36:21.221814 1957595 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-920941" in "kube-system" namespace to be "Ready" ...
I1002 00:36:23.227502 1957595 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:24.847175 1964993 pod_ready.go:103] pod "kube-scheduler-no-preload-643266" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:26.847423 1964993 pod_ready.go:103] pod "kube-scheduler-no-preload-643266" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:25.228486 1957595 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:26.228584 1957595 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-920941" in "kube-system" namespace has status "Ready":"True"
I1002 00:36:26.228662 1957595 pod_ready.go:82] duration metric: took 5.006839188s for pod "kube-scheduler-old-k8s-version-920941" in "kube-system" namespace to be "Ready" ...
I1002 00:36:26.228688 1957595 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace to be "Ready" ...
I1002 00:36:28.234816 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:28.346732 1964993 pod_ready.go:93] pod "kube-scheduler-no-preload-643266" in "kube-system" namespace has status "Ready":"True"
I1002 00:36:28.346805 1964993 pod_ready.go:82] duration metric: took 12.506228267s for pod "kube-scheduler-no-preload-643266" in "kube-system" namespace to be "Ready" ...
I1002 00:36:28.346831 1964993 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace to be "Ready" ...
I1002 00:36:30.353473 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:32.353504 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:30.236092 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:32.736345 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:34.853505 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:37.353203 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:35.234991 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:37.235434 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:39.236103 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:39.853232 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:42.353771 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:41.236546 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:43.735666 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:44.853109 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:47.352279 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:46.235955 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:48.734957 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:49.352583 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:51.355860 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:50.735615 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:52.735648 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:53.852511 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:56.353123 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:55.236733 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:57.239178 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:58.853415 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:01.353115 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:36:59.734959 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:01.735219 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:04.237345 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:03.852235 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:05.853363 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:07.860997 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:06.735087 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:08.735842 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:10.353155 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:12.353356 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:11.235348 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:13.735763 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:14.853005 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:16.853544 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:16.234810 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:18.235343 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:19.353091 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:21.353914 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:20.735050 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:23.235940 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:23.852324 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:25.853117 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:27.853530 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:25.735045 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:28.234568 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:30.353115 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:32.353593 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:30.235503 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:32.735295 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:34.853499 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:37.352549 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:35.235317 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:37.734651 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:39.357458 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:41.853137 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:40.235325 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:42.235666 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:44.356991 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:46.852913 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:44.735462 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:47.234819 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:49.235228 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:49.353588 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:51.853048 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:51.734924 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:53.735129 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:53.853802 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:56.353155 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:56.234708 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:58.735319 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:37:58.853028 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:01.353740 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:01.234117 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:03.235524 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:03.852907 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:05.853327 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:05.735867 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:08.235269 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:08.352854 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:10.355097 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:12.853707 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:10.235566 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:12.735472 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:15.352858 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:17.353392 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:14.737310 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:17.234735 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:19.854973 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:22.353605 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:19.735217 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:21.735317 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:24.235157 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:24.852694 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:26.853139 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:26.734605 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:28.734860 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:28.853304 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:31.352962 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:30.735008 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:33.234148 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:33.852770 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:36.352821 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:35.234909 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:37.735168 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:38.361643 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:40.853153 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:42.853562 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:39.735540 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:41.735835 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:44.235027 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:45.352516 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:47.352683 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:46.734386 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:48.735126 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:49.352907 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:51.353053 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:50.736039 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:53.234472 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:53.853244 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:56.353621 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:55.234593 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:57.235198 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:59.235364 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:38:58.852889 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:01.352989 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:01.235569 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:03.735110 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:03.852333 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:05.852439 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:07.853669 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:06.235324 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:08.734702 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:09.854272 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:12.352949 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:10.736790 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:13.235130 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:14.853880 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:17.352077 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:15.235733 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:17.734764 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:19.352662 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:21.353365 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:19.734977 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:21.735890 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:24.235463 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:23.853180 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:26.353270 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:26.235565 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:28.735069 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:28.853590 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:31.353512 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:30.735329 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:32.736129 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:33.852933 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:35.853533 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:37.853771 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:35.235603 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:37.734912 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:40.353391 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:42.353774 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:39.736246 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:42.235540 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:44.853309 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:47.353347 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:44.735190 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:47.236303 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:49.852702 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:52.353743 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:49.736213 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:52.235593 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:54.852900 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:57.352486 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:54.735856 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:57.235708 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:59.352844 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:01.852856 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:39:59.735217 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:02.235341 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:04.235464 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:03.853388 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:06.353341 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:06.752875 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:09.235497 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:08.853298 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:11.352652 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:11.739045 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:14.234873 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:13.353618 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:15.852556 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:17.853234 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:16.734971 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:18.735025 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:19.853878 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:22.353470 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:21.234561 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:23.735307 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:24.852830 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:27.354837 1964993 pod_ready.go:103] pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:25.735630 1957595 pod_ready.go:103] pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace has status "Ready":"False"
I1002 00:40:26.235407 1957595 pod_ready.go:82] duration metric: took 4m0.006692573s for pod "metrics-server-9975d5f86-49vwr" in "kube-system" namespace to be "Ready" ...
E1002 00:40:26.235429 1957595 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I1002 00:40:26.235438 1957595 pod_ready.go:39] duration metric: took 5m27.530349402s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1002 00:40:26.235452 1957595 api_server.go:52] waiting for apiserver process to appear ...
I1002 00:40:26.235482 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I1002 00:40:26.235571 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1002 00:40:26.281727 1957595 cri.go:89] found id: "0a25b599263d779d6664295d455c78ad67aae1ea393696c88eb6887fedc9bf29"
I1002 00:40:26.281798 1957595 cri.go:89] found id: "11ec001392bd7c1b6e1804233a847099114357802451cb3dfc4f819481c9eac5"
I1002 00:40:26.281808 1957595 cri.go:89] found id: ""
I1002 00:40:26.281817 1957595 logs.go:282] 2 containers: [0a25b599263d779d6664295d455c78ad67aae1ea393696c88eb6887fedc9bf29 11ec001392bd7c1b6e1804233a847099114357802451cb3dfc4f819481c9eac5]
I1002 00:40:26.281883 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.285748 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.289204 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I1002 00:40:26.289276 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1002 00:40:26.330580 1957595 cri.go:89] found id: "ab6cea850151c0b10687176375d47fb249199d273efd44a9c5d6a1d39e3f623a"
I1002 00:40:26.330601 1957595 cri.go:89] found id: "8c7992aa581c091fd0ff51c777b72d5212ca433204a6a429359b1bf731b055f4"
I1002 00:40:26.330606 1957595 cri.go:89] found id: ""
I1002 00:40:26.330613 1957595 logs.go:282] 2 containers: [ab6cea850151c0b10687176375d47fb249199d273efd44a9c5d6a1d39e3f623a 8c7992aa581c091fd0ff51c777b72d5212ca433204a6a429359b1bf731b055f4]
I1002 00:40:26.330687 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.334426 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.338199 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I1002 00:40:26.338294 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1002 00:40:26.383276 1957595 cri.go:89] found id: "9f4ef323c339f7d0dd395ca641e6b83c6ee625242e1e405bcb230f0280f833f9"
I1002 00:40:26.383301 1957595 cri.go:89] found id: "8518536c30aef09017c911aee769571a3ca250e88cc9853905c824c874626cac"
I1002 00:40:26.383306 1957595 cri.go:89] found id: ""
I1002 00:40:26.383323 1957595 logs.go:282] 2 containers: [9f4ef323c339f7d0dd395ca641e6b83c6ee625242e1e405bcb230f0280f833f9 8518536c30aef09017c911aee769571a3ca250e88cc9853905c824c874626cac]
I1002 00:40:26.383404 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.387099 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.390623 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I1002 00:40:26.390695 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1002 00:40:26.427645 1957595 cri.go:89] found id: "87d3a4aa9e474d9d563b52794771a880f456688ecc28b5c9391254d7e388d601"
I1002 00:40:26.427672 1957595 cri.go:89] found id: "19bd9ef04d15a6dccf5970eea7159536699fa21c02ae6b578cb94fb5a6c7af6a"
I1002 00:40:26.427683 1957595 cri.go:89] found id: ""
I1002 00:40:26.427691 1957595 logs.go:282] 2 containers: [87d3a4aa9e474d9d563b52794771a880f456688ecc28b5c9391254d7e388d601 19bd9ef04d15a6dccf5970eea7159536699fa21c02ae6b578cb94fb5a6c7af6a]
I1002 00:40:26.427749 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.431220 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.434462 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I1002 00:40:26.434533 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1002 00:40:26.474025 1957595 cri.go:89] found id: "8ff3cc680606db52e7aec936aa5a3da89b1f05ec9c72362a02657eefc93740a6"
I1002 00:40:26.474046 1957595 cri.go:89] found id: "7d0046a7ae8533f8fe5ca98c95ba71a7292736d0effab8db2b682672e751ab5f"
I1002 00:40:26.474051 1957595 cri.go:89] found id: ""
I1002 00:40:26.474058 1957595 logs.go:282] 2 containers: [8ff3cc680606db52e7aec936aa5a3da89b1f05ec9c72362a02657eefc93740a6 7d0046a7ae8533f8fe5ca98c95ba71a7292736d0effab8db2b682672e751ab5f]
I1002 00:40:26.474118 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.478508 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.482063 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I1002 00:40:26.482131 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1002 00:40:26.529778 1957595 cri.go:89] found id: "ad357c0209d969730c7b744d5c2fbad0a7c610d618ddddb9a2fc771ce023b605"
I1002 00:40:26.529803 1957595 cri.go:89] found id: "9882de920e5952a14a2e090a9a310cf476deae60c93e9ecd7f4384e8d6012f04"
I1002 00:40:26.529809 1957595 cri.go:89] found id: ""
I1002 00:40:26.529817 1957595 logs.go:282] 2 containers: [ad357c0209d969730c7b744d5c2fbad0a7c610d618ddddb9a2fc771ce023b605 9882de920e5952a14a2e090a9a310cf476deae60c93e9ecd7f4384e8d6012f04]
I1002 00:40:26.529877 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.533446 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.536980 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I1002 00:40:26.537109 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1002 00:40:26.578079 1957595 cri.go:89] found id: "a767e421df83a00b32383377cc55e4151e7bd6f66d1066e2c265fd0d78172cac"
I1002 00:40:26.578103 1957595 cri.go:89] found id: "1051ac83c993493af1544df235a7ec482b2588f13293c80a3af3112eff956a41"
I1002 00:40:26.578108 1957595 cri.go:89] found id: ""
I1002 00:40:26.578116 1957595 logs.go:282] 2 containers: [a767e421df83a00b32383377cc55e4151e7bd6f66d1066e2c265fd0d78172cac 1051ac83c993493af1544df235a7ec482b2588f13293c80a3af3112eff956a41]
I1002 00:40:26.578172 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.581929 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.585716 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I1002 00:40:26.585837 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I1002 00:40:26.634661 1957595 cri.go:89] found id: "287dac3a47db438435ee5f4915263ed26e3f6eae852bb618365b6490d95b4453"
I1002 00:40:26.634692 1957595 cri.go:89] found id: "4a7d63ad64058ab8a816f95771113a6646e7f49235241d0b9c99ee631cdf7f38"
I1002 00:40:26.634697 1957595 cri.go:89] found id: ""
I1002 00:40:26.634704 1957595 logs.go:282] 2 containers: [287dac3a47db438435ee5f4915263ed26e3f6eae852bb618365b6490d95b4453 4a7d63ad64058ab8a816f95771113a6646e7f49235241d0b9c99ee631cdf7f38]
I1002 00:40:26.634769 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.638476 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.641979 1957595 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I1002 00:40:26.642082 1957595 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I1002 00:40:26.684232 1957595 cri.go:89] found id: "6d607cf4c97f9850c9226c3b461edd448574512ffe663325bf684f333c1bef50"
I1002 00:40:26.684295 1957595 cri.go:89] found id: ""
I1002 00:40:26.684318 1957595 logs.go:282] 1 containers: [6d607cf4c97f9850c9226c3b461edd448574512ffe663325bf684f333c1bef50]
I1002 00:40:26.684407 1957595 ssh_runner.go:195] Run: which crictl
I1002 00:40:26.688115 1957595 logs.go:123] Gathering logs for describe nodes ...
I1002 00:40:26.688142 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I1002 00:40:26.840427 1957595 logs.go:123] Gathering logs for kube-apiserver [0a25b599263d779d6664295d455c78ad67aae1ea393696c88eb6887fedc9bf29] ...
I1002 00:40:26.840617 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0a25b599263d779d6664295d455c78ad67aae1ea393696c88eb6887fedc9bf29"
I1002 00:40:26.907015 1957595 logs.go:123] Gathering logs for etcd [ab6cea850151c0b10687176375d47fb249199d273efd44a9c5d6a1d39e3f623a] ...
I1002 00:40:26.907065 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ab6cea850151c0b10687176375d47fb249199d273efd44a9c5d6a1d39e3f623a"
I1002 00:40:26.952130 1957595 logs.go:123] Gathering logs for coredns [9f4ef323c339f7d0dd395ca641e6b83c6ee625242e1e405bcb230f0280f833f9] ...
I1002 00:40:26.952161 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9f4ef323c339f7d0dd395ca641e6b83c6ee625242e1e405bcb230f0280f833f9"
I1002 00:40:26.993101 1957595 logs.go:123] Gathering logs for coredns [8518536c30aef09017c911aee769571a3ca250e88cc9853905c824c874626cac] ...
I1002 00:40:26.993131 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8518536c30aef09017c911aee769571a3ca250e88cc9853905c824c874626cac"
I1002 00:40:27.051452 1957595 logs.go:123] Gathering logs for kube-proxy [8ff3cc680606db52e7aec936aa5a3da89b1f05ec9c72362a02657eefc93740a6] ...
I1002 00:40:27.051531 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8ff3cc680606db52e7aec936aa5a3da89b1f05ec9c72362a02657eefc93740a6"
I1002 00:40:27.101863 1957595 logs.go:123] Gathering logs for kubelet ...
I1002 00:40:27.101891 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W1002 00:40:27.165499 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.403474 657 reflector.go:138] object-"kube-system"/"kube-proxy-token-72v75": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-72v75" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.165767 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.403634 657 reflector.go:138] object-"kube-system"/"kindnet-token-drxz7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-drxz7" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.165977 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.403804 657 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.166190 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.403951 657 reflector.go:138] object-"kube-system"/"coredns-token-p2g4h": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-p2g4h" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.166401 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.406263 657 reflector.go:138] object-"default"/"default-token-lmpgm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-lmpgm" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.166604 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.406638 657 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.166826 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.406794 657 reflector.go:138] object-"kube-system"/"metrics-server-token-x2fml": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-x2fml" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.167052 1957595 logs.go:138] Found kubelet problem: Oct 02 00:34:58 old-k8s-version-920941 kubelet[657]: E1002 00:34:58.406955 657 reflector.go:138] object-"kube-system"/"storage-provisioner-token-2v6pp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-2v6pp" is forbidden: User "system:node:old-k8s-version-920941" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-920941' and this object
W1002 00:40:27.175955 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:02 old-k8s-version-920941 kubelet[657]: E1002 00:35:02.816096 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1002 00:40:27.176152 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:03 old-k8s-version-920941 kubelet[657]: E1002 00:35:03.404518 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.179250 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:17 old-k8s-version-920941 kubelet[657]: E1002 00:35:17.054839 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1002 00:40:27.180905 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:24 old-k8s-version-920941 kubelet[657]: E1002 00:35:24.463670 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.181701 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:25 old-k8s-version-920941 kubelet[657]: E1002 00:35:25.467856 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.181887 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:28 old-k8s-version-920941 kubelet[657]: E1002 00:35:28.036655 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.182213 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:32 old-k8s-version-920941 kubelet[657]: E1002 00:35:32.484516 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.182651 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:32 old-k8s-version-920941 kubelet[657]: E1002 00:35:32.507888 657 pod_workers.go:191] Error syncing pod 4cf65c92-656f-422a-952b-05891b36cb68 ("storage-provisioner_kube-system(4cf65c92-656f-422a-952b-05891b36cb68)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(4cf65c92-656f-422a-952b-05891b36cb68)"
W1002 00:40:27.185453 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:39 old-k8s-version-920941 kubelet[657]: E1002 00:35:39.045417 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1002 00:40:27.186187 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:46 old-k8s-version-920941 kubelet[657]: E1002 00:35:46.553569 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.186376 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:50 old-k8s-version-920941 kubelet[657]: E1002 00:35:50.037065 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.186705 1957595 logs.go:138] Found kubelet problem: Oct 02 00:35:52 old-k8s-version-920941 kubelet[657]: E1002 00:35:52.484920 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.186890 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:01 old-k8s-version-920941 kubelet[657]: E1002 00:36:01.036920 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.187229 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:05 old-k8s-version-920941 kubelet[657]: E1002 00:36:05.038238 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.187413 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:14 old-k8s-version-920941 kubelet[657]: E1002 00:36:14.037429 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.187999 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:17 old-k8s-version-920941 kubelet[657]: E1002 00:36:17.639596 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.188326 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:22 old-k8s-version-920941 kubelet[657]: E1002 00:36:22.485499 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.190840 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:25 old-k8s-version-920941 kubelet[657]: E1002 00:36:25.067982 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1002 00:40:27.191173 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:36 old-k8s-version-920941 kubelet[657]: E1002 00:36:36.036206 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.191359 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:37 old-k8s-version-920941 kubelet[657]: E1002 00:36:37.038810 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.191686 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:49 old-k8s-version-920941 kubelet[657]: E1002 00:36:49.045805 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.191870 1957595 logs.go:138] Found kubelet problem: Oct 02 00:36:50 old-k8s-version-920941 kubelet[657]: E1002 00:36:50.037091 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.192053 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:03 old-k8s-version-920941 kubelet[657]: E1002 00:37:03.040054 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.192644 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:04 old-k8s-version-920941 kubelet[657]: E1002 00:37:04.765096 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.192971 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:12 old-k8s-version-920941 kubelet[657]: E1002 00:37:12.484569 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.193163 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:17 old-k8s-version-920941 kubelet[657]: E1002 00:37:17.036843 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.193488 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:27 old-k8s-version-920941 kubelet[657]: E1002 00:37:27.037002 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.193671 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:28 old-k8s-version-920941 kubelet[657]: E1002 00:37:28.036803 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.193857 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:40 old-k8s-version-920941 kubelet[657]: E1002 00:37:40.036708 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.194183 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:42 old-k8s-version-920941 kubelet[657]: E1002 00:37:42.036260 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.194508 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:54 old-k8s-version-920941 kubelet[657]: E1002 00:37:54.036836 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.196937 1957595 logs.go:138] Found kubelet problem: Oct 02 00:37:54 old-k8s-version-920941 kubelet[657]: E1002 00:37:54.044847 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1002 00:40:27.197264 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:05 old-k8s-version-920941 kubelet[657]: E1002 00:38:05.036582 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.197450 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:07 old-k8s-version-920941 kubelet[657]: E1002 00:38:07.040872 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.197779 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:17 old-k8s-version-920941 kubelet[657]: E1002 00:38:17.036860 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.197964 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:21 old-k8s-version-920941 kubelet[657]: E1002 00:38:21.036821 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.198554 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:29 old-k8s-version-920941 kubelet[657]: E1002 00:38:29.977771 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.198882 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:32 old-k8s-version-920941 kubelet[657]: E1002 00:38:32.484422 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.199066 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:36 old-k8s-version-920941 kubelet[657]: E1002 00:38:36.036591 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.199394 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:46 old-k8s-version-920941 kubelet[657]: E1002 00:38:46.036189 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.199582 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:50 old-k8s-version-920941 kubelet[657]: E1002 00:38:50.036961 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.199907 1957595 logs.go:138] Found kubelet problem: Oct 02 00:38:59 old-k8s-version-920941 kubelet[657]: E1002 00:38:59.040242 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.200091 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:04 old-k8s-version-920941 kubelet[657]: E1002 00:39:04.036603 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.200416 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:11 old-k8s-version-920941 kubelet[657]: E1002 00:39:11.036751 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.200607 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:17 old-k8s-version-920941 kubelet[657]: E1002 00:39:17.036726 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.200935 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:26 old-k8s-version-920941 kubelet[657]: E1002 00:39:26.036140 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.201122 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:28 old-k8s-version-920941 kubelet[657]: E1002 00:39:28.036705 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.201447 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:37 old-k8s-version-920941 kubelet[657]: E1002 00:39:37.039880 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.201635 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:42 old-k8s-version-920941 kubelet[657]: E1002 00:39:42.037320 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.201962 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:48 old-k8s-version-920941 kubelet[657]: E1002 00:39:48.036281 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.202147 1957595 logs.go:138] Found kubelet problem: Oct 02 00:39:55 old-k8s-version-920941 kubelet[657]: E1002 00:39:55.037598 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.202508 1957595 logs.go:138] Found kubelet problem: Oct 02 00:40:02 old-k8s-version-920941 kubelet[657]: E1002 00:40:02.036402 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.202694 1957595 logs.go:138] Found kubelet problem: Oct 02 00:40:08 old-k8s-version-920941 kubelet[657]: E1002 00:40:08.036742 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.203020 1957595 logs.go:138] Found kubelet problem: Oct 02 00:40:15 old-k8s-version-920941 kubelet[657]: E1002 00:40:15.037929 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.203205 1957595 logs.go:138] Found kubelet problem: Oct 02 00:40:20 old-k8s-version-920941 kubelet[657]: E1002 00:40:20.036677 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.203530 1957595 logs.go:138] Found kubelet problem: Oct 02 00:40:27 old-k8s-version-920941 kubelet[657]: E1002 00:40:27.036953 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
I1002 00:40:27.203544 1957595 logs.go:123] Gathering logs for kube-scheduler [19bd9ef04d15a6dccf5970eea7159536699fa21c02ae6b578cb94fb5a6c7af6a] ...
I1002 00:40:27.203559 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 19bd9ef04d15a6dccf5970eea7159536699fa21c02ae6b578cb94fb5a6c7af6a"
I1002 00:40:27.270245 1957595 logs.go:123] Gathering logs for kindnet [a767e421df83a00b32383377cc55e4151e7bd6f66d1066e2c265fd0d78172cac] ...
I1002 00:40:27.270278 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a767e421df83a00b32383377cc55e4151e7bd6f66d1066e2c265fd0d78172cac"
I1002 00:40:27.330354 1957595 logs.go:123] Gathering logs for kubernetes-dashboard [6d607cf4c97f9850c9226c3b461edd448574512ffe663325bf684f333c1bef50] ...
I1002 00:40:27.330384 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6d607cf4c97f9850c9226c3b461edd448574512ffe663325bf684f333c1bef50"
I1002 00:40:27.377052 1957595 logs.go:123] Gathering logs for dmesg ...
I1002 00:40:27.377080 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1002 00:40:27.396038 1957595 logs.go:123] Gathering logs for kube-scheduler [87d3a4aa9e474d9d563b52794771a880f456688ecc28b5c9391254d7e388d601] ...
I1002 00:40:27.396069 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 87d3a4aa9e474d9d563b52794771a880f456688ecc28b5c9391254d7e388d601"
I1002 00:40:27.434135 1957595 logs.go:123] Gathering logs for kube-controller-manager [ad357c0209d969730c7b744d5c2fbad0a7c610d618ddddb9a2fc771ce023b605] ...
I1002 00:40:27.434161 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ad357c0209d969730c7b744d5c2fbad0a7c610d618ddddb9a2fc771ce023b605"
I1002 00:40:27.489634 1957595 logs.go:123] Gathering logs for kube-controller-manager [9882de920e5952a14a2e090a9a310cf476deae60c93e9ecd7f4384e8d6012f04] ...
I1002 00:40:27.489667 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9882de920e5952a14a2e090a9a310cf476deae60c93e9ecd7f4384e8d6012f04"
I1002 00:40:27.551020 1957595 logs.go:123] Gathering logs for containerd ...
I1002 00:40:27.551058 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I1002 00:40:27.615278 1957595 logs.go:123] Gathering logs for kube-apiserver [11ec001392bd7c1b6e1804233a847099114357802451cb3dfc4f819481c9eac5] ...
I1002 00:40:27.615315 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 11ec001392bd7c1b6e1804233a847099114357802451cb3dfc4f819481c9eac5"
I1002 00:40:27.699876 1957595 logs.go:123] Gathering logs for etcd [8c7992aa581c091fd0ff51c777b72d5212ca433204a6a429359b1bf731b055f4] ...
I1002 00:40:27.699910 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8c7992aa581c091fd0ff51c777b72d5212ca433204a6a429359b1bf731b055f4"
I1002 00:40:27.745907 1957595 logs.go:123] Gathering logs for kube-proxy [7d0046a7ae8533f8fe5ca98c95ba71a7292736d0effab8db2b682672e751ab5f] ...
I1002 00:40:27.745938 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7d0046a7ae8533f8fe5ca98c95ba71a7292736d0effab8db2b682672e751ab5f"
I1002 00:40:27.790931 1957595 logs.go:123] Gathering logs for kindnet [1051ac83c993493af1544df235a7ec482b2588f13293c80a3af3112eff956a41] ...
I1002 00:40:27.790957 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1051ac83c993493af1544df235a7ec482b2588f13293c80a3af3112eff956a41"
I1002 00:40:27.841399 1957595 logs.go:123] Gathering logs for storage-provisioner [287dac3a47db438435ee5f4915263ed26e3f6eae852bb618365b6490d95b4453] ...
I1002 00:40:27.841438 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 287dac3a47db438435ee5f4915263ed26e3f6eae852bb618365b6490d95b4453"
I1002 00:40:27.882342 1957595 logs.go:123] Gathering logs for storage-provisioner [4a7d63ad64058ab8a816f95771113a6646e7f49235241d0b9c99ee631cdf7f38] ...
I1002 00:40:27.882368 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4a7d63ad64058ab8a816f95771113a6646e7f49235241d0b9c99ee631cdf7f38"
I1002 00:40:27.925417 1957595 logs.go:123] Gathering logs for container status ...
I1002 00:40:27.925443 1957595 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1002 00:40:27.970197 1957595 out.go:358] Setting ErrFile to fd 2...
I1002 00:40:27.970228 1957595 out.go:392] TERM=,COLORTERM=, which probably does not support color
W1002 00:40:27.970391 1957595 out.go:270] X Problems detected in kubelet:
W1002 00:40:27.970409 1957595 out.go:270] Oct 02 00:40:02 old-k8s-version-920941 kubelet[657]: E1002 00:40:02.036402 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.970430 1957595 out.go:270] Oct 02 00:40:08 old-k8s-version-920941 kubelet[657]: E1002 00:40:08.036742 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.970447 1957595 out.go:270] Oct 02 00:40:15 old-k8s-version-920941 kubelet[657]: E1002 00:40:15.037929 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
W1002 00:40:27.970454 1957595 out.go:270] Oct 02 00:40:20 old-k8s-version-920941 kubelet[657]: E1002 00:40:20.036677 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1002 00:40:27.970464 1957595 out.go:270] Oct 02 00:40:27 old-k8s-version-920941 kubelet[657]: E1002 00:40:27.036953 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
I1002 00:40:27.970475 1957595 out.go:358] Setting ErrFile to fd 2...
I1002 00:40:27.970482 1957595 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1002 00:40:28.353221 1964993 pod_ready.go:82] duration metric: took 4m0.006366195s for pod "metrics-server-6867b74b74-npt4v" in "kube-system" namespace to be "Ready" ...
E1002 00:40:28.353248 1964993 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I1002 00:40:28.353269 1964993 pod_ready.go:39] duration metric: took 4m12.794967836s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1002 00:40:28.353285 1964993 api_server.go:52] waiting for apiserver process to appear ...
I1002 00:40:28.353312 1964993 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I1002 00:40:28.353380 1964993 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1002 00:40:28.390123 1964993 cri.go:89] found id: "b92c04d976cf457def1c3e1c5c1771c05abc92414cf9f58f2163d2062f92d1f0"
I1002 00:40:28.390144 1964993 cri.go:89] found id: "66577b32134293bb35dd337993a9291b47071541572d1e97c391dbf01350de33"
I1002 00:40:28.390148 1964993 cri.go:89] found id: ""
I1002 00:40:28.390155 1964993 logs.go:282] 2 containers: [b92c04d976cf457def1c3e1c5c1771c05abc92414cf9f58f2163d2062f92d1f0 66577b32134293bb35dd337993a9291b47071541572d1e97c391dbf01350de33]
I1002 00:40:28.390214 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.393760 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.397182 1964993 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I1002 00:40:28.397304 1964993 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1002 00:40:28.435037 1964993 cri.go:89] found id: "2ccc95e83c5312e11677c1375a5c0f1586dc075112b8f728428c81f16a9c405f"
I1002 00:40:28.435059 1964993 cri.go:89] found id: "6d268abb1217cac0a576b1f76c6914b8c8d323cf46b9da078c742aeac3f2fb83"
I1002 00:40:28.435065 1964993 cri.go:89] found id: ""
I1002 00:40:28.435072 1964993 logs.go:282] 2 containers: [2ccc95e83c5312e11677c1375a5c0f1586dc075112b8f728428c81f16a9c405f 6d268abb1217cac0a576b1f76c6914b8c8d323cf46b9da078c742aeac3f2fb83]
I1002 00:40:28.435131 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.438951 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.442757 1964993 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I1002 00:40:28.442833 1964993 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1002 00:40:28.480604 1964993 cri.go:89] found id: "67fc404ed205955a07aee2a954b09265bf5bbf16acfe7a61fec21fce8877e424"
I1002 00:40:28.480679 1964993 cri.go:89] found id: "4135867ed4acb2d1c331b95489e27f4be2485ad15403545148d1824e5f1c4e8f"
I1002 00:40:28.480697 1964993 cri.go:89] found id: ""
I1002 00:40:28.480718 1964993 logs.go:282] 2 containers: [67fc404ed205955a07aee2a954b09265bf5bbf16acfe7a61fec21fce8877e424 4135867ed4acb2d1c331b95489e27f4be2485ad15403545148d1824e5f1c4e8f]
I1002 00:40:28.480810 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.484617 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.487775 1964993 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I1002 00:40:28.487877 1964993 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1002 00:40:28.529568 1964993 cri.go:89] found id: "85cff847d41fa4de144e1521354a74dcc9165e0016ff4f7621a11d88126994b1"
I1002 00:40:28.529644 1964993 cri.go:89] found id: "7cb4fe5d533b8ec48fe48950e554c6aba769ee754aa13719bdb5078978fbfeb6"
I1002 00:40:28.529661 1964993 cri.go:89] found id: ""
I1002 00:40:28.529689 1964993 logs.go:282] 2 containers: [85cff847d41fa4de144e1521354a74dcc9165e0016ff4f7621a11d88126994b1 7cb4fe5d533b8ec48fe48950e554c6aba769ee754aa13719bdb5078978fbfeb6]
I1002 00:40:28.529774 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.533653 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.537059 1964993 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I1002 00:40:28.537176 1964993 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1002 00:40:28.576701 1964993 cri.go:89] found id: "bbfbf8b0371e2018a3aa70e3ccfd503c7b6af822245d5634a539533d6e973311"
I1002 00:40:28.576730 1964993 cri.go:89] found id: "a01e2f4ff5d8ed78b9df7324f5550f47a624ae296408c70204ff351a1b2e4ad0"
I1002 00:40:28.576735 1964993 cri.go:89] found id: ""
I1002 00:40:28.576741 1964993 logs.go:282] 2 containers: [bbfbf8b0371e2018a3aa70e3ccfd503c7b6af822245d5634a539533d6e973311 a01e2f4ff5d8ed78b9df7324f5550f47a624ae296408c70204ff351a1b2e4ad0]
I1002 00:40:28.576809 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.580712 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.584179 1964993 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I1002 00:40:28.584247 1964993 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1002 00:40:28.620945 1964993 cri.go:89] found id: "17d9d1f1793828e7e751349d6de1e04094c67aff9a2d5ed6c6870371c9a84869"
I1002 00:40:28.620969 1964993 cri.go:89] found id: "200cc54dc91df970755d5924d60cfcdfeea81697ac0a49ddae44e074ffab6870"
I1002 00:40:28.620975 1964993 cri.go:89] found id: ""
I1002 00:40:28.620982 1964993 logs.go:282] 2 containers: [17d9d1f1793828e7e751349d6de1e04094c67aff9a2d5ed6c6870371c9a84869 200cc54dc91df970755d5924d60cfcdfeea81697ac0a49ddae44e074ffab6870]
I1002 00:40:28.621039 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.624993 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.628596 1964993 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I1002 00:40:28.628664 1964993 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1002 00:40:28.668805 1964993 cri.go:89] found id: "31e1608032a84d4a051fe13e028dde8059dd432c004b00ccba658661d794cb83"
I1002 00:40:28.668827 1964993 cri.go:89] found id: "1d500cb37211f32dd14aa83f29576fc4093384b3d5410f2ae3d57c4de3b64e1d"
I1002 00:40:28.668833 1964993 cri.go:89] found id: ""
I1002 00:40:28.668840 1964993 logs.go:282] 2 containers: [31e1608032a84d4a051fe13e028dde8059dd432c004b00ccba658661d794cb83 1d500cb37211f32dd14aa83f29576fc4093384b3d5410f2ae3d57c4de3b64e1d]
I1002 00:40:28.668901 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.672431 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.675893 1964993 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I1002 00:40:28.675960 1964993 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I1002 00:40:28.725324 1964993 cri.go:89] found id: "f550f26320a85294a023e987d647be9aecf80bf2f5a96c5b6b333720dc42baf7"
I1002 00:40:28.725345 1964993 cri.go:89] found id: ""
I1002 00:40:28.725352 1964993 logs.go:282] 1 containers: [f550f26320a85294a023e987d647be9aecf80bf2f5a96c5b6b333720dc42baf7]
I1002 00:40:28.725440 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.729159 1964993 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I1002 00:40:28.729290 1964993 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I1002 00:40:28.768966 1964993 cri.go:89] found id: "bd0ebafa0062b294e1dd7417d92f303381894417f4ed4fa5896092e479ee613e"
I1002 00:40:28.768990 1964993 cri.go:89] found id: "35f838f0352a89eba32cb3c56ccbe98ed6425f0dc4716e448f82a2c770ae6d09"
I1002 00:40:28.768995 1964993 cri.go:89] found id: ""
I1002 00:40:28.769002 1964993 logs.go:282] 2 containers: [bd0ebafa0062b294e1dd7417d92f303381894417f4ed4fa5896092e479ee613e 35f838f0352a89eba32cb3c56ccbe98ed6425f0dc4716e448f82a2c770ae6d09]
I1002 00:40:28.769081 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.772779 1964993 ssh_runner.go:195] Run: which crictl
I1002 00:40:28.776082 1964993 logs.go:123] Gathering logs for dmesg ...
I1002 00:40:28.776104 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1002 00:40:28.793105 1964993 logs.go:123] Gathering logs for describe nodes ...
I1002 00:40:28.793133 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I1002 00:40:28.960868 1964993 logs.go:123] Gathering logs for coredns [67fc404ed205955a07aee2a954b09265bf5bbf16acfe7a61fec21fce8877e424] ...
I1002 00:40:28.960903 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 67fc404ed205955a07aee2a954b09265bf5bbf16acfe7a61fec21fce8877e424"
I1002 00:40:29.002042 1964993 logs.go:123] Gathering logs for coredns [4135867ed4acb2d1c331b95489e27f4be2485ad15403545148d1824e5f1c4e8f] ...
I1002 00:40:29.002129 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4135867ed4acb2d1c331b95489e27f4be2485ad15403545148d1824e5f1c4e8f"
I1002 00:40:29.046160 1964993 logs.go:123] Gathering logs for kube-scheduler [7cb4fe5d533b8ec48fe48950e554c6aba769ee754aa13719bdb5078978fbfeb6] ...
I1002 00:40:29.046187 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7cb4fe5d533b8ec48fe48950e554c6aba769ee754aa13719bdb5078978fbfeb6"
I1002 00:40:29.103707 1964993 logs.go:123] Gathering logs for kube-proxy [bbfbf8b0371e2018a3aa70e3ccfd503c7b6af822245d5634a539533d6e973311] ...
I1002 00:40:29.103741 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bbfbf8b0371e2018a3aa70e3ccfd503c7b6af822245d5634a539533d6e973311"
I1002 00:40:29.149192 1964993 logs.go:123] Gathering logs for kube-controller-manager [17d9d1f1793828e7e751349d6de1e04094c67aff9a2d5ed6c6870371c9a84869] ...
I1002 00:40:29.149220 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 17d9d1f1793828e7e751349d6de1e04094c67aff9a2d5ed6c6870371c9a84869"
I1002 00:40:29.220431 1964993 logs.go:123] Gathering logs for kubelet ...
I1002 00:40:29.220497 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W1002 00:40:29.261752 1964993 logs.go:138] Found kubelet problem: Oct 02 00:36:15 no-preload-643266 kubelet[657]: W1002 00:36:15.762374 657 reflector.go:561] object-"kube-system"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-643266" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-643266' and this object
W1002 00:40:29.262023 1964993 logs.go:138] Found kubelet problem: Oct 02 00:36:15 no-preload-643266 kubelet[657]: E1002 00:36:15.762558 657 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-643266\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-643266' and this object" logger="UnhandledError"
W1002 00:40:29.262204 1964993 logs.go:138] Found kubelet problem: Oct 02 00:36:15 no-preload-643266 kubelet[657]: W1002 00:36:15.762706 657 reflector.go:561] object-"kube-system"/"coredns": failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:no-preload-643266" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-643266' and this object
W1002 00:40:29.262426 1964993 logs.go:138] Found kubelet problem: Oct 02 00:36:15 no-preload-643266 kubelet[657]: E1002 00:36:15.767953 657 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"coredns\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"coredns\" is forbidden: User \"system:node:no-preload-643266\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-643266' and this object" logger="UnhandledError"
W1002 00:40:29.262612 1964993 logs.go:138] Found kubelet problem: Oct 02 00:36:15 no-preload-643266 kubelet[657]: W1002 00:36:15.769561 657 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-643266" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'no-preload-643266' and this object
W1002 00:40:29.262842 1964993 logs.go:138] Found kubelet problem: Oct 02 00:36:15 no-preload-643266 kubelet[657]: E1002 00:36:15.769722 657 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-643266\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'no-preload-643266' and this object" logger="UnhandledError"
W1002 00:40:29.263024 1964993 logs.go:138] Found kubelet problem: Oct 02 00:36:15 no-preload-643266 kubelet[657]: W1002 00:36:15.771013 657 reflector.go:561] object-"kube-system"/"kube-proxy": failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:no-preload-643266" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-643266' and this object
W1002 00:40:29.263249 1964993 logs.go:138] Found kubelet problem: Oct 02 00:36:15 no-preload-643266 kubelet[657]: E1002 00:36:15.775699 657 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-proxy\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-proxy\" is forbidden: User \"system:node:no-preload-643266\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-643266' and this object" logger="UnhandledError"
W1002 00:40:29.270028 1964993 logs.go:138] Found kubelet problem: Oct 02 00:36:19 no-preload-643266 kubelet[657]: W1002 00:36:19.540537 657 reflector.go:561] object-"kubernetes-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-643266" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-643266' and this object
W1002 00:40:29.270266 1964993 logs.go:138] Found kubelet problem: Oct 02 00:36:19 no-preload-643266 kubelet[657]: E1002 00:36:19.541010 657 reflector.go:158] "Unhandled Error" err="object-\"kubernetes-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-643266\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kubernetes-dashboard\": no relationship found between node 'no-preload-643266' and this object" logger="UnhandledError"
I1002 00:40:29.302777 1964993 logs.go:123] Gathering logs for storage-provisioner [bd0ebafa0062b294e1dd7417d92f303381894417f4ed4fa5896092e479ee613e] ...
I1002 00:40:29.302803 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bd0ebafa0062b294e1dd7417d92f303381894417f4ed4fa5896092e479ee613e"
I1002 00:40:29.340391 1964993 logs.go:123] Gathering logs for containerd ...
I1002 00:40:29.340417 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I1002 00:40:29.405206 1964993 logs.go:123] Gathering logs for kubernetes-dashboard [f550f26320a85294a023e987d647be9aecf80bf2f5a96c5b6b333720dc42baf7] ...
I1002 00:40:29.405242 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f550f26320a85294a023e987d647be9aecf80bf2f5a96c5b6b333720dc42baf7"
I1002 00:40:29.448084 1964993 logs.go:123] Gathering logs for kube-controller-manager [200cc54dc91df970755d5924d60cfcdfeea81697ac0a49ddae44e074ffab6870] ...
I1002 00:40:29.448112 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 200cc54dc91df970755d5924d60cfcdfeea81697ac0a49ddae44e074ffab6870"
I1002 00:40:29.506527 1964993 logs.go:123] Gathering logs for storage-provisioner [35f838f0352a89eba32cb3c56ccbe98ed6425f0dc4716e448f82a2c770ae6d09] ...
I1002 00:40:29.506557 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 35f838f0352a89eba32cb3c56ccbe98ed6425f0dc4716e448f82a2c770ae6d09"
I1002 00:40:29.546099 1964993 logs.go:123] Gathering logs for container status ...
I1002 00:40:29.546128 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1002 00:40:29.588244 1964993 logs.go:123] Gathering logs for kube-proxy [a01e2f4ff5d8ed78b9df7324f5550f47a624ae296408c70204ff351a1b2e4ad0] ...
I1002 00:40:29.588274 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a01e2f4ff5d8ed78b9df7324f5550f47a624ae296408c70204ff351a1b2e4ad0"
I1002 00:40:29.625627 1964993 logs.go:123] Gathering logs for etcd [6d268abb1217cac0a576b1f76c6914b8c8d323cf46b9da078c742aeac3f2fb83] ...
I1002 00:40:29.625657 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6d268abb1217cac0a576b1f76c6914b8c8d323cf46b9da078c742aeac3f2fb83"
I1002 00:40:29.684615 1964993 logs.go:123] Gathering logs for kindnet [31e1608032a84d4a051fe13e028dde8059dd432c004b00ccba658661d794cb83] ...
I1002 00:40:29.684690 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 31e1608032a84d4a051fe13e028dde8059dd432c004b00ccba658661d794cb83"
I1002 00:40:29.736303 1964993 logs.go:123] Gathering logs for kindnet [1d500cb37211f32dd14aa83f29576fc4093384b3d5410f2ae3d57c4de3b64e1d] ...
I1002 00:40:29.736337 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1d500cb37211f32dd14aa83f29576fc4093384b3d5410f2ae3d57c4de3b64e1d"
I1002 00:40:29.776598 1964993 logs.go:123] Gathering logs for etcd [2ccc95e83c5312e11677c1375a5c0f1586dc075112b8f728428c81f16a9c405f] ...
I1002 00:40:29.776626 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2ccc95e83c5312e11677c1375a5c0f1586dc075112b8f728428c81f16a9c405f"
I1002 00:40:29.831660 1964993 logs.go:123] Gathering logs for kube-apiserver [66577b32134293bb35dd337993a9291b47071541572d1e97c391dbf01350de33] ...
I1002 00:40:29.831692 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 66577b32134293bb35dd337993a9291b47071541572d1e97c391dbf01350de33"
I1002 00:40:29.892484 1964993 logs.go:123] Gathering logs for kube-scheduler [85cff847d41fa4de144e1521354a74dcc9165e0016ff4f7621a11d88126994b1] ...
I1002 00:40:29.892515 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 85cff847d41fa4de144e1521354a74dcc9165e0016ff4f7621a11d88126994b1"
I1002 00:40:29.948679 1964993 logs.go:123] Gathering logs for kube-apiserver [b92c04d976cf457def1c3e1c5c1771c05abc92414cf9f58f2163d2062f92d1f0] ...
I1002 00:40:29.948711 1964993 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b92c04d976cf457def1c3e1c5c1771c05abc92414cf9f58f2163d2062f92d1f0"
I1002 00:40:30.005895 1964993 out.go:358] Setting ErrFile to fd 2...
I1002 00:40:30.005936 1964993 out.go:392] TERM=,COLORTERM=, which probably does not support color
W1002 00:40:30.006014 1964993 out.go:270] X Problems detected in kubelet:
W1002 00:40:30.006039 1964993 out.go:270] Oct 02 00:36:15 no-preload-643266 kubelet[657]: E1002 00:36:15.769722 657 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-643266\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'no-preload-643266' and this object" logger="UnhandledError"
W1002 00:40:30.006050 1964993 out.go:270] Oct 02 00:36:15 no-preload-643266 kubelet[657]: W1002 00:36:15.771013 657 reflector.go:561] object-"kube-system"/"kube-proxy": failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:no-preload-643266" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-643266' and this object
W1002 00:40:30.006211 1964993 out.go:270] Oct 02 00:36:15 no-preload-643266 kubelet[657]: E1002 00:36:15.775699 657 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-proxy\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-proxy\" is forbidden: User \"system:node:no-preload-643266\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-643266' and this object" logger="UnhandledError"
W1002 00:40:30.006219 1964993 out.go:270] Oct 02 00:36:19 no-preload-643266 kubelet[657]: W1002 00:36:19.540537 657 reflector.go:561] object-"kubernetes-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-643266" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-643266' and this object
W1002 00:40:30.006229 1964993 out.go:270] Oct 02 00:36:19 no-preload-643266 kubelet[657]: E1002 00:36:19.541010 657 reflector.go:158] "Unhandled Error" err="object-\"kubernetes-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-643266\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kubernetes-dashboard\": no relationship found between node 'no-preload-643266' and this object" logger="UnhandledError"
I1002 00:40:30.006236 1964993 out.go:358] Setting ErrFile to fd 2...
I1002 00:40:30.006250 1964993 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1002 00:40:37.971296 1957595 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1002 00:40:37.984057 1957595 api_server.go:72] duration metric: took 6m0.754066339s to wait for apiserver process to appear ...
I1002 00:40:37.984081 1957595 api_server.go:88] waiting for apiserver healthz status ...
I1002 00:40:37.986391 1957595 out.go:201]
W1002 00:40:37.988342 1957595 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W1002 00:40:37.988362 1957595 out.go:270] *
W1002 00:40:37.990636 1957595 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1002 00:40:37.993660 1957595 out.go:201]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
e948e7eda020f 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 da3dc8774e99b dashboard-metrics-scraper-8d5bb5db8-hlf6t
287dac3a47db4 ba04bb24b9575 4 minutes ago Running storage-provisioner 2 c3e6dff0be9a3 storage-provisioner
6d607cf4c97f9 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 0dc01871d3f89 kubernetes-dashboard-cd95d586-g94cm
a767e421df83a 6a23fa8fd2b78 5 minutes ago Running kindnet-cni 1 d2288ac512f9c kindnet-v2lm7
56e926b48dece 1611cd07b61d5 5 minutes ago Running busybox 1 86fc316cc65bc busybox
8ff3cc680606d 25a5233254979 5 minutes ago Running kube-proxy 1 1b904193b1f7a kube-proxy-42b7q
4a7d63ad64058 ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 c3e6dff0be9a3 storage-provisioner
9f4ef323c339f db91994f4ee8f 5 minutes ago Running coredns 1 8f7c98e38cda8 coredns-74ff55c5b-nbdkx
ad357c0209d96 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 e70333d2656ff kube-controller-manager-old-k8s-version-920941
0a25b599263d7 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 3ff57087a5249 kube-apiserver-old-k8s-version-920941
87d3a4aa9e474 e7605f88f17d6 5 minutes ago Running kube-scheduler 1 5a266de224a20 kube-scheduler-old-k8s-version-920941
ab6cea850151c 05b738aa1bc63 5 minutes ago Running etcd 1 c2c373dafef48 etcd-old-k8s-version-920941
2850055cdbd3e 1611cd07b61d5 6 minutes ago Exited busybox 0 6c29055419581 busybox
8518536c30aef db91994f4ee8f 7 minutes ago Exited coredns 0 c21aeb3cb74e8 coredns-74ff55c5b-nbdkx
1051ac83c9934 6a23fa8fd2b78 7 minutes ago Exited kindnet-cni 0 822f533cc9af0 kindnet-v2lm7
7d0046a7ae853 25a5233254979 7 minutes ago Exited kube-proxy 0 02179b6c9ddbe kube-proxy-42b7q
9882de920e595 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 b33a4a46eabef kube-controller-manager-old-k8s-version-920941
19bd9ef04d15a e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 bca0adeadd888 kube-scheduler-old-k8s-version-920941
11ec001392bd7 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 ff78d6443f77e kube-apiserver-old-k8s-version-920941
8c7992aa581c0 05b738aa1bc63 8 minutes ago Exited etcd 0 a0bc77fcf5647 etcd-old-k8s-version-920941
==> containerd <==
Oct 02 00:36:25 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:36:25.064537504Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Oct 02 00:36:25 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:36:25.066446959Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Oct 02 00:36:25 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:36:25.066540077Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Oct 02 00:37:04 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:37:04.038999195Z" level=info msg="CreateContainer within sandbox \"da3dc8774e99b1dbdec62a899bbb1f81321683238c53cfb68f257e35c1450e6b\" for container name:\"dashboard-metrics-scraper\" attempt:4"
Oct 02 00:37:04 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:37:04.056549792Z" level=info msg="CreateContainer within sandbox \"da3dc8774e99b1dbdec62a899bbb1f81321683238c53cfb68f257e35c1450e6b\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"36fd8b5c62d3346cf48339fda72d27447be562ec33feb1a8f839b64bfe251fda\""
Oct 02 00:37:04 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:37:04.057114539Z" level=info msg="StartContainer for \"36fd8b5c62d3346cf48339fda72d27447be562ec33feb1a8f839b64bfe251fda\""
Oct 02 00:37:04 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:37:04.122311861Z" level=info msg="StartContainer for \"36fd8b5c62d3346cf48339fda72d27447be562ec33feb1a8f839b64bfe251fda\" returns successfully"
Oct 02 00:37:04 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:37:04.147342188Z" level=info msg="shim disconnected" id=36fd8b5c62d3346cf48339fda72d27447be562ec33feb1a8f839b64bfe251fda namespace=k8s.io
Oct 02 00:37:04 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:37:04.147401797Z" level=warning msg="cleaning up after shim disconnected" id=36fd8b5c62d3346cf48339fda72d27447be562ec33feb1a8f839b64bfe251fda namespace=k8s.io
Oct 02 00:37:04 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:37:04.147413341Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Oct 02 00:37:04 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:37:04.761958864Z" level=info msg="RemoveContainer for \"2b836a698cc796cedef8140bfcb36cf13b31caeba83f8b7595356d31a397f503\""
Oct 02 00:37:04 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:37:04.768970714Z" level=info msg="RemoveContainer for \"2b836a698cc796cedef8140bfcb36cf13b31caeba83f8b7595356d31a397f503\" returns successfully"
Oct 02 00:37:54 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:37:54.037266965Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 02 00:37:54 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:37:54.042595365Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Oct 02 00:37:54 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:37:54.044193943Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Oct 02 00:37:54 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:37:54.044219378Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Oct 02 00:38:29 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:38:29.039015616Z" level=info msg="CreateContainer within sandbox \"da3dc8774e99b1dbdec62a899bbb1f81321683238c53cfb68f257e35c1450e6b\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Oct 02 00:38:29 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:38:29.055309577Z" level=info msg="CreateContainer within sandbox \"da3dc8774e99b1dbdec62a899bbb1f81321683238c53cfb68f257e35c1450e6b\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"e948e7eda020fba099d2e760d8e1201abedc6a045610f2704724d8729adc18c0\""
Oct 02 00:38:29 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:38:29.056020421Z" level=info msg="StartContainer for \"e948e7eda020fba099d2e760d8e1201abedc6a045610f2704724d8729adc18c0\""
Oct 02 00:38:29 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:38:29.126820582Z" level=info msg="StartContainer for \"e948e7eda020fba099d2e760d8e1201abedc6a045610f2704724d8729adc18c0\" returns successfully"
Oct 02 00:38:29 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:38:29.152865541Z" level=info msg="shim disconnected" id=e948e7eda020fba099d2e760d8e1201abedc6a045610f2704724d8729adc18c0 namespace=k8s.io
Oct 02 00:38:29 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:38:29.152929876Z" level=warning msg="cleaning up after shim disconnected" id=e948e7eda020fba099d2e760d8e1201abedc6a045610f2704724d8729adc18c0 namespace=k8s.io
Oct 02 00:38:29 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:38:29.152940813Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Oct 02 00:38:29 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:38:29.986281404Z" level=info msg="RemoveContainer for \"36fd8b5c62d3346cf48339fda72d27447be562ec33feb1a8f839b64bfe251fda\""
Oct 02 00:38:29 old-k8s-version-920941 containerd[569]: time="2024-10-02T00:38:29.996216833Z" level=info msg="RemoveContainer for \"36fd8b5c62d3346cf48339fda72d27447be562ec33feb1a8f839b64bfe251fda\" returns successfully"
==> coredns [8518536c30aef09017c911aee769571a3ca250e88cc9853905c824c874626cac] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:43479 - 1498 "HINFO IN 2804956054141908690.4456827025126775008. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.03128646s
==> coredns [9f4ef323c339f7d0dd395ca641e6b83c6ee625242e1e405bcb230f0280f833f9] <==
[INFO] plugin/ready: Still waiting on: "kubernetes"
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:55831 - 62672 "HINFO IN 8662144659542547758.8324823098691210009. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.020795834s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I1002 00:35:31.705040 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-10-02 00:35:01.704563485 +0000 UTC m=+0.173755769) (total time: 30.000372864s):
Trace[2019727887]: [30.000372864s] [30.000372864s] END
E1002 00:35:31.705074 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I1002 00:35:31.705385 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-10-02 00:35:01.705078542 +0000 UTC m=+0.174270810) (total time: 30.000291717s):
Trace[939984059]: [30.000291717s] [30.000291717s] END
E1002 00:35:31.705396 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I1002 00:35:31.712871 1 trace.go:116] Trace[1474941318]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-10-02 00:35:01.705108876 +0000 UTC m=+0.174301144) (total time: 30.007734959s):
Trace[1474941318]: [30.007734959s] [30.007734959s] END
E1002 00:35:31.712954 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> describe nodes <==
Name: old-k8s-version-920941
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-920941
kubernetes.io/os=linux
minikube.k8s.io/commit=f51fafbf3cd47f7a462449fed4417351dbbcecb3
minikube.k8s.io/name=old-k8s-version-920941
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_10_02T00_32_32_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 02 Oct 2024 00:32:28 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-920941
AcquireTime: <unset>
RenewTime: Wed, 02 Oct 2024 00:40:31 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 02 Oct 2024 00:35:49 +0000 Wed, 02 Oct 2024 00:32:22 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 02 Oct 2024 00:35:49 +0000 Wed, 02 Oct 2024 00:32:22 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 02 Oct 2024 00:35:49 +0000 Wed, 02 Oct 2024 00:32:22 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 02 Oct 2024 00:35:49 +0000 Wed, 02 Oct 2024 00:32:46 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-920941
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
System Info:
Machine ID: a423adbfa6564b80a682fc6c52b7ab13
System UUID: 82742919-1985-4b91-a1db-427cbcc79dea
Boot ID: 3aa8f718-8507-41e8-80ca-0eb33f6ce70e
Kernel Version: 5.15.0-1070-aws
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.22
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m34s
kube-system coredns-74ff55c5b-nbdkx 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 7m53s
kube-system etcd-old-k8s-version-920941 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 7m59s
kube-system kindnet-v2lm7 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 7m53s
kube-system kube-apiserver-old-k8s-version-920941 250m (12%) 0 (0%) 0 (0%) 0 (0%) 7m59s
kube-system kube-controller-manager-old-k8s-version-920941 200m (10%) 0 (0%) 0 (0%) 0 (0%) 7m59s
kube-system kube-proxy-42b7q 0 (0%) 0 (0%) 0 (0%) 0 (0%) 7m53s
kube-system kube-scheduler-old-k8s-version-920941 100m (5%) 0 (0%) 0 (0%) 0 (0%) 7m59s
kube-system metrics-server-9975d5f86-49vwr 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 6m22s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 7m51s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-hlf6t 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m21s
kubernetes-dashboard kubernetes-dashboard-cd95d586-g94cm 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m21s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 100m (5%)
memory 420Mi (5%) 220Mi (2%)
ephemeral-storage 100Mi (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m18s (x5 over 8m18s) kubelet Node old-k8s-version-920941 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m18s (x5 over 8m18s) kubelet Node old-k8s-version-920941 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m18s (x4 over 8m18s) kubelet Node old-k8s-version-920941 status is now: NodeHasSufficientPID
Normal Starting 8m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 7m59s kubelet Node old-k8s-version-920941 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 7m59s kubelet Node old-k8s-version-920941 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 7m59s kubelet Node old-k8s-version-920941 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 7m59s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 7m53s kubelet Node old-k8s-version-920941 status is now: NodeReady
Normal Starting 7m51s kube-proxy Starting kube-proxy.
Normal Starting 5m55s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m54s (x8 over 5m54s) kubelet Node old-k8s-version-920941 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m54s (x7 over 5m54s) kubelet Node old-k8s-version-920941 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m54s (x8 over 5m54s) kubelet Node old-k8s-version-920941 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m54s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m37s kube-proxy Starting kube-proxy.
==> dmesg <==
[Oct 1 23:13] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
[ +0.010864] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
[ +0.140336] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
==> etcd [8c7992aa581c091fd0ff51c777b72d5212ca433204a6a429359b1bf731b055f4] <==
raft2024/10/02 00:32:21 INFO: ea7e25599daad906 switched to configuration voters=(16896983918768216326)
2024-10-02 00:32:21.871227 I | etcdserver/membership: added member ea7e25599daad906 [https://192.168.76.2:2380] to cluster 6f20f2c4b2fb5f8a
raft2024/10/02 00:32:22 INFO: ea7e25599daad906 is starting a new election at term 1
raft2024/10/02 00:32:22 INFO: ea7e25599daad906 became candidate at term 2
raft2024/10/02 00:32:22 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/10/02 00:32:22 INFO: ea7e25599daad906 became leader at term 2
raft2024/10/02 00:32:22 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-10-02 00:32:22.652854 I | etcdserver: published {Name:old-k8s-version-920941 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-10-02 00:32:22.653012 I | embed: ready to serve client requests
2024-10-02 00:32:22.654538 I | embed: serving client requests on 192.168.76.2:2379
2024-10-02 00:32:22.654608 I | etcdserver: setting up the initial cluster version to 3.4
2024-10-02 00:32:22.655000 I | embed: ready to serve client requests
2024-10-02 00:32:22.655069 N | etcdserver/membership: set the initial cluster version to 3.4
2024-10-02 00:32:22.655143 I | etcdserver/api: enabled capabilities for version 3.4
2024-10-02 00:32:22.692358 I | embed: serving client requests on 127.0.0.1:2379
2024-10-02 00:32:43.566829 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:32:49.659503 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:32:59.659863 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:33:09.659839 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:33:19.659633 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:33:29.659746 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:33:39.659634 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:33:49.659650 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:33:59.659628 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:34:09.659592 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [ab6cea850151c0b10687176375d47fb249199d273efd44a9c5d6a1d39e3f623a] <==
2024-10-02 00:36:30.586826 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:36:40.586732 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:36:50.586769 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:37:00.586679 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:37:10.586627 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:37:20.586763 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:37:30.586671 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:37:40.586683 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:37:50.586775 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:38:00.586887 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:38:10.586699 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:38:20.586611 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:38:30.586698 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:38:40.586658 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:38:50.586582 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:39:00.586744 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:39:10.586725 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:39:20.586634 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:39:30.586822 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:39:40.586824 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:39:50.586702 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:40:00.586748 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:40:10.586879 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:40:20.586722 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-02 00:40:30.586821 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
00:40:39 up 8:23, 0 users, load average: 0.81, 1.74, 2.34
Linux old-k8s-version-920941 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [1051ac83c993493af1544df235a7ec482b2588f13293c80a3af3112eff956a41] <==
I1002 00:32:49.826800 1 main.go:148] setting mtu 1500 for CNI
I1002 00:32:49.826853 1 main.go:178] kindnetd IP family: "ipv4"
I1002 00:32:49.826891 1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
I1002 00:32:50.125404 1 controller.go:334] Starting controller kube-network-policies
I1002 00:32:50.125497 1 controller.go:338] Waiting for informer caches to sync
I1002 00:32:50.125521 1 shared_informer.go:313] Waiting for caches to sync for kube-network-policies
I1002 00:32:50.427332 1 shared_informer.go:320] Caches are synced for kube-network-policies
I1002 00:32:50.427364 1 metrics.go:61] Registering metrics
I1002 00:32:50.427452 1 controller.go:374] Syncing nftables rules
I1002 00:33:00.125085 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:33:00.125174 1 main.go:299] handling current node
I1002 00:33:10.125367 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:33:10.125402 1 main.go:299] handling current node
I1002 00:33:20.133341 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:33:20.133376 1 main.go:299] handling current node
I1002 00:33:30.133052 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:33:30.133091 1 main.go:299] handling current node
I1002 00:33:40.125414 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:33:40.125449 1 main.go:299] handling current node
I1002 00:33:50.125520 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:33:50.125555 1 main.go:299] handling current node
I1002 00:34:00.132404 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:34:00.132443 1 main.go:299] handling current node
I1002 00:34:10.125696 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:34:10.125802 1 main.go:299] handling current node
==> kindnet [a767e421df83a00b32383377cc55e4151e7bd6f66d1066e2c265fd0d78172cac] <==
I1002 00:38:33.357390 1 main.go:299] handling current node
I1002 00:38:43.366526 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:38:43.366559 1 main.go:299] handling current node
I1002 00:38:53.366579 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:38:53.366615 1 main.go:299] handling current node
I1002 00:39:03.357975 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:39:03.358010 1 main.go:299] handling current node
I1002 00:39:13.361206 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:39:13.361243 1 main.go:299] handling current node
I1002 00:39:23.366130 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:39:23.366227 1 main.go:299] handling current node
I1002 00:39:33.357724 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:39:33.357759 1 main.go:299] handling current node
I1002 00:39:43.364748 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:39:43.364793 1 main.go:299] handling current node
I1002 00:39:53.360549 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:39:53.360595 1 main.go:299] handling current node
I1002 00:40:03.358330 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:40:03.358365 1 main.go:299] handling current node
I1002 00:40:13.361398 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:40:13.361566 1 main.go:299] handling current node
I1002 00:40:23.366446 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:40:23.366481 1 main.go:299] handling current node
I1002 00:40:33.366134 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1002 00:40:33.366174 1 main.go:299] handling current node
==> kube-apiserver [0a25b599263d779d6664295d455c78ad67aae1ea393696c88eb6887fedc9bf29] <==
I1002 00:37:36.043855 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1002 00:37:36.043864 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W1002 00:38:02.927619 1 handler_proxy.go:102] no RequestInfo found in the context
E1002 00:38:02.927721 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1002 00:38:02.927754 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I1002 00:38:15.184949 1 client.go:360] parsed scheme: "passthrough"
I1002 00:38:15.185001 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1002 00:38:15.185012 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1002 00:38:50.458479 1 client.go:360] parsed scheme: "passthrough"
I1002 00:38:50.458659 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1002 00:38:50.458676 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1002 00:39:22.037838 1 client.go:360] parsed scheme: "passthrough"
I1002 00:39:22.037882 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1002 00:39:22.037892 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1002 00:39:55.475212 1 client.go:360] parsed scheme: "passthrough"
I1002 00:39:55.475256 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1002 00:39:55.475264 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W1002 00:39:59.397757 1 handler_proxy.go:102] no RequestInfo found in the context
E1002 00:39:59.397841 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1002 00:39:59.397856 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I1002 00:40:31.146661 1 client.go:360] parsed scheme: "passthrough"
I1002 00:40:31.146707 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1002 00:40:31.146715 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [11ec001392bd7c1b6e1804233a847099114357802451cb3dfc4f819481c9eac5] <==
I1002 00:32:29.162210 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I1002 00:32:29.162500 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I1002 00:32:29.190557 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I1002 00:32:29.194718 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I1002 00:32:29.194741 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I1002 00:32:29.590760 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1002 00:32:29.631769 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W1002 00:32:29.733113 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I1002 00:32:29.734337 1 controller.go:606] quota admission added evaluator for: endpoints
I1002 00:32:29.738227 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1002 00:32:30.784058 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I1002 00:32:31.440975 1 controller.go:606] quota admission added evaluator for: deployments.apps
I1002 00:32:31.565859 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I1002 00:32:39.983851 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I1002 00:32:46.887938 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I1002 00:32:46.892419 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I1002 00:32:59.052020 1 client.go:360] parsed scheme: "passthrough"
I1002 00:32:59.052064 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1002 00:32:59.052072 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1002 00:33:40.472446 1 client.go:360] parsed scheme: "passthrough"
I1002 00:33:40.472515 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1002 00:33:40.472524 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1002 00:34:15.092655 1 client.go:360] parsed scheme: "passthrough"
I1002 00:34:15.092710 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1002 00:34:15.092882 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [9882de920e5952a14a2e090a9a310cf476deae60c93e9ecd7f4384e8d6012f04] <==
I1002 00:32:46.891419 1 shared_informer.go:247] Caches are synced for HPA
I1002 00:32:46.891526 1 shared_informer.go:247] Caches are synced for resource quota
I1002 00:32:46.900428 1 shared_informer.go:247] Caches are synced for endpoint
I1002 00:32:46.900686 1 shared_informer.go:247] Caches are synced for GC
I1002 00:32:46.902543 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-legacy-unknown
I1002 00:32:46.902763 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-serving
I1002 00:32:46.902874 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-client
I1002 00:32:46.903730 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kube-apiserver-client
I1002 00:32:46.923515 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
I1002 00:32:46.923556 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-bhtjh"
I1002 00:32:46.924645 1 shared_informer.go:247] Caches are synced for persistent volume
I1002 00:32:46.957710 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-v2lm7"
I1002 00:32:46.990001 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-42b7q"
I1002 00:32:46.991740 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-nbdkx"
E1002 00:32:47.057176 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"691e6700-9f49-45d6-ac7c-11a3fa760c6b", ResourceVersion:"267", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63863425951, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x40017ae300), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x40017ae320)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0x40017ae340), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x40016d93c0), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40017ae
360), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40017ae380), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x40017ae3c0)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x40008b2060), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0x400174dbe8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x4000b3e460), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x40002877a0)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x400174dc38)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
E1002 00:32:47.110559 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"691e6700-9f49-45d6-ac7c-11a3fa760c6b", ResourceVersion:"415", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63863425951, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001b54b20), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001b54b40)}, v1.ManagedFieldsEntry{Manager:"kube-co
ntroller-manager", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001b54b60), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001b54b80)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4001b54ba0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElastic
BlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x40018ede40), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSour
ce)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001b54bc0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSo
urce)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001b54be0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil),
Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil),
WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001b54c20)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"F
ile", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x400199b5c0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x40019b0ae8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x400051c2a0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)
(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x4001742438)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x40019b0b38)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:1, NumberReady:0, ObservedGeneration:1, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:1, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest ve
rsion and try again
I1002 00:32:47.162531 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I1002 00:32:47.362751 1 shared_informer.go:247] Caches are synced for garbage collector
I1002 00:32:47.411848 1 shared_informer.go:247] Caches are synced for garbage collector
I1002 00:32:47.411868 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I1002 00:32:48.493187 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I1002 00:32:48.509596 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-bhtjh"
I1002 00:34:16.611978 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
E1002 00:34:16.710884 1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
E1002 00:34:16.711307 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
==> kube-controller-manager [ad357c0209d969730c7b744d5c2fbad0a7c610d618ddddb9a2fc771ce023b605] <==
E1002 00:36:19.447277 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1002 00:36:23.564433 1 request.go:655] Throttling request took 1.048294059s, request: GET:https://192.168.76.2:8443/api/v1?timeout=32s
W1002 00:36:24.416026 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1002 00:36:49.949152 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1002 00:36:56.066479 1 request.go:655] Throttling request took 1.048299319s, request: GET:https://192.168.76.2:8443/apis/networking.k8s.io/v1?timeout=32s
W1002 00:36:56.917883 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1002 00:37:20.450934 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1002 00:37:28.568444 1 request.go:655] Throttling request took 1.048470409s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W1002 00:37:29.427637 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1002 00:37:50.952755 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1002 00:38:01.078081 1 request.go:655] Throttling request took 1.047062219s, request: GET:https://192.168.76.2:8443/apis/rbac.authorization.k8s.io/v1?timeout=32s
W1002 00:38:01.929588 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1002 00:38:21.454477 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1002 00:38:33.579975 1 request.go:655] Throttling request took 1.047901192s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W1002 00:38:34.431383 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1002 00:38:51.956664 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1002 00:39:06.081935 1 request.go:655] Throttling request took 1.04821422s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W1002 00:39:06.933256 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1002 00:39:22.458645 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1002 00:39:38.583666 1 request.go:655] Throttling request took 1.048250953s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W1002 00:39:39.435496 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1002 00:39:52.960845 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1002 00:40:11.039438 1 request.go:655] Throttling request took 1.001877317s, request: GET:https://192.168.76.2:8443/apis/events.k8s.io/v1beta1?timeout=32s
W1002 00:40:11.937383 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1002 00:40:23.462676 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
==> kube-proxy [7d0046a7ae8533f8fe5ca98c95ba71a7292736d0effab8db2b682672e751ab5f] <==
I1002 00:32:48.008891 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I1002 00:32:48.008973 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W1002 00:32:48.088586 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I1002 00:32:48.088674 1 server_others.go:185] Using iptables Proxier.
I1002 00:32:48.088963 1 server.go:650] Version: v1.20.0
I1002 00:32:48.094477 1 config.go:315] Starting service config controller
I1002 00:32:48.094499 1 shared_informer.go:240] Waiting for caches to sync for service config
I1002 00:32:48.095256 1 config.go:224] Starting endpoint slice config controller
I1002 00:32:48.095271 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I1002 00:32:48.194652 1 shared_informer.go:247] Caches are synced for service config
I1002 00:32:48.197414 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-proxy [8ff3cc680606db52e7aec936aa5a3da89b1f05ec9c72362a02657eefc93740a6] <==
I1002 00:35:02.623390 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I1002 00:35:02.623458 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W1002 00:35:02.670757 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I1002 00:35:02.670848 1 server_others.go:185] Using iptables Proxier.
I1002 00:35:02.671060 1 server.go:650] Version: v1.20.0
I1002 00:35:02.671561 1 config.go:315] Starting service config controller
I1002 00:35:02.671570 1 shared_informer.go:240] Waiting for caches to sync for service config
I1002 00:35:02.691697 1 config.go:224] Starting endpoint slice config controller
I1002 00:35:02.691716 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I1002 00:35:02.785900 1 shared_informer.go:247] Caches are synced for service config
I1002 00:35:02.795643 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [19bd9ef04d15a6dccf5970eea7159536699fa21c02ae6b578cb94fb5a6c7af6a] <==
W1002 00:32:28.290514 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W1002 00:32:28.290574 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1002 00:32:28.364000 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I1002 00:32:28.364751 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1002 00:32:28.368485 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1002 00:32:28.368654 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E1002 00:32:28.413239 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E1002 00:32:28.413562 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E1002 00:32:28.413675 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E1002 00:32:28.413771 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E1002 00:32:28.413846 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E1002 00:32:28.413927 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E1002 00:32:28.414034 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E1002 00:32:28.414110 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E1002 00:32:28.414187 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E1002 00:32:28.414257 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E1002 00:32:28.414410 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E1002 00:32:28.414445 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E1002 00:32:29.265312 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E1002 00:32:29.265317 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E1002 00:32:29.274268 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E1002 00:32:29.360259 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E1002 00:32:29.412763 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E1002 00:32:29.425201 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
I1002 00:32:31.169186 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [87d3a4aa9e474d9d563b52794771a880f456688ecc28b5c9391254d7e388d601] <==
I1002 00:34:49.399515 1 serving.go:331] Generated self-signed cert in-memory
W1002 00:34:58.292301 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W1002 00:34:58.292330 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W1002 00:34:58.292339 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W1002 00:34:58.292343 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1002 00:34:58.681529 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I1002 00:34:58.683838 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1002 00:34:58.684019 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1002 00:34:58.684119 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I1002 00:34:58.884274 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Oct 02 00:38:59 old-k8s-version-920941 kubelet[657]: E1002 00:38:59.040242 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
Oct 02 00:39:04 old-k8s-version-920941 kubelet[657]: E1002 00:39:04.036603 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 02 00:39:11 old-k8s-version-920941 kubelet[657]: I1002 00:39:11.035901 657 scope.go:95] [topologymanager] RemoveContainer - Container ID: e948e7eda020fba099d2e760d8e1201abedc6a045610f2704724d8729adc18c0
Oct 02 00:39:11 old-k8s-version-920941 kubelet[657]: E1002 00:39:11.036751 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
Oct 02 00:39:17 old-k8s-version-920941 kubelet[657]: E1002 00:39:17.036726 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 02 00:39:26 old-k8s-version-920941 kubelet[657]: I1002 00:39:26.035801 657 scope.go:95] [topologymanager] RemoveContainer - Container ID: e948e7eda020fba099d2e760d8e1201abedc6a045610f2704724d8729adc18c0
Oct 02 00:39:26 old-k8s-version-920941 kubelet[657]: E1002 00:39:26.036140 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
Oct 02 00:39:28 old-k8s-version-920941 kubelet[657]: E1002 00:39:28.036705 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 02 00:39:37 old-k8s-version-920941 kubelet[657]: I1002 00:39:37.036135 657 scope.go:95] [topologymanager] RemoveContainer - Container ID: e948e7eda020fba099d2e760d8e1201abedc6a045610f2704724d8729adc18c0
Oct 02 00:39:37 old-k8s-version-920941 kubelet[657]: E1002 00:39:37.039880 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
Oct 02 00:39:42 old-k8s-version-920941 kubelet[657]: E1002 00:39:42.037320 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 02 00:39:48 old-k8s-version-920941 kubelet[657]: I1002 00:39:48.035896 657 scope.go:95] [topologymanager] RemoveContainer - Container ID: e948e7eda020fba099d2e760d8e1201abedc6a045610f2704724d8729adc18c0
Oct 02 00:39:48 old-k8s-version-920941 kubelet[657]: E1002 00:39:48.036281 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
Oct 02 00:39:55 old-k8s-version-920941 kubelet[657]: E1002 00:39:55.037598 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 02 00:40:02 old-k8s-version-920941 kubelet[657]: I1002 00:40:02.035948 657 scope.go:95] [topologymanager] RemoveContainer - Container ID: e948e7eda020fba099d2e760d8e1201abedc6a045610f2704724d8729adc18c0
Oct 02 00:40:02 old-k8s-version-920941 kubelet[657]: E1002 00:40:02.036402 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
Oct 02 00:40:08 old-k8s-version-920941 kubelet[657]: E1002 00:40:08.036742 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 02 00:40:15 old-k8s-version-920941 kubelet[657]: I1002 00:40:15.036961 657 scope.go:95] [topologymanager] RemoveContainer - Container ID: e948e7eda020fba099d2e760d8e1201abedc6a045610f2704724d8729adc18c0
Oct 02 00:40:15 old-k8s-version-920941 kubelet[657]: E1002 00:40:15.037929 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
Oct 02 00:40:20 old-k8s-version-920941 kubelet[657]: E1002 00:40:20.036677 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 02 00:40:27 old-k8s-version-920941 kubelet[657]: I1002 00:40:27.036048 657 scope.go:95] [topologymanager] RemoveContainer - Container ID: e948e7eda020fba099d2e760d8e1201abedc6a045610f2704724d8729adc18c0
Oct 02 00:40:27 old-k8s-version-920941 kubelet[657]: E1002 00:40:27.036953 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
Oct 02 00:40:31 old-k8s-version-920941 kubelet[657]: E1002 00:40:31.037322 657 pod_workers.go:191] Error syncing pod 760c9bc1-fd8e-42ac-9f29-2b1ebe602ede ("metrics-server-9975d5f86-49vwr_kube-system(760c9bc1-fd8e-42ac-9f29-2b1ebe602ede)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 02 00:40:39 old-k8s-version-920941 kubelet[657]: I1002 00:40:39.036669 657 scope.go:95] [topologymanager] RemoveContainer - Container ID: e948e7eda020fba099d2e760d8e1201abedc6a045610f2704724d8729adc18c0
Oct 02 00:40:39 old-k8s-version-920941 kubelet[657]: E1002 00:40:39.036998 657 pod_workers.go:191] Error syncing pod 0c776bbe-8a0a-422b-8d17-61f8ff516549 ("dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-hlf6t_kubernetes-dashboard(0c776bbe-8a0a-422b-8d17-61f8ff516549)"
==> kubernetes-dashboard [6d607cf4c97f9850c9226c3b461edd448574512ffe663325bf684f333c1bef50] <==
2024/10/02 00:35:26 Using namespace: kubernetes-dashboard
2024/10/02 00:35:26 Using in-cluster config to connect to apiserver
2024/10/02 00:35:26 Using secret token for csrf signing
2024/10/02 00:35:26 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/10/02 00:35:26 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/10/02 00:35:26 Successful initial request to the apiserver, version: v1.20.0
2024/10/02 00:35:26 Generating JWE encryption key
2024/10/02 00:35:26 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/10/02 00:35:26 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/10/02 00:35:27 Initializing JWE encryption key from synchronized object
2024/10/02 00:35:27 Creating in-cluster Sidecar client
2024/10/02 00:35:27 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/02 00:35:27 Serving insecurely on HTTP port: 9090
2024/10/02 00:35:57 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/02 00:36:27 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/02 00:36:57 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/02 00:37:27 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/02 00:37:57 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/02 00:38:27 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/02 00:38:57 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/02 00:39:27 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/02 00:39:57 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/02 00:40:27 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/02 00:35:26 Starting overwatch
==> storage-provisioner [287dac3a47db438435ee5f4915263ed26e3f6eae852bb618365b6490d95b4453] <==
I1002 00:35:45.158406 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1002 00:35:45.200083 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1002 00:35:45.200149 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I1002 00:36:02.672365 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1002 00:36:02.672582 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-920941_ffda5cb1-3f21-462b-b425-41ba70181056!
I1002 00:36:02.672659 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"e13019b2-a311-4fbc-aafb-05879fd8564d", APIVersion:"v1", ResourceVersion:"838", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-920941_ffda5cb1-3f21-462b-b425-41ba70181056 became leader
I1002 00:36:02.773598 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-920941_ffda5cb1-3f21-462b-b425-41ba70181056!
==> storage-provisioner [4a7d63ad64058ab8a816f95771113a6646e7f49235241d0b9c99ee631cdf7f38] <==
I1002 00:35:02.137535 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F1002 00:35:32.139856 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-920941 -n old-k8s-version-920941
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-920941 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-49vwr
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-920941 describe pod metrics-server-9975d5f86-49vwr
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-920941 describe pod metrics-server-9975d5f86-49vwr: exit status 1 (132.655404ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-49vwr" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-920941 describe pod metrics-server-9975d5f86-49vwr: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (372.14s)