=== RUN TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-windows-amd64.exe start -p default-k8s-diff-port-645100 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --kubernetes-version=v1.28.1
E0914 23:03:16.848255 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kubenet-562500\client.crt: The system cannot find the path specified.
E0914 23:03:36.729024 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\calico-562500\client.crt: The system cannot find the path specified.
E0914 23:03:43.101928 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\addons-468400\client.crt: The system cannot find the path specified.
E0914 23:03:54.196208 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-562500\client.crt: The system cannot find the path specified.
E0914 23:04:08.499214 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\custom-flannel-562500\client.crt: The system cannot find the path specified.
E0914 23:04:11.783231 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:04:11.798320 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:04:11.813387 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:04:11.845008 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:04:11.891274 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:04:11.983858 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:04:12.154699 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:04:12.482658 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:04:13.131503 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:04:14.424735 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:04:16.996358 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:04:22.126752 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:04:32.371235 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:04:52.864691 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:04:58.659258 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\calico-562500\client.crt: The system cannot find the path specified.
E0914 23:05:32.884803 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kubenet-562500\client.crt: The system cannot find the path specified.
E0914 23:05:33.830442 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:06:00.700077 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kubenet-562500\client.crt: The system cannot find the path specified.
E0914 23:06:10.253453 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-562500\client.crt: The system cannot find the path specified.
E0914 23:06:23.204116 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\auto-562500\client.crt: The system cannot find the path specified.
E0914 23:06:24.530517 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\custom-flannel-562500\client.crt: The system cannot find the path specified.
E0914 23:06:38.051583 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-562500\client.crt: The system cannot find the path specified.
E0914 23:06:52.353270 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\custom-flannel-562500\client.crt: The system cannot find the path specified.
E0914 23:06:55.770135 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
E0914 23:07:09.373873 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\functional-060300\client.crt: The system cannot find the path specified.
E0914 23:07:14.701801 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\calico-562500\client.crt: The system cannot find the path specified.
E0914 23:07:17.114279 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\bridge-562500\client.crt: The system cannot find the path specified.
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p default-k8s-diff-port-645100 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --kubernetes-version=v1.28.1: exit status 80 (5m52.8641952s)
-- stdout --
* [default-k8s-diff-port-645100] minikube v1.31.2 on Microsoft Windows 10 Enterprise N 10.0.19045.3448 Build 19045.3448
- KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube
- MINIKUBE_LOCATION=17243
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
* Using the docker driver based on existing profile
* Starting control plane node default-k8s-diff-port-645100 in cluster default-k8s-diff-port-645100
* Pulling base image ...
* Restarting existing docker container for "default-k8s-diff-port-645100" ...
* Preparing Kubernetes v1.28.1 on Docker 24.0.6 ...
* Configuring bridge CNI (Container Networking Interface) ...
- Generating certificates and keys ...
- Booting up control plane ...
- Configuring RBAC rules ...
* Configuring bridge CNI (Container Networking Interface) ...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Verifying Kubernetes components...
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
-- /stdout --
** stderr **
W0914 23:03:04.688805 6016 main.go:291] Unable to resolve the current Docker CLI context "default": context "default": context not found: open C:\Users\jenkins.minikube4\.docker\contexts\meta\37a8eec1ce19687d132fe29051dca629d164e2c4958ba141d5f4133a33f0688f\meta.json: The system cannot find the path specified.
I0914 23:03:04.754805 6016 out.go:296] Setting OutFile to fd 1644 ...
I0914 23:03:04.755731 6016 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0914 23:03:04.755731 6016 out.go:309] Setting ErrFile to fd 1928...
I0914 23:03:04.755988 6016 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0914 23:03:04.776898 6016 out.go:303] Setting JSON to false
I0914 23:03:04.780337 6016 start.go:128] hostinfo: {"hostname":"minikube4","uptime":157780,"bootTime":1694574803,"procs":207,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.3448 Build 19045.3448","kernelVersion":"10.0.19045.3448 Build 19045.3448","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"df6bfb5f-73f2-4acb-9365-df7854ecbb28"}
W0914 23:03:04.780459 6016 start.go:136] gopshost.Virtualization returned error: not implemented yet
I0914 23:03:04.781173 6016 out.go:177] * [default-k8s-diff-port-645100] minikube v1.31.2 on Microsoft Windows 10 Enterprise N 10.0.19045.3448 Build 19045.3448
I0914 23:03:04.782296 6016 out.go:177] - KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0914 23:03:04.782296 6016 notify.go:220] Checking for updates...
I0914 23:03:04.782921 6016 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0914 23:03:04.783856 6016 out.go:177] - MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube
I0914 23:03:04.784574 6016 out.go:177] - MINIKUBE_LOCATION=17243
I0914 23:03:04.785150 6016 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0914 23:03:04.786105 6016 config.go:182] Loaded profile config "default-k8s-diff-port-645100": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.1
I0914 23:03:04.787055 6016 driver.go:373] Setting default libvirt URI to qemu:///system
I0914 23:03:05.087347 6016 docker.go:121] docker version: linux-24.0.6:Docker Desktop 4.23.0 (120376)
I0914 23:03:05.098716 6016 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0914 23:03:05.523693 6016 info.go:266] docker info: {ID:c92f2ba1-df38-4a47-85e3-68e1162cada5 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:87 OomKillDisable:true NGoroutines:80 SystemTime:2023-09-14 23:03:05.4702783 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:9 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x8
6_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,
profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2-desktop.4] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0-desktop.1] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:
Docker Inc. Version:v0.2.20] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.7] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Command line tool for Docker Scout Vendor:Docker Inc. Version:0.24.1]] Warnings:<nil>}}
I0914 23:03:05.525275 6016 out.go:177] * Using the docker driver based on existing profile
I0914 23:03:05.526147 6016 start.go:298] selected driver: docker
I0914 23:03:05.526147 6016 start.go:902] validating driver "docker" against &{Name:default-k8s-diff-port-645100 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694625416-17243@sha256:87a683cf6721050a43e629eceb07cbff2775f9ca392344a264b61b7da435e503 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:default-k8s-diff-port-645100 Namespace:defaul
t APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.103.2 Port:8444 KubernetesVersion:v1.28.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertE
xpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
I0914 23:03:05.526361 6016 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0914 23:03:05.611491 6016 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0914 23:03:06.057593 6016 info.go:266] docker info: {ID:c92f2ba1-df38-4a47-85e3-68e1162cada5 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:87 OomKillDisable:true NGoroutines:80 SystemTime:2023-09-14 23:03:05.9956819 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:9 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x8
6_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,
profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2-desktop.4] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0-desktop.1] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:
Docker Inc. Version:v0.2.20] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.7] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Command line tool for Docker Scout Vendor:Docker Inc. Version:0.24.1]] Warnings:<nil>}}
I0914 23:03:06.057593 6016 start_flags.go:922] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0914 23:03:06.057593 6016 cni.go:84] Creating CNI manager for ""
I0914 23:03:06.057593 6016 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0914 23:03:06.057593 6016 start_flags.go:321] config:
{Name:default-k8s-diff-port-645100 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694625416-17243@sha256:87a683cf6721050a43e629eceb07cbff2775f9ca392344a264b61b7da435e503 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:default-k8s-diff-port-645100 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l
ocal ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.103.2 Port:8444 KubernetesVersion:v1.28.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikub
e-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
I0914 23:03:06.059606 6016 out.go:177] * Starting control plane node default-k8s-diff-port-645100 in cluster default-k8s-diff-port-645100
I0914 23:03:06.059606 6016 cache.go:122] Beginning downloading kic base image for docker with docker
I0914 23:03:06.060600 6016 out.go:177] * Pulling base image ...
I0914 23:03:06.060600 6016 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime docker
I0914 23:03:06.060600 6016 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694625416-17243@sha256:87a683cf6721050a43e629eceb07cbff2775f9ca392344a264b61b7da435e503 in local docker daemon
I0914 23:03:06.060600 6016 preload.go:148] Found local preload: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.28.1-docker-overlay2-amd64.tar.lz4
I0914 23:03:06.060600 6016 cache.go:57] Caching tarball of preloaded images
I0914 23:03:06.061604 6016 preload.go:174] Found C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.28.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0914 23:03:06.061604 6016 cache.go:60] Finished verifying existence of preloaded tar for v1.28.1 on docker
I0914 23:03:06.061604 6016 profile.go:148] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\config.json ...
I0914 23:03:06.259694 6016 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694625416-17243@sha256:87a683cf6721050a43e629eceb07cbff2775f9ca392344a264b61b7da435e503 in local docker daemon, skipping pull
I0914 23:03:06.259694 6016 cache.go:145] gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694625416-17243@sha256:87a683cf6721050a43e629eceb07cbff2775f9ca392344a264b61b7da435e503 exists in daemon, skipping load
I0914 23:03:06.259694 6016 cache.go:195] Successfully downloaded all kic artifacts
I0914 23:03:06.259694 6016 start.go:365] acquiring machines lock for default-k8s-diff-port-645100: {Name:mk3e38cc0cd00c03168a41f70860bc4f6385a707 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0914 23:03:06.259694 6016 start.go:369] acquired machines lock for "default-k8s-diff-port-645100" in 0s
I0914 23:03:06.259694 6016 start.go:96] Skipping create...Using existing machine configuration
I0914 23:03:06.259694 6016 fix.go:54] fixHost starting:
I0914 23:03:06.278693 6016 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-645100 --format={{.State.Status}}
I0914 23:03:06.482241 6016 fix.go:102] recreateIfNeeded on default-k8s-diff-port-645100: state=Stopped err=<nil>
W0914 23:03:06.482241 6016 fix.go:128] unexpected machine state, will restart: <nil>
I0914 23:03:06.483120 6016 out.go:177] * Restarting existing docker container for "default-k8s-diff-port-645100" ...
I0914 23:03:06.492742 6016 cli_runner.go:164] Run: docker start default-k8s-diff-port-645100
I0914 23:03:07.320754 6016 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-645100 --format={{.State.Status}}
I0914 23:03:07.528743 6016 kic.go:426] container "default-k8s-diff-port-645100" state is running.
I0914 23:03:07.549719 6016 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-645100
I0914 23:03:07.736477 6016 profile.go:148] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\config.json ...
I0914 23:03:07.739941 6016 machine.go:88] provisioning docker machine ...
I0914 23:03:07.739941 6016 ubuntu.go:169] provisioning hostname "default-k8s-diff-port-645100"
I0914 23:03:07.753927 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:07.980243 6016 main.go:141] libmachine: Using SSH client type: native
I0914 23:03:07.981253 6016 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xfc1380] 0xfc3ec0 <nil> [] 0s} 127.0.0.1 62306 <nil> <nil>}
I0914 23:03:07.982262 6016 main.go:141] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-645100 && echo "default-k8s-diff-port-645100" | sudo tee /etc/hostname
I0914 23:03:07.986249 6016 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0914 23:03:11.215763 6016 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-645100
I0914 23:03:11.226334 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:11.447868 6016 main.go:141] libmachine: Using SSH client type: native
I0914 23:03:11.448866 6016 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xfc1380] 0xfc3ec0 <nil> [] 0s} 127.0.0.1 62306 <nil> <nil>}
I0914 23:03:11.448866 6016 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-645100' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-645100/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-645100' | sudo tee -a /etc/hosts;
fi
fi
I0914 23:03:11.625278 6016 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0914 23:03:11.625278 6016 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube4\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube4\minikube-integration\.minikube}
I0914 23:03:11.625278 6016 ubuntu.go:177] setting up certificates
I0914 23:03:11.625278 6016 provision.go:83] configureAuth start
I0914 23:03:11.636749 6016 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-645100
I0914 23:03:11.827167 6016 provision.go:138] copyHostCerts
I0914 23:03:11.827606 6016 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem, removing ...
I0914 23:03:11.827686 6016 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.pem
I0914 23:03:11.827994 6016 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem (1078 bytes)
I0914 23:03:11.829292 6016 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem, removing ...
I0914 23:03:11.829410 6016 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cert.pem
I0914 23:03:11.829671 6016 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem (1123 bytes)
I0914 23:03:11.831116 6016 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem, removing ...
I0914 23:03:11.831235 6016 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\key.pem
I0914 23:03:11.831742 6016 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem (1679 bytes)
I0914 23:03:11.832938 6016 provision.go:112] generating server cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.default-k8s-diff-port-645100 san=[192.168.103.2 127.0.0.1 localhost 127.0.0.1 minikube default-k8s-diff-port-645100]
I0914 23:03:12.083190 6016 provision.go:172] copyRemoteCerts
I0914 23:03:12.096731 6016 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0914 23:03:12.105469 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:12.298463 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:03:12.450542 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0914 23:03:12.510174 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1257 bytes)
I0914 23:03:12.569287 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0914 23:03:12.643055 6016 provision.go:86] duration metric: configureAuth took 1.0177227s
I0914 23:03:12.643055 6016 ubuntu.go:193] setting minikube options for container-runtime
I0914 23:03:12.644400 6016 config.go:182] Loaded profile config "default-k8s-diff-port-645100": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.1
I0914 23:03:12.655151 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:12.866452 6016 main.go:141] libmachine: Using SSH client type: native
I0914 23:03:12.867243 6016 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xfc1380] 0xfc3ec0 <nil> [] 0s} 127.0.0.1 62306 <nil> <nil>}
I0914 23:03:12.867293 6016 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0914 23:03:13.056083 6016 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0914 23:03:13.056168 6016 ubuntu.go:71] root file system type: overlay
I0914 23:03:13.056380 6016 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0914 23:03:13.067275 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:13.268469 6016 main.go:141] libmachine: Using SSH client type: native
I0914 23:03:13.269757 6016 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xfc1380] 0xfc3ec0 <nil> [] 0s} 127.0.0.1 62306 <nil> <nil>}
I0914 23:03:13.269909 6016 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0914 23:03:13.491351 6016 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0914 23:03:13.501111 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:13.716525 6016 main.go:141] libmachine: Using SSH client type: native
I0914 23:03:13.717233 6016 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xfc1380] 0xfc3ec0 <nil> [] 0s} 127.0.0.1 62306 <nil> <nil>}
I0914 23:03:13.717233 6016 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0914 23:03:13.870680 6016 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0914 23:03:13.870680 6016 machine.go:91] provisioned docker machine in 6.1304139s
I0914 23:03:13.870680 6016 start.go:300] post-start starting for "default-k8s-diff-port-645100" (driver="docker")
I0914 23:03:13.870680 6016 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0914 23:03:13.884914 6016 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0914 23:03:13.893927 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:14.067514 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:03:14.214456 6016 ssh_runner.go:195] Run: cat /etc/os-release
I0914 23:03:14.225772 6016 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0914 23:03:14.225772 6016 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0914 23:03:14.225772 6016 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0914 23:03:14.225772 6016 info.go:137] Remote host: Ubuntu 22.04.3 LTS
I0914 23:03:14.225772 6016 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\addons for local assets ...
I0914 23:03:14.226547 6016 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\files for local assets ...
I0914 23:03:14.228569 6016 filesync.go:149] local asset: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\40482.pem -> 40482.pem in /etc/ssl/certs
I0914 23:03:14.243582 6016 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0914 23:03:14.265433 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\40482.pem --> /etc/ssl/certs/40482.pem (1708 bytes)
I0914 23:03:14.323281 6016 start.go:303] post-start completed in 452.5422ms
I0914 23:03:14.336662 6016 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0914 23:03:14.345665 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:14.561583 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:03:14.702938 6016 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0914 23:03:14.716018 6016 fix.go:56] fixHost completed within 8.4558765s
I0914 23:03:14.716018 6016 start.go:83] releasing machines lock for "default-k8s-diff-port-645100", held for 8.4558765s
I0914 23:03:14.730378 6016 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-645100
I0914 23:03:14.922898 6016 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0914 23:03:14.934670 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:14.935856 6016 ssh_runner.go:195] Run: cat /version.json
I0914 23:03:14.945283 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:15.137619 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:03:15.153616 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:03:15.426059 6016 ssh_runner.go:195] Run: systemctl --version
I0914 23:03:15.459617 6016 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0914 23:03:15.488099 6016 ssh_runner.go:195] Run: sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
W0914 23:03:15.510382 6016 start.go:413] unable to name loopback interface in configureRuntimes: unable to patch loopback cni config "/etc/cni/net.d/*loopback.conf*": sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;: Process exited with status 1
stdout:
stderr:
find: '\\etc\\cni\\net.d': No such file or directory
I0914 23:03:15.523084 6016 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0914 23:03:15.547831 6016 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0914 23:03:15.547831 6016 start.go:469] detecting cgroup driver to use...
I0914 23:03:15.547831 6016 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0914 23:03:15.547831 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0914 23:03:15.604543 6016 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0914 23:03:15.652681 6016 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0914 23:03:15.676561 6016 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I0914 23:03:15.690660 6016 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0914 23:03:15.730144 6016 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0914 23:03:15.767957 6016 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0914 23:03:15.807480 6016 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0914 23:03:15.847328 6016 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0914 23:03:15.886388 6016 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0914 23:03:15.928369 6016 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0914 23:03:15.965846 6016 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0914 23:03:16.000991 6016 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 23:03:16.196424 6016 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0914 23:03:16.358517 6016 start.go:469] detecting cgroup driver to use...
I0914 23:03:16.359700 6016 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0914 23:03:16.378474 6016 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0914 23:03:16.412344 6016 cruntime.go:276] skipping containerd shutdown because we are bound to it
I0914 23:03:16.425333 6016 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0914 23:03:16.457480 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0914 23:03:16.548183 6016 ssh_runner.go:195] Run: which cri-dockerd
I0914 23:03:16.575366 6016 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0914 23:03:16.600097 6016 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0914 23:03:16.675756 6016 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0914 23:03:16.886604 6016 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0914 23:03:17.084891 6016 docker.go:535] configuring docker to use "cgroupfs" as cgroup driver...
I0914 23:03:17.084891 6016 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
I0914 23:03:17.174640 6016 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 23:03:17.356966 6016 ssh_runner.go:195] Run: sudo systemctl restart docker
I0914 23:03:18.022432 6016 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0914 23:03:18.198796 6016 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0914 23:03:18.365268 6016 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0914 23:03:18.529702 6016 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 23:03:18.690471 6016 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0914 23:03:18.739287 6016 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 23:03:18.913551 6016 ssh_runner.go:195] Run: sudo systemctl restart cri-docker
I0914 23:03:19.078331 6016 start.go:516] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0914 23:03:19.096336 6016 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0914 23:03:19.111082 6016 start.go:537] Will wait 60s for crictl version
I0914 23:03:19.125562 6016 ssh_runner.go:195] Run: which crictl
I0914 23:03:19.154165 6016 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0914 23:03:19.265968 6016 start.go:553] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 24.0.6
RuntimeApiVersion: v1
I0914 23:03:19.277546 6016 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0914 23:03:19.353638 6016 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0914 23:03:19.418188 6016 out.go:204] * Preparing Kubernetes v1.28.1 on Docker 24.0.6 ...
I0914 23:03:19.431233 6016 cli_runner.go:164] Run: docker exec -t default-k8s-diff-port-645100 dig +short host.docker.internal
I0914 23:03:19.799146 6016 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254
I0914 23:03:19.814188 6016 ssh_runner.go:195] Run: grep 192.168.65.254 host.minikube.internal$ /etc/hosts
I0914 23:03:19.825270 6016 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0914 23:03:19.866215 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8444/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:20.064663 6016 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime docker
I0914 23:03:20.074350 6016 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0914 23:03:20.120657 6016 docker.go:636] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.28.1
registry.k8s.io/kube-controller-manager:v1.28.1
registry.k8s.io/kube-proxy:v1.28.1
registry.k8s.io/kube-scheduler:v1.28.1
registry.k8s.io/etcd:3.5.9-0
registry.k8s.io/coredns/coredns:v1.10.1
registry.k8s.io/pause:3.9
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0914 23:03:20.120657 6016 docker.go:566] Images already preloaded, skipping extraction
I0914 23:03:20.131321 6016 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0914 23:03:20.191424 6016 docker.go:636] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.28.1
registry.k8s.io/kube-controller-manager:v1.28.1
registry.k8s.io/kube-scheduler:v1.28.1
registry.k8s.io/kube-proxy:v1.28.1
registry.k8s.io/etcd:3.5.9-0
registry.k8s.io/coredns/coredns:v1.10.1
registry.k8s.io/pause:3.9
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0914 23:03:20.191424 6016 cache_images.go:84] Images are preloaded, skipping loading
I0914 23:03:20.204526 6016 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0914 23:03:20.323571 6016 cni.go:84] Creating CNI manager for ""
I0914 23:03:20.323571 6016 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0914 23:03:20.323571 6016 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0914 23:03:20.323571 6016 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.103.2 APIServerPort:8444 KubernetesVersion:v1.28.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-645100 NodeName:default-k8s-diff-port-645100 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.103.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.103.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/cert
s/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0914 23:03:20.323571 6016 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.103.2
bindPort: 8444
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "default-k8s-diff-port-645100"
kubeletExtraArgs:
node-ip: 192.168.103.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.103.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8444
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0914 23:03:20.323571 6016 kubeadm.go:976] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=default-k8s-diff-port-645100 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.103.2
[Install]
config:
{KubernetesVersion:v1.28.1 ClusterName:default-k8s-diff-port-645100 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:}
I0914 23:03:20.335575 6016 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.1
I0914 23:03:20.362319 6016 binaries.go:44] Found k8s binaries, skipping transfer
I0914 23:03:20.374310 6016 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0914 23:03:20.395883 6016 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (390 bytes)
I0914 23:03:20.434025 6016 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0914 23:03:20.477297 6016 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2114 bytes)
I0914 23:03:20.534045 6016 ssh_runner.go:195] Run: grep 192.168.103.2 control-plane.minikube.internal$ /etc/hosts
I0914 23:03:20.549139 6016 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.103.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0914 23:03:20.578073 6016 certs.go:56] Setting up C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100 for IP: 192.168.103.2
I0914 23:03:20.578073 6016 certs.go:190] acquiring lock for shared ca certs: {Name:mk92285f7546e1a5b3c3b23dab6135aa5a99cd14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 23:03:20.579066 6016 certs.go:199] skipping minikubeCA CA generation: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key
I0914 23:03:20.579386 6016 certs.go:199] skipping proxyClientCA CA generation: C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key
I0914 23:03:20.580241 6016 certs.go:315] skipping minikube-user signed cert generation: C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\client.key
I0914 23:03:20.580711 6016 certs.go:315] skipping minikube signed cert generation: C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\apiserver.key.33fce0b9
I0914 23:03:20.581121 6016 certs.go:315] skipping aggregator signed cert generation: C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\proxy-client.key
I0914 23:03:20.582507 6016 certs.go:437] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\4048.pem (1338 bytes)
W0914 23:03:20.582507 6016 certs.go:433] ignoring C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\4048_empty.pem, impossibly tiny 0 bytes
I0914 23:03:20.583034 6016 certs.go:437] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem (1675 bytes)
I0914 23:03:20.583349 6016 certs.go:437] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem (1078 bytes)
I0914 23:03:20.583596 6016 certs.go:437] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem (1123 bytes)
I0914 23:03:20.583596 6016 certs.go:437] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem (1679 bytes)
I0914 23:03:20.584425 6016 certs.go:437] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\40482.pem (1708 bytes)
I0914 23:03:20.585516 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0914 23:03:20.640768 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0914 23:03:20.698744 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0914 23:03:20.755754 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0914 23:03:20.817001 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0914 23:03:20.872214 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0914 23:03:20.934871 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0914 23:03:20.991017 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0914 23:03:21.045792 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\40482.pem --> /usr/share/ca-certificates/40482.pem (1708 bytes)
I0914 23:03:21.102981 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0914 23:03:21.162297 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\4048.pem --> /usr/share/ca-certificates/4048.pem (1338 bytes)
I0914 23:03:21.217974 6016 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0914 23:03:21.273732 6016 ssh_runner.go:195] Run: openssl version
I0914 23:03:21.301483 6016 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0914 23:03:21.348731 6016 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0914 23:03:21.361218 6016 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Sep 14 21:42 /usr/share/ca-certificates/minikubeCA.pem
I0914 23:03:21.373734 6016 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0914 23:03:21.402634 6016 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0914 23:03:21.443430 6016 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4048.pem && ln -fs /usr/share/ca-certificates/4048.pem /etc/ssl/certs/4048.pem"
I0914 23:03:21.486847 6016 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4048.pem
I0914 23:03:21.500995 6016 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Sep 14 21:53 /usr/share/ca-certificates/4048.pem
I0914 23:03:21.516258 6016 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4048.pem
I0914 23:03:21.548001 6016 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/4048.pem /etc/ssl/certs/51391683.0"
I0914 23:03:21.590073 6016 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/40482.pem && ln -fs /usr/share/ca-certificates/40482.pem /etc/ssl/certs/40482.pem"
I0914 23:03:21.630275 6016 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/40482.pem
I0914 23:03:21.644186 6016 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Sep 14 21:53 /usr/share/ca-certificates/40482.pem
I0914 23:03:21.660444 6016 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/40482.pem
I0914 23:03:21.688765 6016 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/40482.pem /etc/ssl/certs/3ec20f2e.0"
I0914 23:03:21.727474 6016 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I0914 23:03:21.754215 6016 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0914 23:03:21.785295 6016 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0914 23:03:21.815922 6016 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0914 23:03:21.845139 6016 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0914 23:03:21.874837 6016 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0914 23:03:21.907178 6016 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0914 23:03:21.929937 6016 kubeadm.go:404] StartCluster: {Name:default-k8s-diff-port-645100 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694625416-17243@sha256:87a683cf6721050a43e629eceb07cbff2775f9ca392344a264b61b7da435e503 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:default-k8s-diff-port-645100 Namespace:default APIServerName:mini
kubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.103.2 Port:8444 KubernetesVersion:v1.28.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s
Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
I0914 23:03:21.940399 6016 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0914 23:03:21.998445 6016 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0914 23:03:22.022986 6016 kubeadm.go:419] found existing configuration files, will attempt cluster restart
I0914 23:03:22.022986 6016 kubeadm.go:636] restartCluster start
I0914 23:03:22.036393 6016 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0914 23:03:22.061650 6016 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0914 23:03:22.072421 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8444/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:22.247881 6016 kubeconfig.go:135] verify returned: extract IP: "default-k8s-diff-port-645100" does not appear in C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0914 23:03:22.248644 6016 kubeconfig.go:146] "default-k8s-diff-port-645100" context is missing from C:\Users\jenkins.minikube4\minikube-integration\kubeconfig - will repair!
I0914 23:03:22.250000 6016 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 23:03:22.280921 6016 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0914 23:03:22.305159 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:22.319509 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:22.346775 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:22.346775 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:22.362096 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:22.388857 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:22.900674 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:22.920859 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:22.957242 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:23.398457 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:23.413681 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:23.441539 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:23.896386 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:23.917499 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:23.950008 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:24.397399 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:24.412824 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:24.436571 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:24.893565 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:24.914286 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:24.940579 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:25.392870 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:25.413879 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:25.440230 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:25.896257 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:25.910357 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:25.944801 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:26.397798 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:26.414935 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:26.457353 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:26.900001 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:26.923396 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:26.954237 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:27.400377 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:27.418526 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:27.446451 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:27.889422 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:27.911981 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:27.939766 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:28.400914 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:28.413598 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:28.447732 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:28.897565 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:28.911908 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:28.938460 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:29.396684 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:29.411803 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:29.435570 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:29.894436 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:29.909522 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:29.937038 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:30.390718 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:30.404146 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:30.430432 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:30.900975 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:30.919889 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:30.947741 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:31.399313 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:31.414708 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:31.442892 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:31.897829 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:31.934079 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:31.963400 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:32.316556 6016 kubeadm.go:611] needs reconfigure: apiserver error: context deadline exceeded
I0914 23:03:32.316556 6016 kubeadm.go:1128] stopping kube-system containers ...
I0914 23:03:32.327972 6016 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0914 23:03:32.375239 6016 docker.go:462] Stopping containers: [0d9c4fd0d9b1 941214e22182 fa67cdf76781 53525e13bab7 af8312dc99c6 a0230bcafcf5 0bbc5c1d49fd bcdcf5f25c80 69b8ac03fa6a 011845da6521 8afbee6f5ba4 c9828da97537 6ddc0ba56198 ee0002acea18 3b97cbcdb388]
I0914 23:03:32.389079 6016 ssh_runner.go:195] Run: docker stop 0d9c4fd0d9b1 941214e22182 fa67cdf76781 53525e13bab7 af8312dc99c6 a0230bcafcf5 0bbc5c1d49fd bcdcf5f25c80 69b8ac03fa6a 011845da6521 8afbee6f5ba4 c9828da97537 6ddc0ba56198 ee0002acea18 3b97cbcdb388
I0914 23:03:32.454306 6016 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0914 23:03:32.495826 6016 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0914 23:03:32.516382 6016 kubeadm.go:155] found existing configuration files:
-rw------- 1 root root 5639 Sep 14 23:01 /etc/kubernetes/admin.conf
-rw------- 1 root root 5657 Sep 14 23:01 /etc/kubernetes/controller-manager.conf
-rw------- 1 root root 2051 Sep 14 23:02 /etc/kubernetes/kubelet.conf
-rw------- 1 root root 5601 Sep 14 23:01 /etc/kubernetes/scheduler.conf
I0914 23:03:32.528063 6016 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf
I0914 23:03:32.567620 6016 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf
I0914 23:03:32.602617 6016 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf
I0914 23:03:32.626400 6016 kubeadm.go:166] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf: Process exited with status 1
stdout:
stderr:
I0914 23:03:32.642084 6016 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0914 23:03:32.677306 6016 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf
I0914 23:03:32.697331 6016 kubeadm.go:166] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf: Process exited with status 1
stdout:
stderr:
I0914 23:03:32.710333 6016 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0914 23:03:32.748906 6016 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0914 23:03:32.768821 6016 kubeadm.go:713] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
I0914 23:03:32.768821 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0914 23:03:32.877468 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0914 23:03:34.090478 6016 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.2129455s)
I0914 23:03:34.090478 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0914 23:03:34.348671 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0914 23:03:34.472646 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0914 23:03:34.666809 6016 api_server.go:52] waiting for apiserver process to appear ...
I0914 23:03:34.683784 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:03:34.861827 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:03:35.550885 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:03:36.053770 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:03:36.563455 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:03:37.064956 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:03:37.559577 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:03:37.740372 6016 api_server.go:72] duration metric: took 3.0744176s to wait for apiserver process to appear ...
I0914 23:03:37.740372 6016 api_server.go:88] waiting for apiserver healthz status ...
I0914 23:03:37.740372 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:37.746163 6016 api_server.go:269] stopped: https://127.0.0.1:62305/healthz: Get "https://127.0.0.1:62305/healthz": EOF
I0914 23:03:37.746163 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:37.750035 6016 api_server.go:269] stopped: https://127.0.0.1:62305/healthz: Get "https://127.0.0.1:62305/healthz": EOF
I0914 23:03:38.255552 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:38.261665 6016 api_server.go:269] stopped: https://127.0.0.1:62305/healthz: Get "https://127.0.0.1:62305/healthz": EOF
I0914 23:03:38.754632 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:42.635170 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0914 23:03:42.635170 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0914 23:03:42.635170 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:43.041986 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:43.042104 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:43.042104 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:43.143163 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:43.143163 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:43.255930 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:43.336214 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:43.336612 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:43.754632 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:43.841113 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:43.841113 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:44.258240 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:44.344312 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:44.344312 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:44.758651 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:44.842146 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:44.842146 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:45.256737 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:45.344932 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:45.344932 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:45.755922 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:45.844278 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:45.844350 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:46.257840 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:46.332606 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 200:
ok
I0914 23:03:46.433440 6016 api_server.go:141] control plane version: v1.28.1
I0914 23:03:46.433706 6016 api_server.go:131] duration metric: took 8.6926098s to wait for apiserver health ...
I0914 23:03:46.433828 6016 cni.go:84] Creating CNI manager for ""
I0914 23:03:46.433828 6016 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0914 23:03:46.435645 6016 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0914 23:03:46.457972 6016 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0914 23:03:46.554679 6016 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0914 23:03:46.834009 6016 system_pods.go:43] waiting for kube-system pods to appear ...
I0914 23:03:46.941080 6016 system_pods.go:59] 8 kube-system pods found
I0914 23:03:46.941080 6016 system_pods.go:61] "coredns-5dd5756b68-rnfrd" [21cef5f8-f60b-4999-89f1-146409c222d1] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0914 23:03:46.941080 6016 system_pods.go:61] "etcd-default-k8s-diff-port-645100" [c72e4152-fd0a-4daf-adfe-3e944ba01040] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0914 23:03:46.941080 6016 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-645100" [483ddfc0-c3ce-46f6-9511-f917241ab66f] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0914 23:03:46.941273 6016 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-645100" [a9ed8b11-7033-40bc-8978-f8cfdad2c7f8] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0914 23:03:46.941317 6016 system_pods.go:61] "kube-proxy-46stq" [69dee5ce-187f-48be-9382-245b0da0d984] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0914 23:03:46.941354 6016 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-645100" [02763aba-6e2f-4fa0-8245-a3a5b4d51ef4] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0914 23:03:46.941354 6016 system_pods.go:61] "metrics-server-57f55c9bc5-v4l49" [1d457bd3-ccdc-478d-a9e1-09d47b8dd30d] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0914 23:03:46.941522 6016 system_pods.go:61] "storage-provisioner" [588a97e8-47d9-4c79-8acd-4bbb4bf7999d] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0914 23:03:46.941522 6016 system_pods.go:74] duration metric: took 107.5077ms to wait for pod list to return data ...
I0914 23:03:46.941522 6016 node_conditions.go:102] verifying NodePressure condition ...
I0914 23:03:46.951796 6016 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki
I0914 23:03:46.951931 6016 node_conditions.go:123] node cpu capacity is 16
I0914 23:03:46.951976 6016 node_conditions.go:105] duration metric: took 10.453ms to run NodePressure ...
I0914 23:03:46.951976 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0914 23:03:49.229874 6016 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml": (2.2775254s)
I0914 23:03:49.229899 6016 kubeadm.go:772] waiting for restarted kubelet to initialise ...
I0914 23:03:49.246203 6016 kubeadm.go:787] kubelet initialised
I0914 23:03:49.246203 6016 kubeadm.go:788] duration metric: took 16.2088ms waiting for restarted kubelet to initialise ...
I0914 23:03:49.246203 6016 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 23:03:49.263115 6016 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-rnfrd" in "kube-system" namespace to be "Ready" ...
I0914 23:03:51.457609 6016 pod_ready.go:102] pod "coredns-5dd5756b68-rnfrd" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:53.470394 6016 pod_ready.go:102] pod "coredns-5dd5756b68-rnfrd" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:55.975707 6016 pod_ready.go:102] pod "coredns-5dd5756b68-rnfrd" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:58.043458 6016 pod_ready.go:102] pod "coredns-5dd5756b68-rnfrd" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:59.465321 6016 pod_ready.go:92] pod "coredns-5dd5756b68-rnfrd" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:59.465321 6016 pod_ready.go:81] duration metric: took 10.2016652s waiting for pod "coredns-5dd5756b68-rnfrd" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.465321 6016 pod_ready.go:78] waiting up to 4m0s for pod "etcd-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.481162 6016 pod_ready.go:92] pod "etcd-default-k8s-diff-port-645100" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:59.481231 6016 pod_ready.go:81] duration metric: took 15.9095ms waiting for pod "etcd-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.481231 6016 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.494775 6016 pod_ready.go:92] pod "kube-apiserver-default-k8s-diff-port-645100" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:59.495309 6016 pod_ready.go:81] duration metric: took 14.0775ms waiting for pod "kube-apiserver-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.495309 6016 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.508635 6016 pod_ready.go:92] pod "kube-controller-manager-default-k8s-diff-port-645100" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:59.508658 6016 pod_ready.go:81] duration metric: took 13.348ms waiting for pod "kube-controller-manager-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.508706 6016 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-46stq" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.522465 6016 pod_ready.go:92] pod "kube-proxy-46stq" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:59.522465 6016 pod_ready.go:81] duration metric: took 13.759ms waiting for pod "kube-proxy-46stq" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.522465 6016 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.862020 6016 pod_ready.go:92] pod "kube-scheduler-default-k8s-diff-port-645100" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:59.862097 6016 pod_ready.go:81] duration metric: took 339.6136ms waiting for pod "kube-scheduler-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.862097 6016 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace to be "Ready" ...
I0914 23:04:02.194530 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:04.688262 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:07.188187 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:09.698259 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:12.185738 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:14.189391 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:16.199544 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:18.692426 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:21.189038 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:23.697485 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:25.698759 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:27.700444 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:30.186949 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:32.198339 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:34.704826 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:37.199140 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:39.692028 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:42.239198 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:44.706447 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:47.201107 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:49.692150 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:51.698188 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:53.747730 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:56.201014 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:58.691453 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:00.699701 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:02.707568 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:05.198653 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:07.693634 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:09.698468 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:12.192277 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:14.202695 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:16.694865 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:18.698931 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:21.192901 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:23.195019 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:25.697599 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:27.752444 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:30.190811 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:32.202029 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:34.705221 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:37.196766 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:39.695393 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:41.699552 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:43.703179 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:46.197356 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:48.202140 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:50.341278 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:52.695207 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:54.704529 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:56.705385 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:59.195175 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:01.204895 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:03.696885 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:06.195219 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:08.197386 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:10.705609 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:12.706164 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:15.202359 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:17.692347 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:19.702677 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:21.712026 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:24.267051 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:26.705785 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:29.200304 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:31.695271 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:34.206346 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:36.208683 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:38.697247 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:40.707935 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:43.194973 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:45.202515 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:47.762768 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:50.203740 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:52.698024 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:54.707275 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:57.202900 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:59.209144 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:01.710840 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:04.200414 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:06.695367 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:08.702213 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:10.703451 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:12.705759 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:14.707446 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:17.204943 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:19.709359 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:22.210651 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:24.695132 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:26.698404 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:28.706798 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:30.713060 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:33.208295 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:35.698858 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:37.707870 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:40.208730 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:42.705134 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:45.196437 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:47.208389 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:49.393124 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:51.700366 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:53.704017 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:55.711697 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:58.217149 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:59.880860 6016 pod_ready.go:81] duration metric: took 4m0.0060673s waiting for pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace to be "Ready" ...
E0914 23:07:59.880860 6016 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0914 23:07:59.880860 6016 pod_ready.go:38] duration metric: took 4m10.6213989s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 23:07:59.880860 6016 kubeadm.go:640] restartCluster took 4m37.8431761s
W0914 23:07:59.880860 6016 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
I0914 23:07:59.881910 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force"
I0914 23:08:19.589296 6016 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force": (19.7063438s)
I0914 23:08:19.606301 6016 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 23:08:19.649988 6016 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0914 23:08:19.678234 6016 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I0914 23:08:19.697222 6016 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0914 23:08:19.717224 6016 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0914 23:08:19.717224 6016 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0914 23:08:19.918812 6016 kubeadm.go:322] [WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet
I0914 23:08:20.105773 6016 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0914 23:08:37.185198 6016 kubeadm.go:322] [init] Using Kubernetes version: v1.28.1
I0914 23:08:37.185198 6016 kubeadm.go:322] [preflight] Running pre-flight checks
I0914 23:08:37.185198 6016 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0914 23:08:37.185198 6016 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0914 23:08:37.186192 6016 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0914 23:08:37.186192 6016 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0914 23:08:37.187178 6016 out.go:204] - Generating certificates and keys ...
I0914 23:08:37.187178 6016 kubeadm.go:322] [certs] Using existing ca certificate authority
I0914 23:08:37.187178 6016 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0914 23:08:37.187178 6016 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0914 23:08:37.188186 6016 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0914 23:08:37.188186 6016 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0914 23:08:37.188186 6016 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0914 23:08:37.188186 6016 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0914 23:08:37.188186 6016 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0914 23:08:37.188186 6016 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0914 23:08:37.189186 6016 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0914 23:08:37.189186 6016 kubeadm.go:322] [certs] Using the existing "sa" key
I0914 23:08:37.189186 6016 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0914 23:08:37.189186 6016 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0914 23:08:37.189186 6016 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0914 23:08:37.189186 6016 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0914 23:08:37.190182 6016 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0914 23:08:37.190182 6016 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0914 23:08:37.190182 6016 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0914 23:08:37.191190 6016 out.go:204] - Booting up control plane ...
I0914 23:08:37.191190 6016 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0914 23:08:37.191190 6016 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0914 23:08:37.191190 6016 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0914 23:08:37.192183 6016 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0914 23:08:37.192183 6016 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0914 23:08:37.192183 6016 kubeadm.go:322] [kubelet-start] Starting the kubelet
I0914 23:08:37.193186 6016 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0914 23:08:37.193186 6016 kubeadm.go:322] [apiclient] All control plane components are healthy after 13.006502 seconds
I0914 23:08:37.193186 6016 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0914 23:08:37.193186 6016 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0914 23:08:37.194185 6016 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
I0914 23:08:37.194185 6016 kubeadm.go:322] [mark-control-plane] Marking the node default-k8s-diff-port-645100 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0914 23:08:37.194185 6016 kubeadm.go:322] [bootstrap-token] Using token: mp9mmh.zshiiqhzi7m4ytkv
I0914 23:08:37.195178 6016 out.go:204] - Configuring RBAC rules ...
I0914 23:08:37.195178 6016 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0914 23:08:37.195178 6016 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0914 23:08:37.196175 6016 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0914 23:08:37.196175 6016 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0914 23:08:37.197188 6016 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0914 23:08:37.197188 6016 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0914 23:08:37.197188 6016 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0914 23:08:37.197188 6016 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
I0914 23:08:37.197188 6016 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
I0914 23:08:37.197188 6016 kubeadm.go:322]
I0914 23:08:37.198188 6016 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
I0914 23:08:37.198188 6016 kubeadm.go:322]
I0914 23:08:37.198188 6016 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
I0914 23:08:37.198188 6016 kubeadm.go:322]
I0914 23:08:37.198188 6016 kubeadm.go:322] mkdir -p $HOME/.kube
I0914 23:08:37.198188 6016 kubeadm.go:322] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0914 23:08:37.198188 6016 kubeadm.go:322] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0914 23:08:37.198188 6016 kubeadm.go:322]
I0914 23:08:37.199205 6016 kubeadm.go:322] Alternatively, if you are the root user, you can run:
I0914 23:08:37.199205 6016 kubeadm.go:322]
I0914 23:08:37.199205 6016 kubeadm.go:322] export KUBECONFIG=/etc/kubernetes/admin.conf
I0914 23:08:37.199205 6016 kubeadm.go:322]
I0914 23:08:37.199205 6016 kubeadm.go:322] You should now deploy a pod network to the cluster.
I0914 23:08:37.199205 6016 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0914 23:08:37.199205 6016 kubeadm.go:322] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0914 23:08:37.199205 6016 kubeadm.go:322]
I0914 23:08:37.200179 6016 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
I0914 23:08:37.200179 6016 kubeadm.go:322] and service account keys on each node and then running the following as root:
I0914 23:08:37.200179 6016 kubeadm.go:322]
I0914 23:08:37.200179 6016 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8444 --token mp9mmh.zshiiqhzi7m4ytkv \
I0914 23:08:37.200179 6016 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:32b4d7e85e22242a9dda455612f2c711aed2ef170d515f82ac1bb228ecce4fa2 \
I0914 23:08:37.200179 6016 kubeadm.go:322] --control-plane
I0914 23:08:37.200179 6016 kubeadm.go:322]
I0914 23:08:37.201173 6016 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
I0914 23:08:37.201173 6016 kubeadm.go:322]
I0914 23:08:37.201173 6016 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8444 --token mp9mmh.zshiiqhzi7m4ytkv \
I0914 23:08:37.201173 6016 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:32b4d7e85e22242a9dda455612f2c711aed2ef170d515f82ac1bb228ecce4fa2
I0914 23:08:37.201173 6016 cni.go:84] Creating CNI manager for ""
I0914 23:08:37.201173 6016 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0914 23:08:37.202176 6016 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0914 23:08:37.215200 6016 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0914 23:08:37.270070 6016 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0914 23:08:37.454165 6016 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0914 23:08:37.474163 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:37.476163 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl label nodes minikube.k8s.io/version=v1.31.2 minikube.k8s.io/commit=d7492f2ae2d9b6e62b385ffcd97ebad62c645e82 minikube.k8s.io/name=default-k8s-diff-port-645100 minikube.k8s.io/updated_at=2023_09_14T23_08_37_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:37.653438 6016 ops.go:34] apiserver oom_adj: -16
I0914 23:08:38.280313 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:38.898490 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:39.795417 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:40.292751 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:40.797198 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:41.297156 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:41.798031 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:42.296713 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:42.802780 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:43.294878 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:43.805720 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:44.310061 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:44.810695 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:45.312215 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:45.800798 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:46.312824 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:46.798963 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:47.291208 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:47.802399 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:48.304928 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:49.348226 6016 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (1.0432424s)
I0914 23:08:49.348226 6016 kubeadm.go:1081] duration metric: took 11.8934323s to wait for elevateKubeSystemPrivileges.
I0914 23:08:49.348226 6016 kubeadm.go:406] StartCluster complete in 5m27.4009687s
I0914 23:08:49.348226 6016 settings.go:142] acquiring lock: {Name:mk5d8710830d010adb6db61f855b0ef766a8622c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 23:08:49.348226 6016 settings.go:150] Updating kubeconfig: C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0914 23:08:49.353232 6016 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 23:08:49.355236 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0914 23:08:49.355236 6016 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]
I0914 23:08:49.355236 6016 addons.go:69] Setting storage-provisioner=true in profile "default-k8s-diff-port-645100"
I0914 23:08:49.355236 6016 addons.go:231] Setting addon storage-provisioner=true in "default-k8s-diff-port-645100"
W0914 23:08:49.355236 6016 addons.go:240] addon storage-provisioner should already be in state true
I0914 23:08:49.355236 6016 addons.go:69] Setting dashboard=true in profile "default-k8s-diff-port-645100"
I0914 23:08:49.355236 6016 addons.go:231] Setting addon dashboard=true in "default-k8s-diff-port-645100"
W0914 23:08:49.355236 6016 addons.go:240] addon dashboard should already be in state true
I0914 23:08:49.355236 6016 host.go:66] Checking if "default-k8s-diff-port-645100" exists ...
I0914 23:08:49.355236 6016 host.go:66] Checking if "default-k8s-diff-port-645100" exists ...
I0914 23:08:49.356237 6016 config.go:182] Loaded profile config "default-k8s-diff-port-645100": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.1
I0914 23:08:49.356237 6016 addons.go:69] Setting metrics-server=true in profile "default-k8s-diff-port-645100"
I0914 23:08:49.356237 6016 addons.go:231] Setting addon metrics-server=true in "default-k8s-diff-port-645100"
I0914 23:08:49.355236 6016 addons.go:69] Setting default-storageclass=true in profile "default-k8s-diff-port-645100"
I0914 23:08:49.356237 6016 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-diff-port-645100"
W0914 23:08:49.356237 6016 addons.go:240] addon metrics-server should already be in state true
I0914 23:08:49.356237 6016 host.go:66] Checking if "default-k8s-diff-port-645100" exists ...
I0914 23:08:49.395240 6016 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-645100 --format={{.State.Status}}
I0914 23:08:49.395240 6016 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-645100 --format={{.State.Status}}
I0914 23:08:49.399339 6016 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-645100 --format={{.State.Status}}
I0914 23:08:49.402240 6016 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-645100 --format={{.State.Status}}
I0914 23:08:49.653985 6016 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0914 23:08:49.652982 6016 kapi.go:248] "coredns" deployment in "kube-system" namespace and "default-k8s-diff-port-645100" context rescaled to 1 replicas
I0914 23:08:49.654979 6016 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.103.2 Port:8444 KubernetesVersion:v1.28.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0914 23:08:49.655958 6016 out.go:177] * Verifying Kubernetes components...
I0914 23:08:49.654979 6016 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0914 23:08:49.656979 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0914 23:08:49.676974 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:08:49.681966 6016 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 23:08:49.687970 6016 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0914 23:08:49.688972 6016 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0914 23:08:49.688972 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0914 23:08:49.698965 6016 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0914 23:08:49.699966 6016 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0914 23:08:49.699966 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:08:49.700959 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0914 23:08:49.700959 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0914 23:08:49.711983 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:08:49.889589 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:08:49.920616 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:08:49.935582 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:08:50.067426 6016 addons.go:231] Setting addon default-storageclass=true in "default-k8s-diff-port-645100"
W0914 23:08:50.067426 6016 addons.go:240] addon default-storageclass should already be in state true
I0914 23:08:50.067426 6016 host.go:66] Checking if "default-k8s-diff-port-645100" exists ...
I0914 23:08:50.097403 6016 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-645100 --format={{.State.Status}}
I0914 23:08:50.170649 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.254 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0914 23:08:50.185654 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8444/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:08:50.314585 6016 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
I0914 23:08:50.314585 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0914 23:08:50.323586 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:08:50.394584 6016 node_ready.go:35] waiting up to 6m0s for node "default-k8s-diff-port-645100" to be "Ready" ...
I0914 23:08:50.492607 6016 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0914 23:08:50.492607 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0914 23:08:50.506602 6016 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0914 23:08:50.522764 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:08:50.554379 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0914 23:08:50.554379 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0914 23:08:50.665625 6016 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0914 23:08:50.665625 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0914 23:08:50.765479 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0914 23:08:50.765734 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0914 23:08:50.875002 6016 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0914 23:08:50.875002 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0914 23:08:51.048102 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0914 23:08:51.048102 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0914 23:08:51.179253 6016 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0914 23:08:51.186399 6016 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0914 23:08:51.270152 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0914 23:08:51.270690 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0914 23:08:51.957332 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-role.yaml
I0914 23:08:51.957332 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0914 23:08:52.079481 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0914 23:08:52.079481 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0914 23:08:52.173537 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0914 23:08:52.173537 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0914 23:08:52.266352 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0914 23:08:52.266352 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0914 23:08:52.464506 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0914 23:08:52.464506 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0914 23:08:52.520469 6016 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0914 23:08:57.417729 6016 node_ready.go:53] error getting node "default-k8s-diff-port-645100": etcdserver: request timed out
I0914 23:08:57.417756 6016 node_ready.go:38] duration metric: took 7.0228008s waiting for node "default-k8s-diff-port-645100" to be "Ready" ...
I0914 23:08:57.418509 6016 out.go:177]
W0914 23:08:57.419229 6016 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: error getting node "default-k8s-diff-port-645100": etcdserver: request timed out
X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: error getting node "default-k8s-diff-port-645100": etcdserver: request timed out
W0914 23:08:57.419229 6016 out.go:239] *
*
W0914 23:08:57.420479 6016 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0914 23:08:57.421474 6016 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-windows-amd64.exe start -p default-k8s-diff-port-645100 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --kubernetes-version=v1.28.1": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect default-k8s-diff-port-645100
helpers_test.go:235: (dbg) docker inspect default-k8s-diff-port-645100:
-- stdout --
[
{
"Id": "e3edc8cae7bc765963e5a5c69a417e65c83c01ceb20b086e267e8b44d69418e0",
"Created": "2023-09-14T23:01:29.8506487Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 350214,
"ExitCode": 0,
"Error": "",
"StartedAt": "2023-09-14T23:03:07.2540629Z",
"FinishedAt": "2023-09-14T23:03:02.6143889Z"
},
"Image": "sha256:054d552c99fa5c97a88670450e215d3fb345ddb79136029def1f0a74c5796d3a",
"ResolvConfPath": "/var/lib/docker/containers/e3edc8cae7bc765963e5a5c69a417e65c83c01ceb20b086e267e8b44d69418e0/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/e3edc8cae7bc765963e5a5c69a417e65c83c01ceb20b086e267e8b44d69418e0/hostname",
"HostsPath": "/var/lib/docker/containers/e3edc8cae7bc765963e5a5c69a417e65c83c01ceb20b086e267e8b44d69418e0/hosts",
"LogPath": "/var/lib/docker/containers/e3edc8cae7bc765963e5a5c69a417e65c83c01ceb20b086e267e8b44d69418e0/e3edc8cae7bc765963e5a5c69a417e65c83c01ceb20b086e267e8b44d69418e0-json.log",
"Name": "/default-k8s-diff-port-645100",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"default-k8s-diff-port-645100:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "default-k8s-diff-port-645100",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"8444/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/d31ab38eb935df99e9bf7e948ef5fa561a82ace894845ee9e175cef419491fd2-init/diff:/var/lib/docker/overlay2/ac87d09cb73b51f85191cdd2a3757056129c3f92f519cedde2699ac07302c9cd/diff",
"MergedDir": "/var/lib/docker/overlay2/d31ab38eb935df99e9bf7e948ef5fa561a82ace894845ee9e175cef419491fd2/merged",
"UpperDir": "/var/lib/docker/overlay2/d31ab38eb935df99e9bf7e948ef5fa561a82ace894845ee9e175cef419491fd2/diff",
"WorkDir": "/var/lib/docker/overlay2/d31ab38eb935df99e9bf7e948ef5fa561a82ace894845ee9e175cef419491fd2/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "default-k8s-diff-port-645100",
"Source": "/var/lib/docker/volumes/default-k8s-diff-port-645100/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "default-k8s-diff-port-645100",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8444/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694625416-17243@sha256:87a683cf6721050a43e629eceb07cbff2775f9ca392344a264b61b7da435e503",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "default-k8s-diff-port-645100",
"name.minikube.sigs.k8s.io": "default-k8s-diff-port-645100",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "38c5e7478fdd3f43b6ac0ba6b61f5698ea63a5aba1fc227e4a7519ffa5ea2f0a",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "62306"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "62307"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "62308"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "62309"
}
],
"8444/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "62305"
}
]
},
"SandboxKey": "/var/run/docker/netns/38c5e7478fdd",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"default-k8s-diff-port-645100": {
"IPAMConfig": {
"IPv4Address": "192.168.103.2"
},
"Links": null,
"Aliases": [
"e3edc8cae7bc",
"default-k8s-diff-port-645100"
],
"NetworkID": "037184b7f3e410d8f7511d1ab9280ffb0046faef30520f17dc29878032656507",
"EndpointID": "106f9baa7bf8579c04418e2d8a275a5af60e2082131062295b439b27c04ab241",
"Gateway": "192.168.103.1",
"IPAddress": "192.168.103.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:67:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-windows-amd64.exe status --format={{.Host}} -p default-k8s-diff-port-645100 -n default-k8s-diff-port-645100
E0914 23:09:11.802516 4048 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-562500\client.crt: The system cannot find the path specified.
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.Host}} -p default-k8s-diff-port-645100 -n default-k8s-diff-port-645100: exit status 2 (16.7621888s)
-- stdout --
Running
-- /stdout --
** stderr **
W0914 23:08:58.309409 6256 main.go:291] Unable to resolve the current Docker CLI context "default": context "default": context not found: open C:\Users\jenkins.minikube4\.docker\contexts\meta\37a8eec1ce19687d132fe29051dca629d164e2c4958ba141d5f4133a33f0688f\meta.json: The system cannot find the path specified.
E0914 23:09:14.915886 6256 status.go:424] Error apiserver status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[-]etcd failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[+]poststarthook/rbac/bootstrap-roles ok
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
** /stderr **
helpers_test.go:239: status error: exit status 2 (may be ok)
helpers_test.go:244: <<< TestStartStop/group/default-k8s-diff-port/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-windows-amd64.exe -p default-k8s-diff-port-645100 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-windows-amd64.exe -p default-k8s-diff-port-645100 logs -n 25: (6.9585273s)
helpers_test.go:252: TestStartStop/group/default-k8s-diff-port/serial/SecondStart logs:
-- stdout --
*
* ==> Audit <==
* |---------|--------------------------------------------------------|------------------------------|-------------------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|-------------------|---------|---------------------|---------------------|
| start | -p | default-k8s-diff-port-645100 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:01 UTC | 14 Sep 23 23:02 UTC |
| | default-k8s-diff-port-645100 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=docker | | | | | |
| | --kubernetes-version=v1.28.1 | | | | | |
| stop | -p no-preload-182800 | no-preload-182800 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:01 UTC | 14 Sep 23 23:01 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p embed-certs-675900 | embed-certs-675900 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:01 UTC | 14 Sep 23 23:01 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| addons | enable dashboard -p no-preload-182800 | no-preload-182800 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:01 UTC | 14 Sep 23 23:01 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-182800 | no-preload-182800 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:01 UTC | 14 Sep 23 23:07 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --kubernetes-version=v1.28.1 | | | | | |
| stop | -p embed-certs-675900 | embed-certs-675900 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:01 UTC | 14 Sep 23 23:01 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p embed-certs-675900 | embed-certs-675900 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:01 UTC | 14 Sep 23 23:01 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| addons | enable metrics-server -p old-k8s-version-113800 | old-k8s-version-113800 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:01 UTC | 14 Sep 23 23:01 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| start | -p embed-certs-675900 | embed-certs-675900 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:01 UTC | 14 Sep 23 23:07 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --kubernetes-version=v1.28.1 | | | | | |
| stop | -p old-k8s-version-113800 | old-k8s-version-113800 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:01 UTC | 14 Sep 23 23:01 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-113800 | old-k8s-version-113800 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:01 UTC | 14 Sep 23 23:01 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-113800 | old-k8s-version-113800 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:01 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| addons | enable metrics-server -p default-k8s-diff-port-645100 | default-k8s-diff-port-645100 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:02 UTC | 14 Sep 23 23:02 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p | default-k8s-diff-port-645100 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:02 UTC | 14 Sep 23 23:03 UTC |
| | default-k8s-diff-port-645100 | | | | | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p default-k8s-diff-port-645100 | default-k8s-diff-port-645100 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:03 UTC | 14 Sep 23 23:03 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p | default-k8s-diff-port-645100 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:03 UTC | |
| | default-k8s-diff-port-645100 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=docker | | | | | |
| | --kubernetes-version=v1.28.1 | | | | | |
| ssh | -p no-preload-182800 sudo | no-preload-182800 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:08 UTC | 14 Sep 23 23:08 UTC |
| | crictl images -o json | | | | | |
| ssh | -p embed-certs-675900 sudo | embed-certs-675900 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:08 UTC | 14 Sep 23 23:08 UTC |
| | crictl images -o json | | | | | |
| pause | -p no-preload-182800 | no-preload-182800 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:08 UTC | 14 Sep 23 23:08 UTC |
| | --alsologtostderr -v=1 | | | | | |
| pause | -p embed-certs-675900 | embed-certs-675900 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:08 UTC | 14 Sep 23 23:08 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-182800 | no-preload-182800 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:08 UTC | 14 Sep 23 23:08 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p embed-certs-675900 | embed-certs-675900 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:08 UTC | 14 Sep 23 23:08 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-182800 | no-preload-182800 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:08 UTC | 14 Sep 23 23:09 UTC |
| delete | -p embed-certs-675900 | embed-certs-675900 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:08 UTC | |
| delete | -p no-preload-182800 | no-preload-182800 | minikube4\jenkins | v1.31.2 | 14 Sep 23 23:09 UTC | |
|---------|--------------------------------------------------------|------------------------------|-------------------|---------|---------------------|---------------------|
*
* ==> Last Start <==
* Log file created at: 2023/09/14 23:03:04
Running on machine: minikube4
Binary: Built with gc go1.21.1 for windows/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0914 23:03:04.754805 6016 out.go:296] Setting OutFile to fd 1644 ...
I0914 23:03:04.755731 6016 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0914 23:03:04.755731 6016 out.go:309] Setting ErrFile to fd 1928...
I0914 23:03:04.755988 6016 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0914 23:03:04.776898 6016 out.go:303] Setting JSON to false
I0914 23:03:04.780337 6016 start.go:128] hostinfo: {"hostname":"minikube4","uptime":157780,"bootTime":1694574803,"procs":207,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.3448 Build 19045.3448","kernelVersion":"10.0.19045.3448 Build 19045.3448","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"df6bfb5f-73f2-4acb-9365-df7854ecbb28"}
W0914 23:03:04.780459 6016 start.go:136] gopshost.Virtualization returned error: not implemented yet
I0914 23:03:04.781173 6016 out.go:177] * [default-k8s-diff-port-645100] minikube v1.31.2 on Microsoft Windows 10 Enterprise N 10.0.19045.3448 Build 19045.3448
I0914 23:03:04.782296 6016 out.go:177] - KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0914 23:03:04.782296 6016 notify.go:220] Checking for updates...
I0914 23:03:04.782921 6016 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0914 23:03:04.783856 6016 out.go:177] - MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube
I0914 23:03:04.784574 6016 out.go:177] - MINIKUBE_LOCATION=17243
I0914 23:03:04.785150 6016 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0914 23:03:00.313511 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:02.318296 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:04.812754 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:04.786105 6016 config.go:182] Loaded profile config "default-k8s-diff-port-645100": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.1
I0914 23:03:04.787055 6016 driver.go:373] Setting default libvirt URI to qemu:///system
I0914 23:03:05.087347 6016 docker.go:121] docker version: linux-24.0.6:Docker Desktop 4.23.0 (120376)
I0914 23:03:05.098716 6016 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0914 23:03:05.523693 6016 info.go:266] docker info: {ID:c92f2ba1-df38-4a47-85e3-68e1162cada5 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:87 OomKillDisable:true NGoroutines:80 SystemTime:2023-09-14 23:03:05.4702783 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:9 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x8
6_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,
profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2-desktop.4] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0-desktop.1] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:
Docker Inc. Version:v0.2.20] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.7] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Command line tool for Docker Scout Vendor:Docker Inc. Version:0.24.1]] Warnings:<nil>}}
I0914 23:03:05.525275 6016 out.go:177] * Using the docker driver based on existing profile
I0914 23:03:02.420763 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:04.918140 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:05.526147 6016 start.go:298] selected driver: docker
I0914 23:03:05.526147 6016 start.go:902] validating driver "docker" against &{Name:default-k8s-diff-port-645100 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694625416-17243@sha256:87a683cf6721050a43e629eceb07cbff2775f9ca392344a264b61b7da435e503 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:default-k8s-diff-port-645100 Namespace:defaul
t APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.103.2 Port:8444 KubernetesVersion:v1.28.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertE
xpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
I0914 23:03:05.526361 6016 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0914 23:03:05.611491 6016 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0914 23:03:06.057593 6016 info.go:266] docker info: {ID:c92f2ba1-df38-4a47-85e3-68e1162cada5 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:87 OomKillDisable:true NGoroutines:80 SystemTime:2023-09-14 23:03:05.9956819 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:9 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x8
6_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,
profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2-desktop.4] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0-desktop.1] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:
Docker Inc. Version:v0.2.20] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.7] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Command line tool for Docker Scout Vendor:Docker Inc. Version:0.24.1]] Warnings:<nil>}}
I0914 23:03:06.057593 6016 start_flags.go:922] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0914 23:03:06.057593 6016 cni.go:84] Creating CNI manager for ""
I0914 23:03:06.057593 6016 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0914 23:03:06.057593 6016 start_flags.go:321] config:
{Name:default-k8s-diff-port-645100 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694625416-17243@sha256:87a683cf6721050a43e629eceb07cbff2775f9ca392344a264b61b7da435e503 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:default-k8s-diff-port-645100 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l
ocal ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.103.2 Port:8444 KubernetesVersion:v1.28.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikub
e-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
I0914 23:03:06.059606 6016 out.go:177] * Starting control plane node default-k8s-diff-port-645100 in cluster default-k8s-diff-port-645100
I0914 23:03:06.059606 6016 cache.go:122] Beginning downloading kic base image for docker with docker
I0914 23:03:06.060600 6016 out.go:177] * Pulling base image ...
I0914 23:03:06.060600 6016 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime docker
I0914 23:03:06.060600 6016 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694625416-17243@sha256:87a683cf6721050a43e629eceb07cbff2775f9ca392344a264b61b7da435e503 in local docker daemon
I0914 23:03:06.060600 6016 preload.go:148] Found local preload: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.28.1-docker-overlay2-amd64.tar.lz4
I0914 23:03:06.060600 6016 cache.go:57] Caching tarball of preloaded images
I0914 23:03:06.061604 6016 preload.go:174] Found C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.28.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0914 23:03:06.061604 6016 cache.go:60] Finished verifying existence of preloaded tar for v1.28.1 on docker
I0914 23:03:06.061604 6016 profile.go:148] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\config.json ...
I0914 23:03:06.259694 6016 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694625416-17243@sha256:87a683cf6721050a43e629eceb07cbff2775f9ca392344a264b61b7da435e503 in local docker daemon, skipping pull
I0914 23:03:06.259694 6016 cache.go:145] gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694625416-17243@sha256:87a683cf6721050a43e629eceb07cbff2775f9ca392344a264b61b7da435e503 exists in daemon, skipping load
I0914 23:03:06.259694 6016 cache.go:195] Successfully downloaded all kic artifacts
I0914 23:03:06.259694 6016 start.go:365] acquiring machines lock for default-k8s-diff-port-645100: {Name:mk3e38cc0cd00c03168a41f70860bc4f6385a707 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0914 23:03:06.259694 6016 start.go:369] acquired machines lock for "default-k8s-diff-port-645100" in 0s
I0914 23:03:06.259694 6016 start.go:96] Skipping create...Using existing machine configuration
I0914 23:03:06.259694 6016 fix.go:54] fixHost starting:
I0914 23:03:06.278693 6016 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-645100 --format={{.State.Status}}
I0914 23:03:06.482241 6016 fix.go:102] recreateIfNeeded on default-k8s-diff-port-645100: state=Stopped err=<nil>
W0914 23:03:06.482241 6016 fix.go:128] unexpected machine state, will restart: <nil>
I0914 23:03:06.483120 6016 out.go:177] * Restarting existing docker container for "default-k8s-diff-port-645100" ...
I0914 23:03:02.551312 12004 api_server.go:269] stopped: https://127.0.0.1:62202/healthz: Get "https://127.0.0.1:62202/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0914 23:03:02.551312 12004 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62202/healthz ...
I0914 23:03:05.033800 12004 api_server.go:279] https://127.0.0.1:62202/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0914 23:03:05.034356 12004 api_server.go:103] status: https://127.0.0.1:62202/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0914 23:03:05.034412 12004 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62202/healthz ...
I0914 23:03:05.436631 12004 api_server.go:279] https://127.0.0.1:62202/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0914 23:03:05.436664 12004 api_server.go:103] status: https://127.0.0.1:62202/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0914 23:03:05.436772 12004 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62202/healthz ...
I0914 23:03:05.640124 12004 api_server.go:279] https://127.0.0.1:62202/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0914 23:03:05.640124 12004 api_server.go:103] status: https://127.0.0.1:62202/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0914 23:03:05.640124 12004 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62202/healthz ...
I0914 23:03:05.749834 12004 api_server.go:279] https://127.0.0.1:62202/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0914 23:03:05.749834 12004 api_server.go:103] status: https://127.0.0.1:62202/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0914 23:03:06.041628 12004 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62202/healthz ...
I0914 23:03:06.229693 12004 api_server.go:279] https://127.0.0.1:62202/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0914 23:03:06.229693 12004 api_server.go:103] status: https://127.0.0.1:62202/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0914 23:03:06.544449 12004 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62202/healthz ...
I0914 23:03:06.657098 12004 api_server.go:279] https://127.0.0.1:62202/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0914 23:03:06.657098 12004 api_server.go:103] status: https://127.0.0.1:62202/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0914 23:03:07.045364 12004 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62202/healthz ...
I0914 23:03:07.143225 12004 api_server.go:279] https://127.0.0.1:62202/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0914 23:03:07.143225 12004 api_server.go:103] status: https://127.0.0.1:62202/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0914 23:03:06.492742 6016 cli_runner.go:164] Run: docker start default-k8s-diff-port-645100
I0914 23:03:07.320754 6016 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-645100 --format={{.State.Status}}
I0914 23:03:07.528743 6016 kic.go:426] container "default-k8s-diff-port-645100" state is running.
I0914 23:03:07.549719 6016 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-645100
I0914 23:03:07.736477 6016 profile.go:148] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\config.json ...
I0914 23:03:07.739941 6016 machine.go:88] provisioning docker machine ...
I0914 23:03:07.739941 6016 ubuntu.go:169] provisioning hostname "default-k8s-diff-port-645100"
I0914 23:03:07.753927 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:07.980243 6016 main.go:141] libmachine: Using SSH client type: native
I0914 23:03:07.981253 6016 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xfc1380] 0xfc3ec0 <nil> [] 0s} 127.0.0.1 62306 <nil> <nil>}
I0914 23:03:07.982262 6016 main.go:141] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-645100 && echo "default-k8s-diff-port-645100" | sudo tee /etc/hostname
I0914 23:03:07.986249 6016 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0914 23:03:07.310769 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:09.321807 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:07.405184 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:09.415027 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:07.544733 12004 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62202/healthz ...
I0914 23:03:07.641718 12004 api_server.go:279] https://127.0.0.1:62202/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0914 23:03:07.641718 12004 api_server.go:103] status: https://127.0.0.1:62202/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0914 23:03:08.050933 12004 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62202/healthz ...
I0914 23:03:08.145463 12004 api_server.go:279] https://127.0.0.1:62202/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0914 23:03:08.145463 12004 api_server.go:103] status: https://127.0.0.1:62202/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0914 23:03:08.550755 12004 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62202/healthz ...
I0914 23:03:08.836138 12004 api_server.go:279] https://127.0.0.1:62202/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0914 23:03:08.836138 12004 api_server.go:103] status: https://127.0.0.1:62202/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0914 23:03:09.046949 12004 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62202/healthz ...
I0914 23:03:09.241281 12004 api_server.go:279] https://127.0.0.1:62202/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0914 23:03:09.241281 12004 api_server.go:103] status: https://127.0.0.1:62202/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0914 23:03:09.547433 12004 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62202/healthz ...
I0914 23:03:09.732184 12004 api_server.go:279] https://127.0.0.1:62202/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0914 23:03:09.732184 12004 api_server.go:103] status: https://127.0.0.1:62202/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0914 23:03:10.043556 12004 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62202/healthz ...
I0914 23:03:10.142339 12004 api_server.go:279] https://127.0.0.1:62202/healthz returned 200:
ok
I0914 23:03:10.328017 12004 api_server.go:141] control plane version: v1.16.0
I0914 23:03:10.328140 12004 api_server.go:131] duration metric: took 13.296948s to wait for apiserver health ...
I0914 23:03:10.328140 12004 cni.go:84] Creating CNI manager for ""
I0914 23:03:10.328140 12004 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0914 23:03:10.328239 12004 system_pods.go:43] waiting for kube-system pods to appear ...
I0914 23:03:10.348883 12004 system_pods.go:59] 8 kube-system pods found
I0914 23:03:10.348883 12004 system_pods.go:61] "coredns-5644d7b6d9-qj2nd" [411e0cc4-20ad-49b0-9355-766e81e3adda] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0914 23:03:10.348883 12004 system_pods.go:61] "etcd-old-k8s-version-113800" [a4aef0c1-1d34-4506-a597-c18c83732975] Running
I0914 23:03:10.348883 12004 system_pods.go:61] "kube-apiserver-old-k8s-version-113800" [0601128e-4403-4e84-a1a4-a70e4106749a] Running
I0914 23:03:10.348883 12004 system_pods.go:61] "kube-controller-manager-old-k8s-version-113800" [50858630-06b8-4b52-b026-caf61018d97f] Running
I0914 23:03:10.348883 12004 system_pods.go:61] "kube-proxy-x6ngj" [0e99df68-7ee5-4c28-b17a-be9e99b16e84] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0914 23:03:10.348883 12004 system_pods.go:61] "kube-scheduler-old-k8s-version-113800" [bb250d87-5759-45fa-a61d-71db8b6cb3ab] Running
I0914 23:03:10.348883 12004 system_pods.go:61] "metrics-server-74d5856cc6-558tg" [5f8acef7-4fed-4b24-ae52-d7b1c1fe0287] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0914 23:03:10.348883 12004 system_pods.go:61] "storage-provisioner" [5fee334f-1208-4a19-9637-f87f45ef338e] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0914 23:03:10.348883 12004 system_pods.go:74] duration metric: took 20.6433ms to wait for pod list to return data ...
I0914 23:03:10.348883 12004 node_conditions.go:102] verifying NodePressure condition ...
I0914 23:03:10.441583 12004 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki
I0914 23:03:10.441646 12004 node_conditions.go:123] node cpu capacity is 16
I0914 23:03:10.441708 12004 node_conditions.go:105] duration metric: took 92.8197ms to run NodePressure ...
I0914 23:03:10.441802 12004 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0914 23:03:11.474334 12004 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml": (1.0324771s)
I0914 23:03:11.474334 12004 kubeadm.go:772] waiting for restarted kubelet to initialise ...
I0914 23:03:11.483333 12004 retry.go:31] will retry after 279.733914ms: kubelet not initialised
I0914 23:03:11.778520 12004 retry.go:31] will retry after 253.596961ms: kubelet not initialised
I0914 23:03:12.057127 12004 retry.go:31] will retry after 513.647495ms: kubelet not initialised
I0914 23:03:11.215763 6016 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-645100
I0914 23:03:11.226334 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:11.447868 6016 main.go:141] libmachine: Using SSH client type: native
I0914 23:03:11.448866 6016 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xfc1380] 0xfc3ec0 <nil> [] 0s} 127.0.0.1 62306 <nil> <nil>}
I0914 23:03:11.448866 6016 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-645100' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-645100/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-645100' | sudo tee -a /etc/hosts;
fi
fi
I0914 23:03:11.625278 6016 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0914 23:03:11.625278 6016 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube4\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube4\minikube-integration\.minikube}
I0914 23:03:11.625278 6016 ubuntu.go:177] setting up certificates
I0914 23:03:11.625278 6016 provision.go:83] configureAuth start
I0914 23:03:11.636749 6016 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-645100
I0914 23:03:11.827167 6016 provision.go:138] copyHostCerts
I0914 23:03:11.827606 6016 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem, removing ...
I0914 23:03:11.827686 6016 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.pem
I0914 23:03:11.827994 6016 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem (1078 bytes)
I0914 23:03:11.829292 6016 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem, removing ...
I0914 23:03:11.829410 6016 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cert.pem
I0914 23:03:11.829671 6016 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem (1123 bytes)
I0914 23:03:11.831116 6016 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem, removing ...
I0914 23:03:11.831235 6016 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\key.pem
I0914 23:03:11.831742 6016 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem (1679 bytes)
I0914 23:03:11.832938 6016 provision.go:112] generating server cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.default-k8s-diff-port-645100 san=[192.168.103.2 127.0.0.1 localhost 127.0.0.1 minikube default-k8s-diff-port-645100]
I0914 23:03:12.083190 6016 provision.go:172] copyRemoteCerts
I0914 23:03:12.096731 6016 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0914 23:03:12.105469 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:12.298463 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:03:12.450542 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0914 23:03:12.510174 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1257 bytes)
I0914 23:03:12.569287 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0914 23:03:12.643055 6016 provision.go:86] duration metric: configureAuth took 1.0177227s
I0914 23:03:12.643055 6016 ubuntu.go:193] setting minikube options for container-runtime
I0914 23:03:12.644400 6016 config.go:182] Loaded profile config "default-k8s-diff-port-645100": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.1
I0914 23:03:12.655151 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:12.866452 6016 main.go:141] libmachine: Using SSH client type: native
I0914 23:03:12.867243 6016 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xfc1380] 0xfc3ec0 <nil> [] 0s} 127.0.0.1 62306 <nil> <nil>}
I0914 23:03:12.867293 6016 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0914 23:03:13.056083 6016 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0914 23:03:13.056168 6016 ubuntu.go:71] root file system type: overlay
I0914 23:03:13.056380 6016 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0914 23:03:13.067275 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:13.268469 6016 main.go:141] libmachine: Using SSH client type: native
I0914 23:03:13.269757 6016 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xfc1380] 0xfc3ec0 <nil> [] 0s} 127.0.0.1 62306 <nil> <nil>}
I0914 23:03:13.269909 6016 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0914 23:03:13.491351 6016 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0914 23:03:13.501111 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:13.716525 6016 main.go:141] libmachine: Using SSH client type: native
I0914 23:03:13.717233 6016 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xfc1380] 0xfc3ec0 <nil> [] 0s} 127.0.0.1 62306 <nil> <nil>}
I0914 23:03:13.717233 6016 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0914 23:03:13.870680 6016 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0914 23:03:13.870680 6016 machine.go:91] provisioned docker machine in 6.1304139s
I0914 23:03:13.870680 6016 start.go:300] post-start starting for "default-k8s-diff-port-645100" (driver="docker")
I0914 23:03:13.870680 6016 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0914 23:03:13.884914 6016 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0914 23:03:13.893927 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:14.067514 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:03:14.214456 6016 ssh_runner.go:195] Run: cat /etc/os-release
I0914 23:03:14.225772 6016 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0914 23:03:14.225772 6016 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0914 23:03:14.225772 6016 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0914 23:03:14.225772 6016 info.go:137] Remote host: Ubuntu 22.04.3 LTS
I0914 23:03:14.225772 6016 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\addons for local assets ...
I0914 23:03:14.226547 6016 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\files for local assets ...
I0914 23:03:14.228569 6016 filesync.go:149] local asset: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\40482.pem -> 40482.pem in /etc/ssl/certs
I0914 23:03:14.243582 6016 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0914 23:03:14.265433 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\40482.pem --> /etc/ssl/certs/40482.pem (1708 bytes)
I0914 23:03:14.323281 6016 start.go:303] post-start completed in 452.5422ms
I0914 23:03:14.336662 6016 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0914 23:03:14.345665 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:14.561583 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:03:14.702938 6016 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0914 23:03:14.716018 6016 fix.go:56] fixHost completed within 8.4558765s
I0914 23:03:14.716018 6016 start.go:83] releasing machines lock for "default-k8s-diff-port-645100", held for 8.4558765s
I0914 23:03:14.730378 6016 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-645100
I0914 23:03:11.811504 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:13.844933 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:11.909366 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:13.921031 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:12.588927 12004 retry.go:31] will retry after 1.039346025s: kubelet not initialised
I0914 23:03:13.646061 12004 retry.go:31] will retry after 1.377860233s: kubelet not initialised
I0914 23:03:15.041243 12004 retry.go:31] will retry after 2.278302519s: kubelet not initialised
I0914 23:03:14.922898 6016 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0914 23:03:14.934670 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:14.935856 6016 ssh_runner.go:195] Run: cat /version.json
I0914 23:03:14.945283 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:15.137619 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:03:15.153616 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:03:15.426059 6016 ssh_runner.go:195] Run: systemctl --version
I0914 23:03:15.459617 6016 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0914 23:03:15.488099 6016 ssh_runner.go:195] Run: sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
W0914 23:03:15.510382 6016 start.go:413] unable to name loopback interface in configureRuntimes: unable to patch loopback cni config "/etc/cni/net.d/*loopback.conf*": sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;: Process exited with status 1
stdout:
stderr:
find: '\\etc\\cni\\net.d': No such file or directory
I0914 23:03:15.523084 6016 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0914 23:03:15.547831 6016 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0914 23:03:15.547831 6016 start.go:469] detecting cgroup driver to use...
I0914 23:03:15.547831 6016 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0914 23:03:15.547831 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0914 23:03:15.604543 6016 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0914 23:03:15.652681 6016 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0914 23:03:15.676561 6016 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I0914 23:03:15.690660 6016 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0914 23:03:15.730144 6016 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0914 23:03:15.767957 6016 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0914 23:03:15.807480 6016 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0914 23:03:15.847328 6016 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0914 23:03:15.886388 6016 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0914 23:03:15.928369 6016 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0914 23:03:15.965846 6016 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0914 23:03:16.000991 6016 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 23:03:16.196424 6016 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0914 23:03:16.358517 6016 start.go:469] detecting cgroup driver to use...
I0914 23:03:16.359700 6016 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0914 23:03:16.378474 6016 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0914 23:03:16.412344 6016 cruntime.go:276] skipping containerd shutdown because we are bound to it
I0914 23:03:16.425333 6016 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0914 23:03:16.457480 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0914 23:03:16.548183 6016 ssh_runner.go:195] Run: which cri-dockerd
I0914 23:03:16.575366 6016 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0914 23:03:16.600097 6016 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0914 23:03:16.675756 6016 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0914 23:03:16.886604 6016 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0914 23:03:17.084891 6016 docker.go:535] configuring docker to use "cgroupfs" as cgroup driver...
I0914 23:03:17.084891 6016 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
I0914 23:03:17.174640 6016 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 23:03:17.356966 6016 ssh_runner.go:195] Run: sudo systemctl restart docker
I0914 23:03:18.022432 6016 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0914 23:03:18.198796 6016 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0914 23:03:18.365268 6016 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0914 23:03:18.529702 6016 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 23:03:18.690471 6016 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0914 23:03:18.739287 6016 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 23:03:18.913551 6016 ssh_runner.go:195] Run: sudo systemctl restart cri-docker
I0914 23:03:19.078331 6016 start.go:516] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0914 23:03:19.096336 6016 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0914 23:03:19.111082 6016 start.go:537] Will wait 60s for crictl version
I0914 23:03:19.125562 6016 ssh_runner.go:195] Run: which crictl
I0914 23:03:19.154165 6016 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0914 23:03:19.265968 6016 start.go:553] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 24.0.6
RuntimeApiVersion: v1
I0914 23:03:19.277546 6016 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0914 23:03:19.353638 6016 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0914 23:03:19.418188 6016 out.go:204] * Preparing Kubernetes v1.28.1 on Docker 24.0.6 ...
I0914 23:03:19.431233 6016 cli_runner.go:164] Run: docker exec -t default-k8s-diff-port-645100 dig +short host.docker.internal
I0914 23:03:16.321477 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:18.818072 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:16.407409 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:18.412548 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:20.918001 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:17.354209 12004 retry.go:31] will retry after 2.790107244s: kubelet not initialised
I0914 23:03:20.168424 12004 retry.go:31] will retry after 6.277735267s: kubelet not initialised
I0914 23:03:19.799146 6016 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254
I0914 23:03:19.814188 6016 ssh_runner.go:195] Run: grep 192.168.65.254 host.minikube.internal$ /etc/hosts
I0914 23:03:19.825270 6016 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0914 23:03:19.866215 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8444/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:20.064663 6016 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime docker
I0914 23:03:20.074350 6016 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0914 23:03:20.120657 6016 docker.go:636] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.28.1
registry.k8s.io/kube-controller-manager:v1.28.1
registry.k8s.io/kube-proxy:v1.28.1
registry.k8s.io/kube-scheduler:v1.28.1
registry.k8s.io/etcd:3.5.9-0
registry.k8s.io/coredns/coredns:v1.10.1
registry.k8s.io/pause:3.9
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0914 23:03:20.120657 6016 docker.go:566] Images already preloaded, skipping extraction
I0914 23:03:20.131321 6016 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0914 23:03:20.191424 6016 docker.go:636] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.28.1
registry.k8s.io/kube-controller-manager:v1.28.1
registry.k8s.io/kube-scheduler:v1.28.1
registry.k8s.io/kube-proxy:v1.28.1
registry.k8s.io/etcd:3.5.9-0
registry.k8s.io/coredns/coredns:v1.10.1
registry.k8s.io/pause:3.9
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0914 23:03:20.191424 6016 cache_images.go:84] Images are preloaded, skipping loading
I0914 23:03:20.204526 6016 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0914 23:03:20.323571 6016 cni.go:84] Creating CNI manager for ""
I0914 23:03:20.323571 6016 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0914 23:03:20.323571 6016 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0914 23:03:20.323571 6016 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.103.2 APIServerPort:8444 KubernetesVersion:v1.28.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-645100 NodeName:default-k8s-diff-port-645100 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.103.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.103.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/cert
s/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0914 23:03:20.323571 6016 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.103.2
bindPort: 8444
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "default-k8s-diff-port-645100"
kubeletExtraArgs:
node-ip: 192.168.103.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.103.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8444
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0914 23:03:20.323571 6016 kubeadm.go:976] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=default-k8s-diff-port-645100 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.103.2
[Install]
config:
{KubernetesVersion:v1.28.1 ClusterName:default-k8s-diff-port-645100 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:}
I0914 23:03:20.335575 6016 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.1
I0914 23:03:20.362319 6016 binaries.go:44] Found k8s binaries, skipping transfer
I0914 23:03:20.374310 6016 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0914 23:03:20.395883 6016 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (390 bytes)
I0914 23:03:20.434025 6016 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0914 23:03:20.477297 6016 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2114 bytes)
I0914 23:03:20.534045 6016 ssh_runner.go:195] Run: grep 192.168.103.2 control-plane.minikube.internal$ /etc/hosts
I0914 23:03:20.549139 6016 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.103.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0914 23:03:20.578073 6016 certs.go:56] Setting up C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100 for IP: 192.168.103.2
I0914 23:03:20.578073 6016 certs.go:190] acquiring lock for shared ca certs: {Name:mk92285f7546e1a5b3c3b23dab6135aa5a99cd14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 23:03:20.579066 6016 certs.go:199] skipping minikubeCA CA generation: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key
I0914 23:03:20.579386 6016 certs.go:199] skipping proxyClientCA CA generation: C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key
I0914 23:03:20.580241 6016 certs.go:315] skipping minikube-user signed cert generation: C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\client.key
I0914 23:03:20.580711 6016 certs.go:315] skipping minikube signed cert generation: C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\apiserver.key.33fce0b9
I0914 23:03:20.581121 6016 certs.go:315] skipping aggregator signed cert generation: C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\proxy-client.key
I0914 23:03:20.582507 6016 certs.go:437] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\4048.pem (1338 bytes)
W0914 23:03:20.582507 6016 certs.go:433] ignoring C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\4048_empty.pem, impossibly tiny 0 bytes
I0914 23:03:20.583034 6016 certs.go:437] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem (1675 bytes)
I0914 23:03:20.583349 6016 certs.go:437] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem (1078 bytes)
I0914 23:03:20.583596 6016 certs.go:437] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem (1123 bytes)
I0914 23:03:20.583596 6016 certs.go:437] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem (1679 bytes)
I0914 23:03:20.584425 6016 certs.go:437] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\40482.pem (1708 bytes)
I0914 23:03:20.585516 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0914 23:03:20.640768 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0914 23:03:20.698744 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0914 23:03:20.755754 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\default-k8s-diff-port-645100\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0914 23:03:20.817001 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0914 23:03:20.872214 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0914 23:03:20.934871 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0914 23:03:20.991017 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0914 23:03:21.045792 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\40482.pem --> /usr/share/ca-certificates/40482.pem (1708 bytes)
I0914 23:03:21.102981 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0914 23:03:21.162297 6016 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\4048.pem --> /usr/share/ca-certificates/4048.pem (1338 bytes)
I0914 23:03:21.217974 6016 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0914 23:03:21.273732 6016 ssh_runner.go:195] Run: openssl version
I0914 23:03:21.301483 6016 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0914 23:03:21.348731 6016 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0914 23:03:21.361218 6016 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Sep 14 21:42 /usr/share/ca-certificates/minikubeCA.pem
I0914 23:03:21.373734 6016 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0914 23:03:21.402634 6016 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0914 23:03:21.443430 6016 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4048.pem && ln -fs /usr/share/ca-certificates/4048.pem /etc/ssl/certs/4048.pem"
I0914 23:03:21.486847 6016 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4048.pem
I0914 23:03:21.500995 6016 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Sep 14 21:53 /usr/share/ca-certificates/4048.pem
I0914 23:03:21.516258 6016 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4048.pem
I0914 23:03:21.548001 6016 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/4048.pem /etc/ssl/certs/51391683.0"
I0914 23:03:21.590073 6016 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/40482.pem && ln -fs /usr/share/ca-certificates/40482.pem /etc/ssl/certs/40482.pem"
I0914 23:03:21.630275 6016 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/40482.pem
I0914 23:03:21.644186 6016 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Sep 14 21:53 /usr/share/ca-certificates/40482.pem
I0914 23:03:21.660444 6016 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/40482.pem
I0914 23:03:21.688765 6016 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/40482.pem /etc/ssl/certs/3ec20f2e.0"
I0914 23:03:21.727474 6016 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I0914 23:03:21.754215 6016 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0914 23:03:21.785295 6016 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0914 23:03:21.815922 6016 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0914 23:03:21.845139 6016 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0914 23:03:21.874837 6016 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0914 23:03:21.907178 6016 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0914 23:03:21.929937 6016 kubeadm.go:404] StartCluster: {Name:default-k8s-diff-port-645100 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694625416-17243@sha256:87a683cf6721050a43e629eceb07cbff2775f9ca392344a264b61b7da435e503 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:default-k8s-diff-port-645100 Namespace:default APIServerName:mini
kubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.103.2 Port:8444 KubernetesVersion:v1.28.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s
Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
I0914 23:03:21.940399 6016 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0914 23:03:21.998445 6016 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0914 23:03:22.022986 6016 kubeadm.go:419] found existing configuration files, will attempt cluster restart
I0914 23:03:22.022986 6016 kubeadm.go:636] restartCluster start
I0914 23:03:22.036393 6016 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0914 23:03:22.061650 6016 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0914 23:03:22.072421 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8444/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:03:22.247881 6016 kubeconfig.go:135] verify returned: extract IP: "default-k8s-diff-port-645100" does not appear in C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0914 23:03:22.248644 6016 kubeconfig.go:146] "default-k8s-diff-port-645100" context is missing from C:\Users\jenkins.minikube4\minikube-integration\kubeconfig - will repair!
I0914 23:03:22.250000 6016 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 23:03:22.280921 6016 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0914 23:03:22.305159 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:22.319509 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:22.346775 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:22.346775 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:22.362096 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:22.388857 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:22.900674 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:22.920859 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:22.957242 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:23.398457 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:23.413681 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:23.441539 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:23.896386 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:23.917499 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:23.950008 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:24.397399 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:24.412824 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:24.436571 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:21.321126 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:23.323580 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:22.924405 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:25.412364 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:26.534175 12004 retry.go:31] will retry after 4.406128288s: kubelet not initialised
I0914 23:03:24.893565 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:24.914286 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:24.940579 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:25.392870 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:25.413879 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:25.440230 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:25.896257 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:25.910357 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:25.944801 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:26.397798 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:26.414935 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:26.457353 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:26.900001 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:26.923396 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:26.954237 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:27.400377 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:27.418526 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:27.446451 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:27.889422 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:27.911981 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:27.939766 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:28.400914 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:28.413598 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:28.447732 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:28.897565 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:28.911908 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:28.938460 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:29.396684 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:29.411803 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:29.435570 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:25.817483 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:28.312901 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:27.421400 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:29.919673 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:30.960261 12004 retry.go:31] will retry after 9.553315925s: kubelet not initialised
I0914 23:03:29.894436 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:29.909522 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:29.937038 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:30.390718 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:30.404146 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:30.430432 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:30.900975 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:30.919889 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:30.947741 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:31.399313 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:31.414708 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:31.442892 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:31.897829 6016 api_server.go:166] Checking apiserver status ...
I0914 23:03:31.934079 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0914 23:03:31.963400 6016 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0914 23:03:32.316556 6016 kubeadm.go:611] needs reconfigure: apiserver error: context deadline exceeded
I0914 23:03:32.316556 6016 kubeadm.go:1128] stopping kube-system containers ...
I0914 23:03:32.327972 6016 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0914 23:03:32.375239 6016 docker.go:462] Stopping containers: [0d9c4fd0d9b1 941214e22182 fa67cdf76781 53525e13bab7 af8312dc99c6 a0230bcafcf5 0bbc5c1d49fd bcdcf5f25c80 69b8ac03fa6a 011845da6521 8afbee6f5ba4 c9828da97537 6ddc0ba56198 ee0002acea18 3b97cbcdb388]
I0914 23:03:32.389079 6016 ssh_runner.go:195] Run: docker stop 0d9c4fd0d9b1 941214e22182 fa67cdf76781 53525e13bab7 af8312dc99c6 a0230bcafcf5 0bbc5c1d49fd bcdcf5f25c80 69b8ac03fa6a 011845da6521 8afbee6f5ba4 c9828da97537 6ddc0ba56198 ee0002acea18 3b97cbcdb388
I0914 23:03:32.454306 6016 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0914 23:03:32.495826 6016 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0914 23:03:32.516382 6016 kubeadm.go:155] found existing configuration files:
-rw------- 1 root root 5639 Sep 14 23:01 /etc/kubernetes/admin.conf
-rw------- 1 root root 5657 Sep 14 23:01 /etc/kubernetes/controller-manager.conf
-rw------- 1 root root 2051 Sep 14 23:02 /etc/kubernetes/kubelet.conf
-rw------- 1 root root 5601 Sep 14 23:01 /etc/kubernetes/scheduler.conf
I0914 23:03:32.528063 6016 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf
I0914 23:03:32.567620 6016 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf
I0914 23:03:32.602617 6016 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf
I0914 23:03:32.626400 6016 kubeadm.go:166] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf: Process exited with status 1
stdout:
stderr:
I0914 23:03:32.642084 6016 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0914 23:03:32.677306 6016 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf
I0914 23:03:32.697331 6016 kubeadm.go:166] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf: Process exited with status 1
stdout:
stderr:
I0914 23:03:32.710333 6016 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0914 23:03:32.748906 6016 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0914 23:03:32.768821 6016 kubeadm.go:713] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
I0914 23:03:32.768821 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0914 23:03:32.877468 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0914 23:03:34.090478 6016 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.2129455s)
I0914 23:03:34.090478 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0914 23:03:34.348671 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0914 23:03:34.472646 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0914 23:03:34.666809 6016 api_server.go:52] waiting for apiserver process to appear ...
I0914 23:03:34.683784 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:03:30.317167 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:32.318534 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:34.320224 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:31.928255 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:34.411720 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:34.861827 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:03:35.550885 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:03:36.053770 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:03:36.563455 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:03:37.064956 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:03:37.559577 6016 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:03:37.740372 6016 api_server.go:72] duration metric: took 3.0744176s to wait for apiserver process to appear ...
I0914 23:03:37.740372 6016 api_server.go:88] waiting for apiserver healthz status ...
I0914 23:03:37.740372 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:37.746163 6016 api_server.go:269] stopped: https://127.0.0.1:62305/healthz: Get "https://127.0.0.1:62305/healthz": EOF
I0914 23:03:37.746163 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:37.750035 6016 api_server.go:269] stopped: https://127.0.0.1:62305/healthz: Get "https://127.0.0.1:62305/healthz": EOF
I0914 23:03:38.255552 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:38.261665 6016 api_server.go:269] stopped: https://127.0.0.1:62305/healthz: Get "https://127.0.0.1:62305/healthz": EOF
I0914 23:03:38.754632 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:36.321581 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:38.817519 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:36.413452 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:38.914860 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:40.540140 12004 retry.go:31] will retry after 17.868330195s: kubelet not initialised
I0914 23:03:42.635170 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0914 23:03:42.635170 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0914 23:03:42.635170 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:43.041986 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:43.042104 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:43.042104 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:43.143163 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:43.143163 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:43.255930 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:43.336214 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:43.336612 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:43.754632 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:43.841113 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:43.841113 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:44.258240 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:44.344312 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:44.344312 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:41.314997 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:43.320160 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:41.418652 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:43.910231 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:44.758651 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:44.842146 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:44.842146 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:45.256737 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:45.344932 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:45.344932 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:45.755922 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:45.844278 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0914 23:03:45.844350 6016 api_server.go:103] status: https://127.0.0.1:62305/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0914 23:03:46.257840 6016 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62305/healthz ...
I0914 23:03:46.332606 6016 api_server.go:279] https://127.0.0.1:62305/healthz returned 200:
ok
I0914 23:03:46.433440 6016 api_server.go:141] control plane version: v1.28.1
I0914 23:03:46.433706 6016 api_server.go:131] duration metric: took 8.6926098s to wait for apiserver health ...
I0914 23:03:46.433828 6016 cni.go:84] Creating CNI manager for ""
I0914 23:03:46.433828 6016 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0914 23:03:46.435645 6016 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0914 23:03:46.457972 6016 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0914 23:03:46.554679 6016 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0914 23:03:46.834009 6016 system_pods.go:43] waiting for kube-system pods to appear ...
I0914 23:03:46.941080 6016 system_pods.go:59] 8 kube-system pods found
I0914 23:03:46.941080 6016 system_pods.go:61] "coredns-5dd5756b68-rnfrd" [21cef5f8-f60b-4999-89f1-146409c222d1] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0914 23:03:46.941080 6016 system_pods.go:61] "etcd-default-k8s-diff-port-645100" [c72e4152-fd0a-4daf-adfe-3e944ba01040] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0914 23:03:46.941080 6016 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-645100" [483ddfc0-c3ce-46f6-9511-f917241ab66f] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0914 23:03:46.941273 6016 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-645100" [a9ed8b11-7033-40bc-8978-f8cfdad2c7f8] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0914 23:03:46.941317 6016 system_pods.go:61] "kube-proxy-46stq" [69dee5ce-187f-48be-9382-245b0da0d984] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0914 23:03:46.941354 6016 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-645100" [02763aba-6e2f-4fa0-8245-a3a5b4d51ef4] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0914 23:03:46.941354 6016 system_pods.go:61] "metrics-server-57f55c9bc5-v4l49" [1d457bd3-ccdc-478d-a9e1-09d47b8dd30d] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0914 23:03:46.941522 6016 system_pods.go:61] "storage-provisioner" [588a97e8-47d9-4c79-8acd-4bbb4bf7999d] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0914 23:03:46.941522 6016 system_pods.go:74] duration metric: took 107.5077ms to wait for pod list to return data ...
I0914 23:03:46.941522 6016 node_conditions.go:102] verifying NodePressure condition ...
I0914 23:03:46.951796 6016 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki
I0914 23:03:46.951931 6016 node_conditions.go:123] node cpu capacity is 16
I0914 23:03:46.951976 6016 node_conditions.go:105] duration metric: took 10.453ms to run NodePressure ...
I0914 23:03:46.951976 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0914 23:03:49.229874 6016 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml": (2.2775254s)
I0914 23:03:49.229899 6016 kubeadm.go:772] waiting for restarted kubelet to initialise ...
I0914 23:03:49.246203 6016 kubeadm.go:787] kubelet initialised
I0914 23:03:49.246203 6016 kubeadm.go:788] duration metric: took 16.2088ms waiting for restarted kubelet to initialise ...
I0914 23:03:49.246203 6016 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 23:03:49.263115 6016 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-rnfrd" in "kube-system" namespace to be "Ready" ...
I0914 23:03:45.323054 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:47.326174 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:49.823662 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:46.417086 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:48.916591 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:51.457609 6016 pod_ready.go:102] pod "coredns-5dd5756b68-rnfrd" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:53.470394 6016 pod_ready.go:102] pod "coredns-5dd5756b68-rnfrd" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:52.314426 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:54.321639 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:51.408076 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:53.417943 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:55.418846 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:55.975707 6016 pod_ready.go:102] pod "coredns-5dd5756b68-rnfrd" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:58.043458 6016 pod_ready.go:102] pod "coredns-5dd5756b68-rnfrd" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:59.465321 6016 pod_ready.go:92] pod "coredns-5dd5756b68-rnfrd" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:59.465321 6016 pod_ready.go:81] duration metric: took 10.2016652s waiting for pod "coredns-5dd5756b68-rnfrd" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.465321 6016 pod_ready.go:78] waiting up to 4m0s for pod "etcd-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.481162 6016 pod_ready.go:92] pod "etcd-default-k8s-diff-port-645100" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:59.481231 6016 pod_ready.go:81] duration metric: took 15.9095ms waiting for pod "etcd-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.481231 6016 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.494775 6016 pod_ready.go:92] pod "kube-apiserver-default-k8s-diff-port-645100" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:59.495309 6016 pod_ready.go:81] duration metric: took 14.0775ms waiting for pod "kube-apiserver-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.495309 6016 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.508635 6016 pod_ready.go:92] pod "kube-controller-manager-default-k8s-diff-port-645100" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:59.508658 6016 pod_ready.go:81] duration metric: took 13.348ms waiting for pod "kube-controller-manager-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.508706 6016 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-46stq" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.522465 6016 pod_ready.go:92] pod "kube-proxy-46stq" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:59.522465 6016 pod_ready.go:81] duration metric: took 13.759ms waiting for pod "kube-proxy-46stq" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.522465 6016 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:56.326714 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:58.824356 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:57.922698 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:59.946719 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:58.446490 12004 kubeadm.go:787] kubelet initialised
I0914 23:03:58.446490 12004 kubeadm.go:788] duration metric: took 46.9696703s waiting for restarted kubelet to initialise ...
I0914 23:03:58.447878 12004 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 23:03:58.462698 12004 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-npnqj" in "kube-system" namespace to be "Ready" ...
I0914 23:03:58.484664 12004 pod_ready.go:92] pod "coredns-5644d7b6d9-npnqj" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:58.484664 12004 pod_ready.go:81] duration metric: took 21.9647ms waiting for pod "coredns-5644d7b6d9-npnqj" in "kube-system" namespace to be "Ready" ...
I0914 23:03:58.484664 12004 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-qj2nd" in "kube-system" namespace to be "Ready" ...
I0914 23:03:58.494942 12004 pod_ready.go:92] pod "coredns-5644d7b6d9-qj2nd" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:58.495004 12004 pod_ready.go:81] duration metric: took 10.3394ms waiting for pod "coredns-5644d7b6d9-qj2nd" in "kube-system" namespace to be "Ready" ...
I0914 23:03:58.495004 12004 pod_ready.go:78] waiting up to 4m0s for pod "etcd-old-k8s-version-113800" in "kube-system" namespace to be "Ready" ...
I0914 23:03:58.507549 12004 pod_ready.go:92] pod "etcd-old-k8s-version-113800" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:58.507601 12004 pod_ready.go:81] duration metric: took 12.5968ms waiting for pod "etcd-old-k8s-version-113800" in "kube-system" namespace to be "Ready" ...
I0914 23:03:58.507601 12004 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-old-k8s-version-113800" in "kube-system" namespace to be "Ready" ...
I0914 23:03:58.521383 12004 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-113800" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:58.521383 12004 pod_ready.go:81] duration metric: took 13.7807ms waiting for pod "kube-apiserver-old-k8s-version-113800" in "kube-system" namespace to be "Ready" ...
I0914 23:03:58.521383 12004 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-old-k8s-version-113800" in "kube-system" namespace to be "Ready" ...
I0914 23:03:58.830027 12004 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-113800" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:58.830217 12004 pod_ready.go:81] duration metric: took 308.8179ms waiting for pod "kube-controller-manager-old-k8s-version-113800" in "kube-system" namespace to be "Ready" ...
I0914 23:03:58.830217 12004 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-x6ngj" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.222696 12004 pod_ready.go:92] pod "kube-proxy-x6ngj" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:59.222744 12004 pod_ready.go:81] duration metric: took 392.5067ms waiting for pod "kube-proxy-x6ngj" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.222744 12004 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-old-k8s-version-113800" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.626349 12004 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-113800" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:59.626349 12004 pod_ready.go:81] duration metric: took 403.5831ms waiting for pod "kube-scheduler-old-k8s-version-113800" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.626349 12004 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace to be "Ready" ...
I0914 23:04:01.958502 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:03:59.862020 6016 pod_ready.go:92] pod "kube-scheduler-default-k8s-diff-port-645100" in "kube-system" namespace has status "Ready":"True"
I0914 23:03:59.862097 6016 pod_ready.go:81] duration metric: took 339.6136ms waiting for pod "kube-scheduler-default-k8s-diff-port-645100" in "kube-system" namespace to be "Ready" ...
I0914 23:03:59.862097 6016 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace to be "Ready" ...
I0914 23:04:02.194530 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:04.688262 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:00.834732 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:03.316152 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:02.408752 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:04.920584 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:04.449577 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:06.458239 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:07.188187 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:09.698259 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:05.326348 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:07.825631 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:09.826317 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:07.405015 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:09.405859 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:08.955210 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:10.968149 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:12.185738 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:14.189391 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:12.312682 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:14.315372 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:11.409811 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:13.914918 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:15.917518 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:13.457414 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:15.964103 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:16.199544 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:18.692426 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:16.322579 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:18.821966 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:18.412363 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:20.911007 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:18.462095 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:20.954199 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:21.189038 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:23.697485 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:21.318688 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:23.823239 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:22.920814 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:25.418424 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:23.455315 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:25.467417 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:25.698759 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:27.700444 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:26.324549 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:28.817660 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:27.420558 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:29.915845 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:27.968001 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:30.468049 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:30.186949 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:32.198339 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:34.704826 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:30.824199 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:32.826834 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:31.916974 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:34.412728 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:32.970840 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:34.972653 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:37.199140 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:39.692028 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:35.316224 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:37.324325 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:39.816226 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:36.921655 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:39.416404 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:37.464740 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:39.955931 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:42.239198 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:44.706447 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:41.818285 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:44.326089 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:41.912435 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:44.035285 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:42.460028 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:44.476175 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:46.966219 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:47.201107 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:49.692150 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:46.832231 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:49.316782 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:46.421016 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:48.911800 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:50.923651 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:49.040783 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:51.468603 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:51.698188 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:53.747730 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:51.330317 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:53.819623 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:53.412886 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:55.452292 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:53.962267 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:55.968015 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:56.201014 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:58.691453 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:55.827877 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:58.318734 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:57.910636 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:59.919769 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:04:58.458642 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:00.464353 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:00.699701 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:02.707568 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:00.328069 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:02.824642 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:04.826532 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:01.923768 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:04.417906 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:02.964242 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:05.462853 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:05.198653 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:07.693634 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:09.698468 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:07.332569 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:09.824780 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:06.913664 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:08.919349 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:07.466417 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:09.969746 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:12.192277 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:14.202695 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:12.315487 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:14.326653 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:11.412108 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:13.419642 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:15.425045 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:12.454657 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:14.463901 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:16.468842 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:16.694865 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:18.698931 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:16.818993 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:18.823663 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:17.916198 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:20.413480 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:18.967090 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:21.465467 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:21.192901 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:23.195019 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:21.328521 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:23.817304 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:22.417479 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:24.914936 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:23.960236 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:26.466203 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:25.697599 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:27.752444 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:25.827843 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:28.324692 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:26.921135 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:28.926640 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:28.968979 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:31.453714 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:30.190811 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:32.202029 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:34.705221 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:30.830090 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:33.319076 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:31.421934 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:33.922407 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:35.929171 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:33.459498 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:35.467708 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:37.196766 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:39.695393 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:35.331376 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:37.815575 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:39.849027 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:38.425073 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:40.921747 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:37.953587 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:39.968396 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:41.699552 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:43.703179 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:42.324666 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:44.820335 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:43.425045 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:45.912399 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:42.464014 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:44.959387 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:46.197356 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:48.202140 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:47.327610 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:49.825403 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:47.922286 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:50.423093 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:47.468517 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:49.969737 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:50.341278 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:52.695207 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:54.704529 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:52.321380 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:54.331714 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:52.915279 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:54.922936 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:52.461351 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:54.474202 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:56.965966 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:56.705385 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:59.195175 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:56.824628 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:58.830034 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:56.924095 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:58.925012 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:05:59.470550 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:01.957165 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:01.204895 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:03.696885 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:01.329914 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:03.348580 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:01.425365 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:03.921290 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:03.971643 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:06.458202 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:06.195219 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:08.197386 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:05.820788 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:07.821207 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:06.414067 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:08.420728 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:10.425162 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:08.462649 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:10.471734 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:10.705609 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:12.706164 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:10.333766 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:12.832439 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:12.924371 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:15.416965 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:12.969657 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:15.465121 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:15.202359 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:17.692347 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:19.702677 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:15.326859 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:17.831233 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:17.924989 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:20.419621 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:17.968978 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:19.970243 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:21.978634 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:21.712026 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:24.267051 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:20.323561 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:22.325039 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:24.329437 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:22.925665 13072 pod_ready.go:102] pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:24.607089 13072 pod_ready.go:81] duration metric: took 4m0.0109566s waiting for pod "metrics-server-57f55c9bc5-kdvjx" in "kube-system" namespace to be "Ready" ...
E0914 23:06:24.607089 13072 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0914 23:06:24.607298 13072 pod_ready.go:38] duration metric: took 4m16.0310693s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 23:06:24.607362 13072 kubeadm.go:640] restartCluster took 4m43.7600789s
W0914 23:06:24.607362 13072 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
I0914 23:06:24.607362 13072 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force"
I0914 23:06:24.475090 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:26.976353 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:26.705785 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:29.200304 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:26.827555 9136 pod_ready.go:102] pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:26.954215 9136 pod_ready.go:81] duration metric: took 4m0.0111539s waiting for pod "metrics-server-57f55c9bc5-w797m" in "kube-system" namespace to be "Ready" ...
E0914 23:06:26.954326 9136 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0914 23:06:26.954436 9136 pod_ready.go:38] duration metric: took 4m4.1059648s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 23:06:26.954526 9136 kubeadm.go:640] restartCluster took 4m34.2792406s
W0914 23:06:26.954668 9136 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
I0914 23:06:26.955246 9136 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force"
I0914 23:06:29.469609 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:31.963682 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:31.695271 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:34.206346 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:33.969657 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:36.470718 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:36.208683 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:38.697247 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:38.971001 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:41.467977 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:40.707935 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:43.194973 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:42.942622 13072 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force": (18.3342552s)
I0914 23:06:42.957581 13072 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 23:06:43.006772 13072 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0914 23:06:43.030881 13072 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I0914 23:06:43.048366 13072 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0914 23:06:43.081839 13072 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0914 23:06:43.081905 13072 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0914 23:06:43.262155 13072 kubeadm.go:322] [WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet
I0914 23:06:43.472214 13072 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0914 23:06:43.469009 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:45.972595 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:45.202515 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:47.762768 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:46.804916 9136 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force": (19.8485597s)
I0914 23:06:46.818921 9136 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 23:06:46.873785 9136 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0914 23:06:46.898636 9136 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I0914 23:06:46.912192 9136 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0914 23:06:46.942683 9136 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0914 23:06:46.942851 9136 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0914 23:06:47.121414 9136 kubeadm.go:322] [WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet
I0914 23:06:47.296052 9136 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0914 23:06:48.470752 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:50.472098 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:50.203740 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:52.698024 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:54.707275 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:52.960614 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:54.960897 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:56.966059 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:57.202900 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:06:59.209144 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:00.057649 13072 kubeadm.go:322] [init] Using Kubernetes version: v1.28.1
I0914 23:07:00.057649 13072 kubeadm.go:322] [preflight] Running pre-flight checks
I0914 23:07:00.057649 13072 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0914 23:07:00.058673 13072 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0914 23:07:00.058673 13072 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0914 23:07:00.058673 13072 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0914 23:07:00.059672 13072 out.go:204] - Generating certificates and keys ...
I0914 23:07:00.059672 13072 kubeadm.go:322] [certs] Using existing ca certificate authority
I0914 23:07:00.060666 13072 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0914 23:07:00.060666 13072 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0914 23:07:00.060666 13072 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0914 23:07:00.060666 13072 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0914 23:07:00.060666 13072 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0914 23:07:00.061662 13072 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0914 23:07:00.061662 13072 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0914 23:07:00.061662 13072 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0914 23:07:00.061662 13072 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0914 23:07:00.062667 13072 kubeadm.go:322] [certs] Using the existing "sa" key
I0914 23:07:00.062667 13072 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0914 23:07:00.062667 13072 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0914 23:07:00.062667 13072 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0914 23:07:00.062667 13072 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0914 23:07:00.063676 13072 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0914 23:07:00.065680 13072 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0914 23:07:00.065680 13072 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0914 23:07:00.066657 13072 out.go:204] - Booting up control plane ...
I0914 23:07:00.066657 13072 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0914 23:07:00.067663 13072 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0914 23:07:00.067663 13072 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0914 23:07:00.067663 13072 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0914 23:07:00.068654 13072 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0914 23:07:00.068654 13072 kubeadm.go:322] [kubelet-start] Starting the kubelet
I0914 23:07:00.068654 13072 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0914 23:07:00.069682 13072 kubeadm.go:322] [apiclient] All control plane components are healthy after 12.506182 seconds
I0914 23:07:00.069682 13072 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0914 23:07:00.069682 13072 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0914 23:07:00.070670 13072 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
I0914 23:07:00.070670 13072 kubeadm.go:322] [mark-control-plane] Marking the node no-preload-182800 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0914 23:07:00.070670 13072 kubeadm.go:322] [bootstrap-token] Using token: di1drf.t9cwhn88xwd6mxdv
I0914 23:07:00.071695 13072 out.go:204] - Configuring RBAC rules ...
I0914 23:07:00.071695 13072 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0914 23:07:00.071695 13072 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0914 23:07:00.072715 13072 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0914 23:07:00.072715 13072 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0914 23:07:00.073656 13072 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0914 23:07:00.073656 13072 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0914 23:07:00.073656 13072 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0914 23:07:00.074715 13072 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
I0914 23:07:00.074715 13072 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
I0914 23:07:00.074715 13072 kubeadm.go:322]
I0914 23:07:00.074715 13072 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
I0914 23:07:00.074715 13072 kubeadm.go:322]
I0914 23:07:00.075683 13072 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
I0914 23:07:00.075683 13072 kubeadm.go:322]
I0914 23:07:00.075683 13072 kubeadm.go:322] mkdir -p $HOME/.kube
I0914 23:07:00.075683 13072 kubeadm.go:322] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0914 23:07:00.075683 13072 kubeadm.go:322] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0914 23:07:00.075683 13072 kubeadm.go:322]
I0914 23:07:00.075683 13072 kubeadm.go:322] Alternatively, if you are the root user, you can run:
I0914 23:07:00.075683 13072 kubeadm.go:322]
I0914 23:07:00.075683 13072 kubeadm.go:322] export KUBECONFIG=/etc/kubernetes/admin.conf
I0914 23:07:00.076652 13072 kubeadm.go:322]
I0914 23:07:00.076652 13072 kubeadm.go:322] You should now deploy a pod network to the cluster.
I0914 23:07:00.076652 13072 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0914 23:07:00.076652 13072 kubeadm.go:322] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0914 23:07:00.076652 13072 kubeadm.go:322]
I0914 23:07:00.077693 13072 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
I0914 23:07:00.077693 13072 kubeadm.go:322] and service account keys on each node and then running the following as root:
I0914 23:07:00.077693 13072 kubeadm.go:322]
I0914 23:07:00.077693 13072 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token di1drf.t9cwhn88xwd6mxdv \
I0914 23:07:00.077693 13072 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:32b4d7e85e22242a9dda455612f2c711aed2ef170d515f82ac1bb228ecce4fa2 \
I0914 23:07:00.077693 13072 kubeadm.go:322] --control-plane
I0914 23:07:00.078675 13072 kubeadm.go:322]
I0914 23:07:00.078675 13072 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
I0914 23:07:00.078675 13072 kubeadm.go:322]
I0914 23:07:00.078675 13072 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token di1drf.t9cwhn88xwd6mxdv \
I0914 23:07:00.079690 13072 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:32b4d7e85e22242a9dda455612f2c711aed2ef170d515f82ac1bb228ecce4fa2
I0914 23:07:00.079690 13072 cni.go:84] Creating CNI manager for ""
I0914 23:07:00.079690 13072 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0914 23:07:00.080691 13072 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0914 23:07:00.096685 13072 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0914 23:07:00.167527 13072 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0914 23:07:00.342767 13072 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0914 23:07:00.368788 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl label nodes minikube.k8s.io/version=v1.31.2 minikube.k8s.io/commit=d7492f2ae2d9b6e62b385ffcd97ebad62c645e82 minikube.k8s.io/name=no-preload-182800 minikube.k8s.io/updated_at=2023_09_14T23_07_00_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:00.370800 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:00.545627 13072 ops.go:34] apiserver oom_adj: -16
I0914 23:06:58.971345 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:01.473975 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:04.255283 9136 kubeadm.go:322] [init] Using Kubernetes version: v1.28.1
I0914 23:07:04.256085 9136 kubeadm.go:322] [preflight] Running pre-flight checks
I0914 23:07:04.256085 9136 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0914 23:07:04.256085 9136 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0914 23:07:04.256085 9136 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0914 23:07:04.256085 9136 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0914 23:07:04.257992 9136 out.go:204] - Generating certificates and keys ...
I0914 23:07:04.257992 9136 kubeadm.go:322] [certs] Using existing ca certificate authority
I0914 23:07:04.257992 9136 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0914 23:07:04.257992 9136 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0914 23:07:04.257992 9136 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0914 23:07:04.257992 9136 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0914 23:07:04.259000 9136 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0914 23:07:04.259000 9136 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0914 23:07:04.259000 9136 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0914 23:07:04.259000 9136 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0914 23:07:04.259000 9136 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0914 23:07:04.259000 9136 kubeadm.go:322] [certs] Using the existing "sa" key
I0914 23:07:04.259000 9136 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0914 23:07:04.259995 9136 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0914 23:07:04.259995 9136 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0914 23:07:04.259995 9136 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0914 23:07:04.259995 9136 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0914 23:07:04.259995 9136 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0914 23:07:04.259995 9136 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0914 23:07:04.260997 9136 out.go:204] - Booting up control plane ...
I0914 23:07:04.260997 9136 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0914 23:07:04.260997 9136 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0914 23:07:04.261987 9136 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0914 23:07:04.261987 9136 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0914 23:07:04.261987 9136 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0914 23:07:04.261987 9136 kubeadm.go:322] [kubelet-start] Starting the kubelet
I0914 23:07:04.261987 9136 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0914 23:07:04.262994 9136 kubeadm.go:322] [apiclient] All control plane components are healthy after 12.005777 seconds
I0914 23:07:04.262994 9136 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0914 23:07:04.262994 9136 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0914 23:07:04.262994 9136 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
I0914 23:07:04.263997 9136 kubeadm.go:322] [mark-control-plane] Marking the node embed-certs-675900 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0914 23:07:04.263997 9136 kubeadm.go:322] [bootstrap-token] Using token: 38288e.cfruaa5umk7s6273
I0914 23:07:04.266999 9136 out.go:204] - Configuring RBAC rules ...
I0914 23:07:04.266999 9136 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0914 23:07:04.267983 9136 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0914 23:07:04.267983 9136 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0914 23:07:04.267983 9136 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0914 23:07:04.269016 9136 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0914 23:07:04.269016 9136 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0914 23:07:04.269016 9136 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0914 23:07:04.269993 9136 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
I0914 23:07:04.269993 9136 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
I0914 23:07:04.269993 9136 kubeadm.go:322]
I0914 23:07:04.269993 9136 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
I0914 23:07:04.269993 9136 kubeadm.go:322]
I0914 23:07:04.269993 9136 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
I0914 23:07:04.269993 9136 kubeadm.go:322]
I0914 23:07:04.269993 9136 kubeadm.go:322] mkdir -p $HOME/.kube
I0914 23:07:04.269993 9136 kubeadm.go:322] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0914 23:07:04.269993 9136 kubeadm.go:322] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0914 23:07:04.269993 9136 kubeadm.go:322]
I0914 23:07:04.270995 9136 kubeadm.go:322] Alternatively, if you are the root user, you can run:
I0914 23:07:04.270995 9136 kubeadm.go:322]
I0914 23:07:04.270995 9136 kubeadm.go:322] export KUBECONFIG=/etc/kubernetes/admin.conf
I0914 23:07:04.270995 9136 kubeadm.go:322]
I0914 23:07:04.270995 9136 kubeadm.go:322] You should now deploy a pod network to the cluster.
I0914 23:07:04.270995 9136 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0914 23:07:04.270995 9136 kubeadm.go:322] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0914 23:07:04.270995 9136 kubeadm.go:322]
I0914 23:07:04.270995 9136 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
I0914 23:07:04.272001 9136 kubeadm.go:322] and service account keys on each node and then running the following as root:
I0914 23:07:04.272001 9136 kubeadm.go:322]
I0914 23:07:04.272001 9136 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 38288e.cfruaa5umk7s6273 \
I0914 23:07:04.272001 9136 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:32b4d7e85e22242a9dda455612f2c711aed2ef170d515f82ac1bb228ecce4fa2 \
I0914 23:07:04.272001 9136 kubeadm.go:322] --control-plane
I0914 23:07:04.272001 9136 kubeadm.go:322]
I0914 23:07:04.272001 9136 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
I0914 23:07:04.272001 9136 kubeadm.go:322]
I0914 23:07:04.272984 9136 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 38288e.cfruaa5umk7s6273 \
I0914 23:07:04.272984 9136 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:32b4d7e85e22242a9dda455612f2c711aed2ef170d515f82ac1bb228ecce4fa2
I0914 23:07:04.272984 9136 cni.go:84] Creating CNI manager for ""
I0914 23:07:04.272984 9136 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0914 23:07:04.273993 9136 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0914 23:07:01.710840 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:04.200414 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:04.287988 9136 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0914 23:07:04.353611 9136 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0914 23:07:04.395864 9136 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0914 23:07:04.410848 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl label nodes minikube.k8s.io/version=v1.31.2 minikube.k8s.io/commit=d7492f2ae2d9b6e62b385ffcd97ebad62c645e82 minikube.k8s.io/name=embed-certs-675900 minikube.k8s.io/updated_at=2023_09_14T23_07_04_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:04.410848 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:04.458292 9136 ops.go:34] apiserver oom_adj: -16
I0914 23:07:01.277226 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:01.689726 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:02.573658 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:03.060862 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:03.575003 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:04.078746 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:04.571705 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:05.068255 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:05.567213 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:03.967832 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:05.976957 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:06.695367 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:08.702213 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:05.267237 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:05.449412 9136 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.28.1/kubectl label nodes minikube.k8s.io/version=v1.31.2 minikube.k8s.io/commit=d7492f2ae2d9b6e62b385ffcd97ebad62c645e82 minikube.k8s.io/name=embed-certs-675900 minikube.k8s.io/updated_at=2023_09_14T23_07_04_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig: (1.0385088s)
I0914 23:07:05.877807 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:06.880778 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:07.383534 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:07.884809 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:08.387432 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:08.884747 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:09.388456 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:09.888384 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:06.075323 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:06.568352 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:07.069748 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:07.574064 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:08.071957 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:08.573311 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:09.079245 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:09.563058 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:10.062609 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:10.563962 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:08.466741 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:10.472661 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:11.066180 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:11.564920 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:12.074387 13072 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:12.273601 13072 kubeadm.go:1081] duration metric: took 11.9299882s to wait for elevateKubeSystemPrivileges.
I0914 23:07:12.273601 13072 kubeadm.go:406] StartCluster complete in 5m31.5190955s
I0914 23:07:12.273601 13072 settings.go:142] acquiring lock: {Name:mk5d8710830d010adb6db61f855b0ef766a8622c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 23:07:12.273601 13072 settings.go:150] Updating kubeconfig: C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0914 23:07:12.276978 13072 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 23:07:12.278685 13072 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0914 23:07:12.278816 13072 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]
I0914 23:07:12.278976 13072 addons.go:69] Setting storage-provisioner=true in profile "no-preload-182800"
I0914 23:07:12.279093 13072 addons.go:231] Setting addon storage-provisioner=true in "no-preload-182800"
W0914 23:07:12.279093 13072 addons.go:240] addon storage-provisioner should already be in state true
I0914 23:07:12.279093 13072 addons.go:69] Setting dashboard=true in profile "no-preload-182800"
I0914 23:07:12.279093 13072 addons.go:69] Setting metrics-server=true in profile "no-preload-182800"
I0914 23:07:12.279174 13072 addons.go:231] Setting addon dashboard=true in "no-preload-182800"
I0914 23:07:12.279250 13072 host.go:66] Checking if "no-preload-182800" exists ...
I0914 23:07:12.279093 13072 addons.go:69] Setting default-storageclass=true in profile "no-preload-182800"
W0914 23:07:12.279250 13072 addons.go:240] addon dashboard should already be in state true
I0914 23:07:12.279303 13072 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-182800"
I0914 23:07:12.279174 13072 addons.go:231] Setting addon metrics-server=true in "no-preload-182800"
I0914 23:07:12.279496 13072 host.go:66] Checking if "no-preload-182800" exists ...
W0914 23:07:12.279496 13072 addons.go:240] addon metrics-server should already be in state true
I0914 23:07:12.279594 13072 config.go:182] Loaded profile config "no-preload-182800": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.1
I0914 23:07:12.279689 13072 host.go:66] Checking if "no-preload-182800" exists ...
I0914 23:07:12.312719 13072 cli_runner.go:164] Run: docker container inspect no-preload-182800 --format={{.State.Status}}
I0914 23:07:12.313709 13072 cli_runner.go:164] Run: docker container inspect no-preload-182800 --format={{.State.Status}}
I0914 23:07:12.314709 13072 cli_runner.go:164] Run: docker container inspect no-preload-182800 --format={{.State.Status}}
I0914 23:07:12.315718 13072 cli_runner.go:164] Run: docker container inspect no-preload-182800 --format={{.State.Status}}
I0914 23:07:12.546767 13072 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0914 23:07:12.547756 13072 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0914 23:07:12.548768 13072 addons.go:423] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0914 23:07:12.549757 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0914 23:07:12.556783 13072 kapi.go:248] "coredns" deployment in "kube-system" namespace and "no-preload-182800" context rescaled to 1 replicas
I0914 23:07:12.556783 13072 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.28.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0914 23:07:12.557761 13072 out.go:177] * Verifying Kubernetes components...
I0914 23:07:12.564746 13072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-182800
I0914 23:07:12.577879 13072 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0914 23:07:12.577879 13072 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0914 23:07:12.578755 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0914 23:07:12.578755 13072 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 23:07:12.590740 13072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-182800
I0914 23:07:12.592740 13072 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0914 23:07:10.703451 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:12.705759 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:14.707446 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:10.376844 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:10.879804 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:11.379290 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:11.878286 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:12.386738 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:12.880087 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:13.379034 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:13.875952 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:14.382200 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:14.891068 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:12.593782 13072 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0914 23:07:12.593782 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0914 23:07:12.603741 13072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-182800
I0914 23:07:12.745283 13072 addons.go:231] Setting addon default-storageclass=true in "no-preload-182800"
W0914 23:07:12.745283 13072 addons.go:240] addon default-storageclass should already be in state true
I0914 23:07:12.746310 13072 host.go:66] Checking if "no-preload-182800" exists ...
I0914 23:07:12.779299 13072 cli_runner.go:164] Run: docker container inspect no-preload-182800 --format={{.State.Status}}
I0914 23:07:12.783259 13072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62112 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\no-preload-182800\id_rsa Username:docker}
I0914 23:07:12.801267 13072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62112 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\no-preload-182800\id_rsa Username:docker}
I0914 23:07:12.832261 13072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62112 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\no-preload-182800\id_rsa Username:docker}
I0914 23:07:12.973545 13072 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
I0914 23:07:12.973545 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0914 23:07:12.984553 13072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-182800
I0914 23:07:13.176002 13072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62112 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\no-preload-182800\id_rsa Username:docker}
I0914 23:07:13.576368 13072 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0914 23:07:13.639764 13072 addons.go:423] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0914 23:07:13.640314 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0914 23:07:13.742874 13072 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml": (1.4641109s)
I0914 23:07:13.743444 13072 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (1.1646281s)
I0914 23:07:13.744481 13072 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.254 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0914 23:07:13.760681 13072 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0914 23:07:13.760681 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0914 23:07:13.766655 13072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" no-preload-182800
I0914 23:07:13.971015 13072 node_ready.go:35] waiting up to 6m0s for node "no-preload-182800" to be "Ready" ...
I0914 23:07:14.041842 13072 addons.go:423] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0914 23:07:14.041842 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0914 23:07:14.145529 13072 node_ready.go:49] node "no-preload-182800" has status "Ready":"True"
I0914 23:07:14.145529 13072 node_ready.go:38] duration metric: took 174.5044ms waiting for node "no-preload-182800" to be "Ready" ...
I0914 23:07:14.145529 13072 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 23:07:14.164127 13072 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0914 23:07:14.251886 13072 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-gl4fn" in "kube-system" namespace to be "Ready" ...
I0914 23:07:14.253136 13072 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0914 23:07:14.253136 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0914 23:07:14.441921 13072 addons.go:423] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0914 23:07:14.441921 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0914 23:07:14.559695 13072 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0914 23:07:14.559695 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0914 23:07:14.746471 13072 addons.go:423] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0914 23:07:14.746471 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0914 23:07:14.975476 13072 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0914 23:07:15.058039 13072 addons.go:423] installing /etc/kubernetes/addons/dashboard-role.yaml
I0914 23:07:15.058039 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0914 23:07:15.343865 13072 addons.go:423] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0914 23:07:15.343865 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0914 23:07:15.650074 13072 addons.go:423] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0914 23:07:15.650191 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0914 23:07:15.861074 13072 addons.go:423] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0914 23:07:15.861074 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0914 23:07:15.387635 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:15.880382 9136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:07:16.373147 9136 kubeadm.go:1081] duration metric: took 11.9766091s to wait for elevateKubeSystemPrivileges.
I0914 23:07:16.373227 9136 kubeadm.go:406] StartCluster complete in 5m23.794307s
I0914 23:07:16.373292 9136 settings.go:142] acquiring lock: {Name:mk5d8710830d010adb6db61f855b0ef766a8622c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 23:07:16.373467 9136 settings.go:150] Updating kubeconfig: C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0914 23:07:16.377499 9136 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 23:07:16.377499 9136 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0914 23:07:16.377499 9136 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]
I0914 23:07:16.377499 9136 addons.go:69] Setting storage-provisioner=true in profile "embed-certs-675900"
I0914 23:07:16.377499 9136 addons.go:231] Setting addon storage-provisioner=true in "embed-certs-675900"
W0914 23:07:16.377499 9136 addons.go:240] addon storage-provisioner should already be in state true
I0914 23:07:16.377499 9136 addons.go:69] Setting default-storageclass=true in profile "embed-certs-675900"
I0914 23:07:16.377499 9136 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-675900"
I0914 23:07:16.377499 9136 addons.go:69] Setting dashboard=true in profile "embed-certs-675900"
I0914 23:07:16.377499 9136 addons.go:231] Setting addon dashboard=true in "embed-certs-675900"
W0914 23:07:16.377499 9136 addons.go:240] addon dashboard should already be in state true
I0914 23:07:16.377499 9136 host.go:66] Checking if "embed-certs-675900" exists ...
I0914 23:07:16.377499 9136 config.go:182] Loaded profile config "embed-certs-675900": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.1
I0914 23:07:16.377499 9136 host.go:66] Checking if "embed-certs-675900" exists ...
I0914 23:07:16.377499 9136 addons.go:69] Setting metrics-server=true in profile "embed-certs-675900"
I0914 23:07:16.382550 9136 addons.go:231] Setting addon metrics-server=true in "embed-certs-675900"
W0914 23:07:16.382550 9136 addons.go:240] addon metrics-server should already be in state true
I0914 23:07:16.382857 9136 host.go:66] Checking if "embed-certs-675900" exists ...
I0914 23:07:16.402552 9136 cli_runner.go:164] Run: docker container inspect embed-certs-675900 --format={{.State.Status}}
I0914 23:07:16.411894 9136 cli_runner.go:164] Run: docker container inspect embed-certs-675900 --format={{.State.Status}}
I0914 23:07:16.412898 9136 cli_runner.go:164] Run: docker container inspect embed-certs-675900 --format={{.State.Status}}
I0914 23:07:16.413891 9136 cli_runner.go:164] Run: docker container inspect embed-certs-675900 --format={{.State.Status}}
I0914 23:07:16.579683 9136 kapi.go:248] "coredns" deployment in "kube-system" namespace and "embed-certs-675900" context rescaled to 1 replicas
I0914 23:07:16.579683 9136 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.28.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0914 23:07:16.579683 9136 out.go:177] * Verifying Kubernetes components...
I0914 23:07:16.594656 9136 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 23:07:16.663069 9136 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0914 23:07:16.664074 9136 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0914 23:07:16.665078 9136 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0914 23:07:16.665078 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0914 23:07:16.664074 9136 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0914 23:07:16.666088 9136 addons.go:423] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0914 23:07:16.666088 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0914 23:07:16.679076 9136 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0914 23:07:12.973545 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:15.471296 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:17.204943 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:19.709359 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:16.679076 9136 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0914 23:07:16.679076 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0914 23:07:16.680070 9136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-675900
I0914 23:07:16.681077 9136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-675900
I0914 23:07:16.692077 9136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-675900
I0914 23:07:16.744187 9136 addons.go:231] Setting addon default-storageclass=true in "embed-certs-675900"
W0914 23:07:16.744187 9136 addons.go:240] addon default-storageclass should already be in state true
I0914 23:07:16.744187 9136 host.go:66] Checking if "embed-certs-675900" exists ...
I0914 23:07:16.784871 9136 cli_runner.go:164] Run: docker container inspect embed-certs-675900 --format={{.State.Status}}
I0914 23:07:16.900924 9136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62166 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\embed-certs-675900\id_rsa Username:docker}
I0914 23:07:16.912921 9136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62166 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\embed-certs-675900\id_rsa Username:docker}
I0914 23:07:16.942934 9136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62166 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\embed-certs-675900\id_rsa Username:docker}
I0914 23:07:17.021057 9136 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
I0914 23:07:17.021129 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0914 23:07:17.032041 9136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-675900
I0914 23:07:17.238300 9136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62166 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\embed-certs-675900\id_rsa Username:docker}
I0914 23:07:17.447779 9136 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml": (1.0701914s)
I0914 23:07:17.448091 9136 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.254 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0914 23:07:17.467564 9136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" embed-certs-675900
I0914 23:07:17.655229 9136 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0914 23:07:17.655229 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0914 23:07:17.674217 9136 node_ready.go:35] waiting up to 6m0s for node "embed-certs-675900" to be "Ready" ...
I0914 23:07:17.847954 9136 addons.go:423] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0914 23:07:17.847954 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0914 23:07:17.866441 9136 node_ready.go:49] node "embed-certs-675900" has status "Ready":"True"
I0914 23:07:17.866441 9136 node_ready.go:38] duration metric: took 192.2142ms waiting for node "embed-certs-675900" to be "Ready" ...
I0914 23:07:17.866441 9136 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 23:07:17.881285 9136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0914 23:07:18.043865 9136 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0914 23:07:18.043865 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0914 23:07:18.067794 9136 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-4tzsl" in "kube-system" namespace to be "Ready" ...
I0914 23:07:18.083306 9136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0914 23:07:18.165749 9136 addons.go:423] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0914 23:07:18.165749 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0914 23:07:18.259161 9136 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0914 23:07:18.259161 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0914 23:07:18.563644 9136 addons.go:423] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0914 23:07:18.563738 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0914 23:07:18.675705 9136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0914 23:07:18.971974 9136 addons.go:423] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0914 23:07:18.972063 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0914 23:07:19.169266 9136 addons.go:423] installing /etc/kubernetes/addons/dashboard-role.yaml
I0914 23:07:19.169266 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0914 23:07:19.460481 9136 addons.go:423] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0914 23:07:19.460481 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0914 23:07:19.677735 9136 addons.go:423] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0914 23:07:19.677735 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0914 23:07:19.864027 9136 addons.go:423] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0914 23:07:19.864027 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0914 23:07:20.065049 9136 addons.go:423] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0914 23:07:20.065049 9136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0914 23:07:16.058472 13072 addons.go:423] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0914 23:07:16.058585 13072 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0914 23:07:16.267587 13072 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0914 23:07:16.645084 13072 pod_ready.go:102] pod "coredns-5dd5756b68-gl4fn" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:19.063276 13072 pod_ready.go:102] pod "coredns-5dd5756b68-gl4fn" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:19.477212 13072 pod_ready.go:92] pod "coredns-5dd5756b68-gl4fn" in "kube-system" namespace has status "Ready":"True"
I0914 23:07:19.477293 13072 pod_ready.go:81] duration metric: took 5.2251303s waiting for pod "coredns-5dd5756b68-gl4fn" in "kube-system" namespace to be "Ready" ...
I0914 23:07:19.477381 13072 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-q9qqb" in "kube-system" namespace to be "Ready" ...
I0914 23:07:19.484410 13072 pod_ready.go:97] error getting pod "coredns-5dd5756b68-q9qqb" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-q9qqb" not found
I0914 23:07:19.484410 13072 pod_ready.go:81] duration metric: took 7.0288ms waiting for pod "coredns-5dd5756b68-q9qqb" in "kube-system" namespace to be "Ready" ...
E0914 23:07:19.484957 13072 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-5dd5756b68-q9qqb" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-q9qqb" not found
I0914 23:07:19.484957 13072 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-182800" in "kube-system" namespace to be "Ready" ...
I0914 23:07:19.561496 13072 pod_ready.go:92] pod "etcd-no-preload-182800" in "kube-system" namespace has status "Ready":"True"
I0914 23:07:19.561496 13072 pod_ready.go:81] duration metric: took 76.5346ms waiting for pod "etcd-no-preload-182800" in "kube-system" namespace to be "Ready" ...
I0914 23:07:19.561496 13072 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-182800" in "kube-system" namespace to be "Ready" ...
I0914 23:07:19.669653 13072 pod_ready.go:92] pod "kube-apiserver-no-preload-182800" in "kube-system" namespace has status "Ready":"True"
I0914 23:07:19.669653 13072 pod_ready.go:81] duration metric: took 108.151ms waiting for pod "kube-apiserver-no-preload-182800" in "kube-system" namespace to be "Ready" ...
I0914 23:07:19.669653 13072 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-182800" in "kube-system" namespace to be "Ready" ...
I0914 23:07:19.755385 13072 pod_ready.go:92] pod "kube-controller-manager-no-preload-182800" in "kube-system" namespace has status "Ready":"True"
I0914 23:07:19.755385 13072 pod_ready.go:81] duration metric: took 85.728ms waiting for pod "kube-controller-manager-no-preload-182800" in "kube-system" namespace to be "Ready" ...
I0914 23:07:19.755385 13072 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-xrdl8" in "kube-system" namespace to be "Ready" ...
I0914 23:07:19.844907 13072 pod_ready.go:92] pod "kube-proxy-xrdl8" in "kube-system" namespace has status "Ready":"True"
I0914 23:07:19.844907 13072 pod_ready.go:81] duration metric: took 89.5166ms waiting for pod "kube-proxy-xrdl8" in "kube-system" namespace to be "Ready" ...
I0914 23:07:19.845043 13072 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-182800" in "kube-system" namespace to be "Ready" ...
I0914 23:07:20.070672 13072 pod_ready.go:92] pod "kube-scheduler-no-preload-182800" in "kube-system" namespace has status "Ready":"True"
I0914 23:07:20.070672 13072 pod_ready.go:81] duration metric: took 225.617ms waiting for pod "kube-scheduler-no-preload-182800" in "kube-system" namespace to be "Ready" ...
I0914 23:07:20.070672 13072 pod_ready.go:38] duration metric: took 5.9248292s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 23:07:20.071404 13072 api_server.go:52] waiting for apiserver process to appear ...
I0914 23:07:20.086839 13072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:07:20.755046 13072 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.1782984s)
I0914 23:07:20.755046 13072 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.254 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (7.0101939s)
I0914 23:07:20.755046 13072 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (6.5905699s)
I0914 23:07:20.755046 13072 start.go:917] {"host.minikube.internal": 192.168.65.254} host record injected into CoreDNS's ConfigMap
I0914 23:07:17.980364 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:20.475649 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:21.145440 13072 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (6.1696373s)
I0914 23:07:21.145440 13072 addons.go:467] Verifying addon metrics-server=true in "no-preload-182800"
I0914 23:07:23.645574 13072 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (7.377419s)
I0914 23:07:23.645574 13072 ssh_runner.go:235] Completed: sudo pgrep -xnf kube-apiserver.*minikube.*: (3.5585469s)
I0914 23:07:23.646743 13072 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-182800 addons enable metrics-server
I0914 23:07:23.645908 13072 api_server.go:72] duration metric: took 11.0885387s to wait for apiserver process to appear ...
I0914 23:07:23.648041 13072 api_server.go:88] waiting for apiserver healthz status ...
I0914 23:07:23.648041 13072 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62116/healthz ...
I0914 23:07:23.649152 13072 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
I0914 23:07:23.650334 13072 addons.go:502] enable addons completed in 11.3709606s: enabled=[storage-provisioner default-storageclass metrics-server dashboard]
I0914 23:07:23.674683 13072 api_server.go:279] https://127.0.0.1:62116/healthz returned 200:
ok
I0914 23:07:23.680607 13072 api_server.go:141] control plane version: v1.28.1
I0914 23:07:23.680607 13072 api_server.go:131] duration metric: took 32.5642ms to wait for apiserver health ...
I0914 23:07:23.680607 13072 system_pods.go:43] waiting for kube-system pods to appear ...
I0914 23:07:23.755999 13072 system_pods.go:59] 8 kube-system pods found
I0914 23:07:23.756089 13072 system_pods.go:61] "coredns-5dd5756b68-gl4fn" [278b0464-9959-4b5c-8e95-eed404377a8c] Running
I0914 23:07:23.756089 13072 system_pods.go:61] "etcd-no-preload-182800" [0ca0b012-f015-459c-b405-6e5764b7fa36] Running
I0914 23:07:23.756089 13072 system_pods.go:61] "kube-apiserver-no-preload-182800" [72dd2877-d57f-45a7-b05f-19fd2adfb229] Running
I0914 23:07:23.756151 13072 system_pods.go:61] "kube-controller-manager-no-preload-182800" [05a8aecf-31b9-4978-a58e-7bcf03ffa663] Running
I0914 23:07:23.756151 13072 system_pods.go:61] "kube-proxy-xrdl8" [fb6a2baa-0209-4b00-a01d-413bf529742e] Running
I0914 23:07:23.756151 13072 system_pods.go:61] "kube-scheduler-no-preload-182800" [0ee5248b-aea0-4f64-a7b4-ae59a307d716] Running
I0914 23:07:23.756210 13072 system_pods.go:61] "metrics-server-57f55c9bc5-gr9fl" [2ef438c6-b6b0-44ba-a667-fae96ef56185] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0914 23:07:23.756210 13072 system_pods.go:61] "storage-provisioner" [741fb17d-2b4d-4f06-b5f1-3d0daefe9a79] Running
I0914 23:07:23.756272 13072 system_pods.go:74] duration metric: took 75.5991ms to wait for pod list to return data ...
I0914 23:07:23.756272 13072 default_sa.go:34] waiting for default service account to be created ...
I0914 23:07:23.770063 13072 default_sa.go:45] found service account: "default"
I0914 23:07:23.770191 13072 default_sa.go:55] duration metric: took 13.8791ms for default service account to be created ...
I0914 23:07:23.770191 13072 system_pods.go:116] waiting for k8s-apps to be running ...
I0914 23:07:23.799604 13072 system_pods.go:86] 8 kube-system pods found
I0914 23:07:23.799683 13072 system_pods.go:89] "coredns-5dd5756b68-gl4fn" [278b0464-9959-4b5c-8e95-eed404377a8c] Running
I0914 23:07:23.799724 13072 system_pods.go:89] "etcd-no-preload-182800" [0ca0b012-f015-459c-b405-6e5764b7fa36] Running
I0914 23:07:23.799724 13072 system_pods.go:89] "kube-apiserver-no-preload-182800" [72dd2877-d57f-45a7-b05f-19fd2adfb229] Running
I0914 23:07:23.799724 13072 system_pods.go:89] "kube-controller-manager-no-preload-182800" [05a8aecf-31b9-4978-a58e-7bcf03ffa663] Running
I0914 23:07:23.799724 13072 system_pods.go:89] "kube-proxy-xrdl8" [fb6a2baa-0209-4b00-a01d-413bf529742e] Running
I0914 23:07:23.799724 13072 system_pods.go:89] "kube-scheduler-no-preload-182800" [0ee5248b-aea0-4f64-a7b4-ae59a307d716] Running
I0914 23:07:23.799792 13072 system_pods.go:89] "metrics-server-57f55c9bc5-gr9fl" [2ef438c6-b6b0-44ba-a667-fae96ef56185] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0914 23:07:23.799860 13072 system_pods.go:89] "storage-provisioner" [741fb17d-2b4d-4f06-b5f1-3d0daefe9a79] Running
I0914 23:07:23.799938 13072 system_pods.go:126] duration metric: took 29.7452ms to wait for k8s-apps to be running ...
I0914 23:07:23.799966 13072 system_svc.go:44] waiting for kubelet service to be running ....
I0914 23:07:23.813030 13072 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 23:07:23.883760 13072 system_svc.go:56] duration metric: took 83.7898ms WaitForService to wait for kubelet.
I0914 23:07:23.883760 13072 kubeadm.go:581] duration metric: took 11.3263781s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
I0914 23:07:23.883760 13072 node_conditions.go:102] verifying NodePressure condition ...
I0914 23:07:23.974393 13072 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki
I0914 23:07:23.974393 13072 node_conditions.go:123] node cpu capacity is 16
I0914 23:07:23.974393 13072 node_conditions.go:105] duration metric: took 90.6283ms to run NodePressure ...
I0914 23:07:23.974393 13072 start.go:228] waiting for startup goroutines ...
I0914 23:07:23.974393 13072 start.go:233] waiting for cluster config update ...
I0914 23:07:23.974393 13072 start.go:242] writing updated cluster config ...
I0914 23:07:23.996659 13072 ssh_runner.go:195] Run: rm -f paused
I0914 23:07:24.195000 13072 start.go:600] kubectl: 1.28.2, cluster: 1.28.1 (minor skew: 0)
I0914 23:07:24.196043 13072 out.go:177] * Done! kubectl is now configured to use "no-preload-182800" cluster and "default" namespace by default
I0914 23:07:22.210651 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:24.695132 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:20.291301 9136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0914 23:07:20.449489 9136 pod_ready.go:102] pod "coredns-5dd5756b68-4tzsl" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:22.460822 9136 pod_ready.go:102] pod "coredns-5dd5756b68-4tzsl" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:22.965114 9136 pod_ready.go:92] pod "coredns-5dd5756b68-4tzsl" in "kube-system" namespace has status "Ready":"True"
I0914 23:07:22.965114 9136 pod_ready.go:81] duration metric: took 4.8970617s waiting for pod "coredns-5dd5756b68-4tzsl" in "kube-system" namespace to be "Ready" ...
I0914 23:07:22.965114 9136 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-crtqn" in "kube-system" namespace to be "Ready" ...
I0914 23:07:22.974118 9136 pod_ready.go:97] error getting pod "coredns-5dd5756b68-crtqn" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-crtqn" not found
I0914 23:07:22.974118 9136 pod_ready.go:81] duration metric: took 9.0036ms waiting for pod "coredns-5dd5756b68-crtqn" in "kube-system" namespace to be "Ready" ...
E0914 23:07:22.974118 9136 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-5dd5756b68-crtqn" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-crtqn" not found
I0914 23:07:22.974118 9136 pod_ready.go:78] waiting up to 6m0s for pod "etcd-embed-certs-675900" in "kube-system" namespace to be "Ready" ...
I0914 23:07:23.045126 9136 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.254 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (5.5965724s)
I0914 23:07:23.045205 9136 start.go:917] {"host.minikube.internal": 192.168.65.254} host record injected into CoreDNS's ConfigMap
I0914 23:07:23.074925 9136 pod_ready.go:92] pod "etcd-embed-certs-675900" in "kube-system" namespace has status "Ready":"True"
I0914 23:07:23.075094 9136 pod_ready.go:81] duration metric: took 100.9702ms waiting for pod "etcd-embed-certs-675900" in "kube-system" namespace to be "Ready" ...
I0914 23:07:23.075094 9136 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-embed-certs-675900" in "kube-system" namespace to be "Ready" ...
I0914 23:07:23.149404 9136 pod_ready.go:92] pod "kube-apiserver-embed-certs-675900" in "kube-system" namespace has status "Ready":"True"
I0914 23:07:23.149625 9136 pod_ready.go:81] duration metric: took 74.527ms waiting for pod "kube-apiserver-embed-certs-675900" in "kube-system" namespace to be "Ready" ...
I0914 23:07:23.149625 9136 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-embed-certs-675900" in "kube-system" namespace to be "Ready" ...
I0914 23:07:23.170896 9136 pod_ready.go:92] pod "kube-controller-manager-embed-certs-675900" in "kube-system" namespace has status "Ready":"True"
I0914 23:07:23.170896 9136 pod_ready.go:81] duration metric: took 21.2696ms waiting for pod "kube-controller-manager-embed-certs-675900" in "kube-system" namespace to be "Ready" ...
I0914 23:07:23.170896 9136 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-brjms" in "kube-system" namespace to be "Ready" ...
I0914 23:07:23.257477 9136 pod_ready.go:92] pod "kube-proxy-brjms" in "kube-system" namespace has status "Ready":"True"
I0914 23:07:23.258056 9136 pod_ready.go:81] duration metric: took 87.1554ms waiting for pod "kube-proxy-brjms" in "kube-system" namespace to be "Ready" ...
I0914 23:07:23.258056 9136 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-embed-certs-675900" in "kube-system" namespace to be "Ready" ...
I0914 23:07:23.546601 9136 pod_ready.go:92] pod "kube-scheduler-embed-certs-675900" in "kube-system" namespace has status "Ready":"True"
I0914 23:07:23.546601 9136 pod_ready.go:81] duration metric: took 288.5299ms waiting for pod "kube-scheduler-embed-certs-675900" in "kube-system" namespace to be "Ready" ...
I0914 23:07:23.546601 9136 pod_ready.go:38] duration metric: took 5.6798591s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 23:07:23.546601 9136 api_server.go:52] waiting for apiserver process to appear ...
I0914 23:07:23.574454 9136 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 23:07:24.459713 9136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (6.3760697s)
I0914 23:07:24.459713 9136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (6.5780803s)
I0914 23:07:24.765295 9136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (6.0892686s)
I0914 23:07:24.765295 9136 addons.go:467] Verifying addon metrics-server=true in "embed-certs-675900"
I0914 23:07:27.283636 9136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (6.9919653s)
I0914 23:07:27.284660 9136 ssh_runner.go:235] Completed: sudo pgrep -xnf kube-apiserver.*minikube.*: (3.7100104s)
I0914 23:07:27.284660 9136 api_server.go:72] duration metric: took 10.7044112s to wait for apiserver process to appear ...
I0914 23:07:27.284660 9136 api_server.go:88] waiting for apiserver healthz status ...
I0914 23:07:27.284660 9136 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p embed-certs-675900 addons enable metrics-server
I0914 23:07:27.284660 9136 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:62170/healthz ...
I0914 23:07:27.286637 9136 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
I0914 23:07:22.971111 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:25.465969 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:27.288635 9136 addons.go:502] enable addons completed in 10.9105586s: enabled=[default-storageclass storage-provisioner metrics-server dashboard]
I0914 23:07:27.354661 9136 api_server.go:279] https://127.0.0.1:62170/healthz returned 200:
ok
I0914 23:07:27.362664 9136 api_server.go:141] control plane version: v1.28.1
I0914 23:07:27.362664 9136 api_server.go:131] duration metric: took 77.9997ms to wait for apiserver health ...
I0914 23:07:27.362664 9136 system_pods.go:43] waiting for kube-system pods to appear ...
I0914 23:07:27.467675 9136 system_pods.go:59] 8 kube-system pods found
I0914 23:07:27.467675 9136 system_pods.go:61] "coredns-5dd5756b68-4tzsl" [878d20da-58a0-4b82-879f-fc4f2df2edcc] Running
I0914 23:07:27.467675 9136 system_pods.go:61] "etcd-embed-certs-675900" [44ecbb40-098d-4d56-964e-e1aa3d45478b] Running
I0914 23:07:27.467675 9136 system_pods.go:61] "kube-apiserver-embed-certs-675900" [9e1c784c-fbbd-4f60-a441-055388aa9de6] Running
I0914 23:07:27.467675 9136 system_pods.go:61] "kube-controller-manager-embed-certs-675900" [5d0408f9-ff50-40ef-bc56-0ef5c50f86a2] Running
I0914 23:07:27.467675 9136 system_pods.go:61] "kube-proxy-brjms" [8659287d-ed77-4df8-ab19-55be12094a0c] Running
I0914 23:07:27.467675 9136 system_pods.go:61] "kube-scheduler-embed-certs-675900" [9ab297ea-2299-433e-a93d-cf0b53a80104] Running
I0914 23:07:27.467675 9136 system_pods.go:61] "metrics-server-57f55c9bc5-rt8dj" [7765ff0d-6894-4f62-beb3-6b5f7095dedc] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0914 23:07:27.467675 9136 system_pods.go:61] "storage-provisioner" [f0c7a8b2-a29c-4746-a788-353488817f03] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0914 23:07:27.467675 9136 system_pods.go:74] duration metric: took 105.0056ms to wait for pod list to return data ...
I0914 23:07:27.467675 9136 default_sa.go:34] waiting for default service account to be created ...
I0914 23:07:27.546694 9136 default_sa.go:45] found service account: "default"
I0914 23:07:27.546694 9136 default_sa.go:55] duration metric: took 79.0151ms for default service account to be created ...
I0914 23:07:27.546694 9136 system_pods.go:116] waiting for k8s-apps to be running ...
I0914 23:07:27.564679 9136 system_pods.go:86] 8 kube-system pods found
I0914 23:07:27.564679 9136 system_pods.go:89] "coredns-5dd5756b68-4tzsl" [878d20da-58a0-4b82-879f-fc4f2df2edcc] Running
I0914 23:07:27.564679 9136 system_pods.go:89] "etcd-embed-certs-675900" [44ecbb40-098d-4d56-964e-e1aa3d45478b] Running
I0914 23:07:27.564679 9136 system_pods.go:89] "kube-apiserver-embed-certs-675900" [9e1c784c-fbbd-4f60-a441-055388aa9de6] Running
I0914 23:07:27.564679 9136 system_pods.go:89] "kube-controller-manager-embed-certs-675900" [5d0408f9-ff50-40ef-bc56-0ef5c50f86a2] Running
I0914 23:07:27.564679 9136 system_pods.go:89] "kube-proxy-brjms" [8659287d-ed77-4df8-ab19-55be12094a0c] Running
I0914 23:07:27.564679 9136 system_pods.go:89] "kube-scheduler-embed-certs-675900" [9ab297ea-2299-433e-a93d-cf0b53a80104] Running
I0914 23:07:27.564679 9136 system_pods.go:89] "metrics-server-57f55c9bc5-rt8dj" [7765ff0d-6894-4f62-beb3-6b5f7095dedc] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0914 23:07:27.565672 9136 system_pods.go:89] "storage-provisioner" [f0c7a8b2-a29c-4746-a788-353488817f03] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0914 23:07:27.565672 9136 system_pods.go:126] duration metric: took 18.9768ms to wait for k8s-apps to be running ...
I0914 23:07:27.565672 9136 system_svc.go:44] waiting for kubelet service to be running ....
I0914 23:07:27.588661 9136 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 23:07:27.767690 9136 system_svc.go:56] duration metric: took 202.0068ms WaitForService to wait for kubelet.
I0914 23:07:27.767690 9136 kubeadm.go:581] duration metric: took 11.1874152s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
I0914 23:07:27.767690 9136 node_conditions.go:102] verifying NodePressure condition ...
I0914 23:07:27.776672 9136 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki
I0914 23:07:27.776672 9136 node_conditions.go:123] node cpu capacity is 16
I0914 23:07:27.776672 9136 node_conditions.go:105] duration metric: took 8.9821ms to run NodePressure ...
I0914 23:07:27.777717 9136 start.go:228] waiting for startup goroutines ...
I0914 23:07:27.777717 9136 start.go:233] waiting for cluster config update ...
I0914 23:07:27.777717 9136 start.go:242] writing updated cluster config ...
I0914 23:07:27.793666 9136 ssh_runner.go:195] Run: rm -f paused
I0914 23:07:28.035253 9136 start.go:600] kubectl: 1.28.2, cluster: 1.28.1 (minor skew: 0)
I0914 23:07:28.036262 9136 out.go:177] * Done! kubectl is now configured to use "embed-certs-675900" cluster and "default" namespace by default
I0914 23:07:26.698404 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:28.706798 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:27.469664 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:29.484845 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:31.977053 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:30.713060 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:33.208295 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:34.471515 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:36.974648 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:35.698858 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:37.707870 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:39.471435 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:41.973145 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:40.208730 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:42.705134 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:43.977214 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:46.466313 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:45.196437 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:47.208389 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:49.393124 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:48.472833 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:50.479323 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:51.700366 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:53.704017 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:52.977185 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:55.473683 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:55.711697 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:58.217149 6016 pod_ready.go:102] pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:57.476486 12004 pod_ready.go:102] pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace has status "Ready":"False"
I0914 23:07:59.643851 12004 pod_ready.go:81] duration metric: took 4m0.004806s waiting for pod "metrics-server-74d5856cc6-558tg" in "kube-system" namespace to be "Ready" ...
E0914 23:07:59.643851 12004 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0914 23:07:59.643851 12004 pod_ready.go:38] duration metric: took 4m1.1832148s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 23:07:59.643851 12004 kubeadm.go:640] restartCluster took 5m21.2721141s
W0914 23:07:59.643851 12004 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
I0914 23:07:59.644840 12004 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0914 23:07:59.880860 6016 pod_ready.go:81] duration metric: took 4m0.0060673s waiting for pod "metrics-server-57f55c9bc5-v4l49" in "kube-system" namespace to be "Ready" ...
E0914 23:07:59.880860 6016 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0914 23:07:59.880860 6016 pod_ready.go:38] duration metric: took 4m10.6213989s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 23:07:59.880860 6016 kubeadm.go:640] restartCluster took 4m37.8431761s
W0914 23:07:59.880860 6016 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
I0914 23:07:59.881910 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force"
I0914 23:08:09.366297 12004 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force": (9.7209436s)
I0914 23:08:09.385268 12004 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 23:08:09.436632 12004 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0914 23:08:09.467028 12004 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I0914 23:08:09.487032 12004 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0914 23:08:09.510760 12004 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0914 23:08:09.510760 12004 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0914 23:08:09.896501 12004 kubeadm.go:322] [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
I0914 23:08:09.898500 12004 kubeadm.go:322] [WARNING Swap]: running with swap on is not supported. Please disable swap
I0914 23:08:10.010378 12004 kubeadm.go:322] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.6. Latest validated version: 18.09
I0914 23:08:10.210007 12004 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0914 23:08:19.589296 6016 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force": (19.7063438s)
I0914 23:08:19.606301 6016 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 23:08:19.649988 6016 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0914 23:08:19.678234 6016 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I0914 23:08:19.697222 6016 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0914 23:08:19.717224 6016 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0914 23:08:19.717224 6016 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0914 23:08:19.918812 6016 kubeadm.go:322] [WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet
I0914 23:08:20.105773 6016 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0914 23:08:28.685842 12004 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0914 23:08:28.685842 12004 kubeadm.go:322] [preflight] Running pre-flight checks
I0914 23:08:28.685842 12004 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0914 23:08:28.686957 12004 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0914 23:08:28.687313 12004 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0914 23:08:28.687578 12004 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0914 23:08:28.687828 12004 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0914 23:08:28.687945 12004 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0914 23:08:28.688135 12004 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0914 23:08:28.688897 12004 out.go:204] - Generating certificates and keys ...
I0914 23:08:28.689292 12004 kubeadm.go:322] [certs] Using existing ca certificate authority
I0914 23:08:28.689292 12004 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0914 23:08:28.689292 12004 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0914 23:08:28.689292 12004 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0914 23:08:28.689828 12004 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0914 23:08:28.690020 12004 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0914 23:08:28.690241 12004 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0914 23:08:28.690437 12004 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0914 23:08:28.690567 12004 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0914 23:08:28.690567 12004 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0914 23:08:28.690567 12004 kubeadm.go:322] [certs] Using the existing "sa" key
I0914 23:08:28.690567 12004 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0914 23:08:28.691319 12004 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0914 23:08:28.691538 12004 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0914 23:08:28.691678 12004 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0914 23:08:28.691804 12004 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0914 23:08:28.691945 12004 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0914 23:08:28.692586 12004 out.go:204] - Booting up control plane ...
I0914 23:08:28.693149 12004 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0914 23:08:28.693429 12004 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0914 23:08:28.693666 12004 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0914 23:08:28.693883 12004 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0914 23:08:28.694383 12004 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0914 23:08:28.694668 12004 kubeadm.go:322] [apiclient] All control plane components are healthy after 15.004725 seconds
I0914 23:08:28.695201 12004 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0914 23:08:28.695715 12004 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config-1.16" in namespace kube-system with the configuration for the kubelets in the cluster
I0914 23:08:28.695715 12004 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
I0914 23:08:28.695715 12004 kubeadm.go:322] [mark-control-plane] Marking the node old-k8s-version-113800 as control-plane by adding the label "node-role.kubernetes.io/master=''"
I0914 23:08:28.696254 12004 kubeadm.go:322] [bootstrap-token] Using token: 4o6taa.rk69sf4lfjzohcfk
I0914 23:08:28.696553 12004 out.go:204] - Configuring RBAC rules ...
I0914 23:08:28.696553 12004 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0914 23:08:28.697261 12004 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0914 23:08:28.697336 12004 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0914 23:08:28.697336 12004 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0914 23:08:28.697336 12004 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0914 23:08:28.698010 12004 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
I0914 23:08:28.698239 12004 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
I0914 23:08:28.698309 12004 kubeadm.go:322]
I0914 23:08:28.698309 12004 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
I0914 23:08:28.698309 12004 kubeadm.go:322]
I0914 23:08:28.698309 12004 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
I0914 23:08:28.698309 12004 kubeadm.go:322]
I0914 23:08:28.698309 12004 kubeadm.go:322] mkdir -p $HOME/.kube
I0914 23:08:28.698850 12004 kubeadm.go:322] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0914 23:08:28.698915 12004 kubeadm.go:322] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0914 23:08:28.698915 12004 kubeadm.go:322]
I0914 23:08:28.699161 12004 kubeadm.go:322] You should now deploy a pod network to the cluster.
I0914 23:08:28.699369 12004 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0914 23:08:28.699571 12004 kubeadm.go:322] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0914 23:08:28.699571 12004 kubeadm.go:322]
I0914 23:08:28.699836 12004 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
I0914 23:08:28.700172 12004 kubeadm.go:322] and service account keys on each node and then running the following as root:
I0914 23:08:28.700172 12004 kubeadm.go:322]
I0914 23:08:28.700172 12004 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 4o6taa.rk69sf4lfjzohcfk \
I0914 23:08:28.700722 12004 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:32b4d7e85e22242a9dda455612f2c711aed2ef170d515f82ac1bb228ecce4fa2 \
I0914 23:08:28.700867 12004 kubeadm.go:322] --control-plane
I0914 23:08:28.700867 12004 kubeadm.go:322]
I0914 23:08:28.700923 12004 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
I0914 23:08:28.700923 12004 kubeadm.go:322]
I0914 23:08:28.700923 12004 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 4o6taa.rk69sf4lfjzohcfk \
I0914 23:08:28.701473 12004 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:32b4d7e85e22242a9dda455612f2c711aed2ef170d515f82ac1bb228ecce4fa2
I0914 23:08:28.701557 12004 cni.go:84] Creating CNI manager for ""
I0914 23:08:28.701639 12004 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0914 23:08:28.701639 12004 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0914 23:08:28.717819 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl label nodes minikube.k8s.io/version=v1.31.2 minikube.k8s.io/commit=d7492f2ae2d9b6e62b385ffcd97ebad62c645e82 minikube.k8s.io/name=old-k8s-version-113800 minikube.k8s.io/updated_at=2023_09_14T23_08_28_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:28.719222 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:28.763596 12004 ops.go:34] apiserver oom_adj: -16
I0914 23:08:29.386884 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:29.795090 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:30.681583 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:31.170101 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:31.675607 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:32.178090 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:37.185198 6016 kubeadm.go:322] [init] Using Kubernetes version: v1.28.1
I0914 23:08:37.185198 6016 kubeadm.go:322] [preflight] Running pre-flight checks
I0914 23:08:37.185198 6016 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0914 23:08:37.185198 6016 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0914 23:08:37.186192 6016 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0914 23:08:37.186192 6016 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0914 23:08:37.187178 6016 out.go:204] - Generating certificates and keys ...
I0914 23:08:37.187178 6016 kubeadm.go:322] [certs] Using existing ca certificate authority
I0914 23:08:37.187178 6016 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0914 23:08:37.187178 6016 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0914 23:08:37.188186 6016 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0914 23:08:37.188186 6016 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0914 23:08:37.188186 6016 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0914 23:08:37.188186 6016 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0914 23:08:37.188186 6016 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0914 23:08:37.188186 6016 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0914 23:08:37.189186 6016 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0914 23:08:37.189186 6016 kubeadm.go:322] [certs] Using the existing "sa" key
I0914 23:08:37.189186 6016 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0914 23:08:37.189186 6016 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0914 23:08:37.189186 6016 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0914 23:08:37.189186 6016 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0914 23:08:37.190182 6016 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0914 23:08:37.190182 6016 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0914 23:08:37.190182 6016 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0914 23:08:37.191190 6016 out.go:204] - Booting up control plane ...
I0914 23:08:37.191190 6016 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0914 23:08:37.191190 6016 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0914 23:08:37.191190 6016 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0914 23:08:37.192183 6016 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0914 23:08:37.192183 6016 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0914 23:08:37.192183 6016 kubeadm.go:322] [kubelet-start] Starting the kubelet
I0914 23:08:37.193186 6016 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0914 23:08:37.193186 6016 kubeadm.go:322] [apiclient] All control plane components are healthy after 13.006502 seconds
I0914 23:08:37.193186 6016 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0914 23:08:37.193186 6016 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0914 23:08:37.194185 6016 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
I0914 23:08:37.194185 6016 kubeadm.go:322] [mark-control-plane] Marking the node default-k8s-diff-port-645100 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0914 23:08:37.194185 6016 kubeadm.go:322] [bootstrap-token] Using token: mp9mmh.zshiiqhzi7m4ytkv
I0914 23:08:37.195178 6016 out.go:204] - Configuring RBAC rules ...
I0914 23:08:37.195178 6016 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0914 23:08:37.195178 6016 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0914 23:08:37.196175 6016 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0914 23:08:37.196175 6016 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0914 23:08:37.197188 6016 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0914 23:08:37.197188 6016 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0914 23:08:37.197188 6016 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0914 23:08:37.197188 6016 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
I0914 23:08:37.197188 6016 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
I0914 23:08:37.197188 6016 kubeadm.go:322]
I0914 23:08:37.198188 6016 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
I0914 23:08:37.198188 6016 kubeadm.go:322]
I0914 23:08:37.198188 6016 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
I0914 23:08:37.198188 6016 kubeadm.go:322]
I0914 23:08:37.198188 6016 kubeadm.go:322] mkdir -p $HOME/.kube
I0914 23:08:37.198188 6016 kubeadm.go:322] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0914 23:08:37.198188 6016 kubeadm.go:322] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0914 23:08:37.198188 6016 kubeadm.go:322]
I0914 23:08:37.199205 6016 kubeadm.go:322] Alternatively, if you are the root user, you can run:
I0914 23:08:37.199205 6016 kubeadm.go:322]
I0914 23:08:37.199205 6016 kubeadm.go:322] export KUBECONFIG=/etc/kubernetes/admin.conf
I0914 23:08:37.199205 6016 kubeadm.go:322]
I0914 23:08:37.199205 6016 kubeadm.go:322] You should now deploy a pod network to the cluster.
I0914 23:08:37.199205 6016 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0914 23:08:37.199205 6016 kubeadm.go:322] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0914 23:08:37.199205 6016 kubeadm.go:322]
I0914 23:08:37.200179 6016 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
I0914 23:08:37.200179 6016 kubeadm.go:322] and service account keys on each node and then running the following as root:
I0914 23:08:37.200179 6016 kubeadm.go:322]
I0914 23:08:37.200179 6016 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8444 --token mp9mmh.zshiiqhzi7m4ytkv \
I0914 23:08:37.200179 6016 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:32b4d7e85e22242a9dda455612f2c711aed2ef170d515f82ac1bb228ecce4fa2 \
I0914 23:08:37.200179 6016 kubeadm.go:322] --control-plane
I0914 23:08:37.200179 6016 kubeadm.go:322]
I0914 23:08:37.201173 6016 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
I0914 23:08:37.201173 6016 kubeadm.go:322]
I0914 23:08:37.201173 6016 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8444 --token mp9mmh.zshiiqhzi7m4ytkv \
I0914 23:08:37.201173 6016 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:32b4d7e85e22242a9dda455612f2c711aed2ef170d515f82ac1bb228ecce4fa2
I0914 23:08:37.201173 6016 cni.go:84] Creating CNI manager for ""
I0914 23:08:37.201173 6016 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0914 23:08:37.202176 6016 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0914 23:08:32.681366 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:33.188432 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:33.691512 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:34.185151 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:34.681097 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:35.173756 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:35.674328 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:36.181579 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:36.682555 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:37.190182 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:37.215200 6016 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0914 23:08:37.270070 6016 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0914 23:08:37.454165 6016 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0914 23:08:37.474163 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:37.476163 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl label nodes minikube.k8s.io/version=v1.31.2 minikube.k8s.io/commit=d7492f2ae2d9b6e62b385ffcd97ebad62c645e82 minikube.k8s.io/name=default-k8s-diff-port-645100 minikube.k8s.io/updated_at=2023_09_14T23_08_37_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:37.653438 6016 ops.go:34] apiserver oom_adj: -16
I0914 23:08:38.280313 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:38.898490 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:37.679238 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:38.183664 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:38.686729 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:39.186509 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:39.672241 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:40.170945 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:40.674962 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:41.173864 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:41.672077 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:42.188694 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:39.795417 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:40.292751 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:40.797198 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:41.297156 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:41.798031 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:42.296713 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:42.802780 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:43.294878 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:43.805720 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:44.310061 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:42.681777 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:43.190391 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:43.673707 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:44.189059 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:44.688569 12004 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:45.571775 12004 kubeadm.go:1081] duration metric: took 16.8691605s to wait for elevateKubeSystemPrivileges.
I0914 23:08:45.573768 12004 kubeadm.go:406] StartCluster complete in 6m7.3030059s
I0914 23:08:45.573768 12004 settings.go:142] acquiring lock: {Name:mk5d8710830d010adb6db61f855b0ef766a8622c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 23:08:45.574765 12004 settings.go:150] Updating kubeconfig: C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0914 23:08:45.577780 12004 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 23:08:45.579764 12004 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0914 23:08:45.579764 12004 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]
I0914 23:08:45.579764 12004 addons.go:69] Setting dashboard=true in profile "old-k8s-version-113800"
I0914 23:08:45.579764 12004 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-113800"
I0914 23:08:45.579764 12004 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-113800"
I0914 23:08:45.579764 12004 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-113800"
I0914 23:08:45.579764 12004 addons.go:231] Setting addon dashboard=true in "old-k8s-version-113800"
I0914 23:08:45.579764 12004 addons.go:231] Setting addon storage-provisioner=true in "old-k8s-version-113800"
W0914 23:08:45.579764 12004 addons.go:240] addon storage-provisioner should already be in state true
I0914 23:08:45.579764 12004 addons.go:231] Setting addon metrics-server=true in "old-k8s-version-113800"
W0914 23:08:45.579764 12004 addons.go:240] addon metrics-server should already be in state true
I0914 23:08:45.579764 12004 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-113800"
I0914 23:08:45.579764 12004 host.go:66] Checking if "old-k8s-version-113800" exists ...
I0914 23:08:45.579764 12004 host.go:66] Checking if "old-k8s-version-113800" exists ...
W0914 23:08:45.579764 12004 addons.go:240] addon dashboard should already be in state true
I0914 23:08:45.579764 12004 config.go:182] Loaded profile config "old-k8s-version-113800": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0914 23:08:45.580765 12004 host.go:66] Checking if "old-k8s-version-113800" exists ...
I0914 23:08:45.620777 12004 cli_runner.go:164] Run: docker container inspect old-k8s-version-113800 --format={{.State.Status}}
I0914 23:08:45.622777 12004 cli_runner.go:164] Run: docker container inspect old-k8s-version-113800 --format={{.State.Status}}
I0914 23:08:45.622777 12004 cli_runner.go:164] Run: docker container inspect old-k8s-version-113800 --format={{.State.Status}}
I0914 23:08:45.622777 12004 cli_runner.go:164] Run: docker container inspect old-k8s-version-113800 --format={{.State.Status}}
I0914 23:08:45.854802 12004 kapi.go:248] "coredns" deployment in "kube-system" namespace and "old-k8s-version-113800" context rescaled to 1 replicas
I0914 23:08:45.854802 12004 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0914 23:08:45.855805 12004 out.go:177] * Verifying Kubernetes components...
I0914 23:08:45.880518 12004 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0914 23:08:45.881509 12004 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0914 23:08:45.882498 12004 addons.go:423] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0914 23:08:45.882498 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0914 23:08:45.884496 12004 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 23:08:45.893509 12004 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0914 23:08:45.894495 12004 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0914 23:08:45.894495 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0914 23:08:45.898518 12004 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-113800
I0914 23:08:45.909497 12004 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0914 23:08:45.910499 12004 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0914 23:08:45.910499 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0914 23:08:45.911506 12004 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-113800
I0914 23:08:45.921513 12004 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-113800
I0914 23:08:46.147958 12004 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62198 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-113800\id_rsa Username:docker}
I0914 23:08:46.148937 12004 addons.go:231] Setting addon default-storageclass=true in "old-k8s-version-113800"
W0914 23:08:46.148937 12004 addons.go:240] addon default-storageclass should already be in state true
I0914 23:08:46.148937 12004 host.go:66] Checking if "old-k8s-version-113800" exists ...
I0914 23:08:46.178940 12004 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62198 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-113800\id_rsa Username:docker}
I0914 23:08:46.186934 12004 cli_runner.go:164] Run: docker container inspect old-k8s-version-113800 --format={{.State.Status}}
I0914 23:08:46.194971 12004 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62198 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-113800\id_rsa Username:docker}
I0914 23:08:46.432820 12004 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
I0914 23:08:46.432820 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0914 23:08:46.442820 12004 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-113800
I0914 23:08:46.555385 12004 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.254 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0914 23:08:46.581381 12004 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-113800
I0914 23:08:46.685674 12004 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62198 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-113800\id_rsa Username:docker}
I0914 23:08:46.758986 12004 addons.go:423] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0914 23:08:46.758986 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0914 23:08:46.809965 12004 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-113800" to be "Ready" ...
I0914 23:08:46.954226 12004 node_ready.go:49] node "old-k8s-version-113800" has status "Ready":"True"
I0914 23:08:46.954226 12004 node_ready.go:38] duration metric: took 144.2532ms waiting for node "old-k8s-version-113800" to be "Ready" ...
I0914 23:08:46.954226 12004 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 23:08:47.054635 12004 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5644d7b6d9-6pdxt" in "kube-system" namespace to be "Ready" ...
I0914 23:08:47.074542 12004 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0914 23:08:47.074542 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0914 23:08:47.094539 12004 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0914 23:08:47.175444 12004 addons.go:423] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0914 23:08:47.175444 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0914 23:08:44.810695 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:45.312215 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:45.800798 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:46.312824 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:46.798963 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:47.291208 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:47.802399 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:48.304928 6016 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 23:08:49.348226 6016 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.28.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (1.0432424s)
I0914 23:08:49.348226 6016 kubeadm.go:1081] duration metric: took 11.8934323s to wait for elevateKubeSystemPrivileges.
I0914 23:08:49.348226 6016 kubeadm.go:406] StartCluster complete in 5m27.4009687s
I0914 23:08:49.348226 6016 settings.go:142] acquiring lock: {Name:mk5d8710830d010adb6db61f855b0ef766a8622c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 23:08:49.348226 6016 settings.go:150] Updating kubeconfig: C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0914 23:08:49.353232 6016 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 23:08:49.355236 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0914 23:08:49.355236 6016 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]
I0914 23:08:49.355236 6016 addons.go:69] Setting storage-provisioner=true in profile "default-k8s-diff-port-645100"
I0914 23:08:49.355236 6016 addons.go:231] Setting addon storage-provisioner=true in "default-k8s-diff-port-645100"
W0914 23:08:49.355236 6016 addons.go:240] addon storage-provisioner should already be in state true
I0914 23:08:49.355236 6016 addons.go:69] Setting dashboard=true in profile "default-k8s-diff-port-645100"
I0914 23:08:49.355236 6016 addons.go:231] Setting addon dashboard=true in "default-k8s-diff-port-645100"
W0914 23:08:49.355236 6016 addons.go:240] addon dashboard should already be in state true
I0914 23:08:49.355236 6016 host.go:66] Checking if "default-k8s-diff-port-645100" exists ...
I0914 23:08:49.355236 6016 host.go:66] Checking if "default-k8s-diff-port-645100" exists ...
I0914 23:08:49.356237 6016 config.go:182] Loaded profile config "default-k8s-diff-port-645100": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.1
I0914 23:08:49.356237 6016 addons.go:69] Setting metrics-server=true in profile "default-k8s-diff-port-645100"
I0914 23:08:49.356237 6016 addons.go:231] Setting addon metrics-server=true in "default-k8s-diff-port-645100"
I0914 23:08:49.355236 6016 addons.go:69] Setting default-storageclass=true in profile "default-k8s-diff-port-645100"
I0914 23:08:49.356237 6016 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-diff-port-645100"
W0914 23:08:49.356237 6016 addons.go:240] addon metrics-server should already be in state true
I0914 23:08:49.356237 6016 host.go:66] Checking if "default-k8s-diff-port-645100" exists ...
I0914 23:08:49.395240 6016 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-645100 --format={{.State.Status}}
I0914 23:08:49.395240 6016 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-645100 --format={{.State.Status}}
I0914 23:08:49.399339 6016 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-645100 --format={{.State.Status}}
I0914 23:08:49.402240 6016 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-645100 --format={{.State.Status}}
I0914 23:08:49.653985 6016 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0914 23:08:49.652982 6016 kapi.go:248] "coredns" deployment in "kube-system" namespace and "default-k8s-diff-port-645100" context rescaled to 1 replicas
I0914 23:08:49.654979 6016 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.103.2 Port:8444 KubernetesVersion:v1.28.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0914 23:08:49.655958 6016 out.go:177] * Verifying Kubernetes components...
I0914 23:08:49.654979 6016 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0914 23:08:49.656979 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0914 23:08:49.676974 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:08:49.681966 6016 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 23:08:49.687970 6016 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0914 23:08:49.688972 6016 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0914 23:08:49.688972 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0914 23:08:49.698965 6016 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0914 23:08:49.699966 6016 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0914 23:08:49.699966 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:08:49.700959 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0914 23:08:49.700959 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0914 23:08:49.711983 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:08:47.357531 12004 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0914 23:08:47.357531 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0914 23:08:47.451320 12004 addons.go:423] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0914 23:08:47.451320 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0914 23:08:47.584258 12004 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0914 23:08:47.666174 12004 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0914 23:08:47.666174 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0914 23:08:47.671194 12004 addons.go:423] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0914 23:08:47.671194 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0914 23:08:48.061756 12004 addons.go:423] installing /etc/kubernetes/addons/dashboard-role.yaml
I0914 23:08:48.061756 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0914 23:08:48.088727 12004 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0914 23:08:48.368509 12004 addons.go:423] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0914 23:08:48.368655 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0914 23:08:48.853282 12004 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.254 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.2977753s)
I0914 23:08:48.853412 12004 start.go:917] {"host.minikube.internal": 192.168.65.254} host record injected into CoreDNS's ConfigMap
I0914 23:08:49.053842 12004 addons.go:423] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0914 23:08:49.053842 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0914 23:08:49.353232 12004 pod_ready.go:102] pod "coredns-5644d7b6d9-6pdxt" in "kube-system" namespace has status "Ready":"False"
I0914 23:08:49.675979 12004 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.5813041s)
I0914 23:08:49.675979 12004 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.0916106s)
I0914 23:08:49.766597 12004 addons.go:423] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0914 23:08:49.766597 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0914 23:08:49.991190 12004 addons.go:423] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0914 23:08:49.991730 12004 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0914 23:08:50.181656 12004 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0914 23:08:49.889589 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:08:49.920616 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:08:49.935582 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:08:50.067426 6016 addons.go:231] Setting addon default-storageclass=true in "default-k8s-diff-port-645100"
W0914 23:08:50.067426 6016 addons.go:240] addon default-storageclass should already be in state true
I0914 23:08:50.067426 6016 host.go:66] Checking if "default-k8s-diff-port-645100" exists ...
I0914 23:08:50.097403 6016 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-645100 --format={{.State.Status}}
I0914 23:08:50.170649 6016 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.254 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0914 23:08:50.185654 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8444/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:08:50.314585 6016 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
I0914 23:08:50.314585 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0914 23:08:50.323586 6016 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-645100
I0914 23:08:50.394584 6016 node_ready.go:35] waiting up to 6m0s for node "default-k8s-diff-port-645100" to be "Ready" ...
I0914 23:08:50.492607 6016 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0914 23:08:50.492607 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0914 23:08:50.506602 6016 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0914 23:08:50.522764 6016 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62306 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\default-k8s-diff-port-645100\id_rsa Username:docker}
I0914 23:08:50.554379 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0914 23:08:50.554379 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0914 23:08:50.665625 6016 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0914 23:08:50.665625 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0914 23:08:50.765479 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0914 23:08:50.765734 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0914 23:08:50.875002 6016 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0914 23:08:50.875002 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0914 23:08:51.048102 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0914 23:08:51.048102 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0914 23:08:51.179253 6016 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0914 23:08:51.186399 6016 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0914 23:08:51.270152 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0914 23:08:51.270690 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0914 23:08:51.957332 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-role.yaml
I0914 23:08:51.957332 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0914 23:08:52.079481 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0914 23:08:52.079481 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0914 23:08:52.173537 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0914 23:08:52.173537 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0914 23:08:52.266352 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0914 23:08:52.266352 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0914 23:08:52.464506 6016 addons.go:423] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0914 23:08:52.464506 6016 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0914 23:08:52.520469 6016 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0914 23:08:57.254204 12004 pod_ready.go:97] error getting pod "coredns-5644d7b6d9-6pdxt" in "kube-system" namespace (skipping!): etcdserver: request timed out
I0914 23:08:57.254204 12004 pod_ready.go:81] duration metric: took 10.1989883s waiting for pod "coredns-5644d7b6d9-6pdxt" in "kube-system" namespace to be "Ready" ...
E0914 23:08:57.254204 12004 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-5644d7b6d9-6pdxt" in "kube-system" namespace (skipping!): etcdserver: request timed out
I0914 23:08:57.254204 12004 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5644d7b6d9-t4f9t" in "kube-system" namespace to be "Ready" ...
I0914 23:08:57.417729 6016 node_ready.go:53] error getting node "default-k8s-diff-port-645100": etcdserver: request timed out
I0914 23:08:57.417756 6016 node_ready.go:38] duration metric: took 7.0228008s waiting for node "default-k8s-diff-port-645100" to be "Ready" ...
I0914 23:08:57.418509 6016 out.go:177]
W0914 23:08:57.419229 6016 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: error getting node "default-k8s-diff-port-645100": etcdserver: request timed out
W0914 23:08:57.419229 6016 out.go:239] *
W0914 23:08:57.420479 6016 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0914 23:08:57.421474 6016 out.go:177]
I0914 23:09:05.947813 12004 pod_ready.go:102] pod "coredns-5644d7b6d9-t4f9t" in "kube-system" namespace has status "Ready":"False"
*
* ==> Docker <==
* Sep 14 23:08:11 default-k8s-diff-port-645100 cri-dockerd[1162]: time="2023-09-14T23:08:11Z" level=error msg="Failed to delete corrupt checkpoint for sandbox URL=\"unix:///var/run/cri-dockerd.sock\": invalid key: \"URL=\\\"unix:///var/run/cri-dockerd.sock\\\"\""
Sep 14 23:08:11 default-k8s-diff-port-645100 cri-dockerd[1162]: time="2023-09-14T23:08:11Z" level=error msg="Failed to delete corrupt checkpoint for sandbox URL=\"unix:///var/run/cri-dockerd.sock\": invalid key: \"URL=\\\"unix:///var/run/cri-dockerd.sock\\\"\""
Sep 14 23:08:11 default-k8s-diff-port-645100 cri-dockerd[1162]: time="2023-09-14T23:08:11Z" level=error msg="Failed to delete corrupt checkpoint for sandbox URL=\"unix:///var/run/cri-dockerd.sock\": invalid key: \"URL=\\\"unix:///var/run/cri-dockerd.sock\\\"\""
Sep 14 23:08:11 default-k8s-diff-port-645100 cri-dockerd[1162]: time="2023-09-14T23:08:11Z" level=error msg="Failed to delete corrupt checkpoint for sandbox URL=\"unix:///var/run/cri-dockerd.sock\": invalid key: \"URL=\\\"unix:///var/run/cri-dockerd.sock\\\"\""
Sep 14 23:08:12 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:12.125837900Z" level=info msg="ignoring event" container=d0f28fa5e657e5879803b0471c9fcb7a25bbbce2bd0ad998b7070626f0f6c604 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:12 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:12.314200600Z" level=info msg="ignoring event" container=b7070e9718a7c43dfaa4162456802ace372b8877f7c311073ed5685e20594a87 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:12 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:12.792522800Z" level=info msg="ignoring event" container=d78fbfe6af16a36862f4ef823ddda09d894d9b043cee758fdf3ce4edaa032001 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:13 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:13.015752000Z" level=info msg="ignoring event" container=73dd4b75c9af52c51b421f02d7786c55c36062775eee9f458842e02a361e180f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:13 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:13.305877800Z" level=info msg="ignoring event" container=e0794008ddeedbd4feba622e80110e36a56a9a2e0abf4489fd0c43648118ceb4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:13 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:13.559381500Z" level=info msg="ignoring event" container=d6f7c2d6d00fd16492284553dfc0b783ba6ecbf49237e624f1ae7e232f0752bb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:14 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:14.065334400Z" level=info msg="ignoring event" container=1ef75d17b79532a6fc51e3653caeb826c3f41c0b1b91ce461a15e43afa970408 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:14 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:14.685135700Z" level=info msg="ignoring event" container=d0d6cd8832c4d97cfb15881d96b6587491d8e3146e728c8f2cd77b4ca0d2f285 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:14 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:14.994416400Z" level=info msg="ignoring event" container=526afbea05d1b84113adab5112ba823cfebb527d5322964c6beb6f63dfbce9d4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:15 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:15.365294100Z" level=info msg="ignoring event" container=54f0b6a520966c3c18f31362b5d66a1a23f5d3a8a47be6ad8adf40fd5a30f45b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:15 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:15.769635900Z" level=info msg="ignoring event" container=14e26c387d71ae559901caa9fa2eeacaf6a96b0e75da7031491a191f140e4f62 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:15 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:15.992399400Z" level=info msg="ignoring event" container=b11336056c3021613ee308f45f079287a06380f4a26ca806784ab9339415e433 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:16 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:16.327232900Z" level=info msg="ignoring event" container=ed41a9f56ea5c5195b5f052f82aff93e41804a890b5a09c4556a1b3dc63602ad module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:16 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:16.626988400Z" level=info msg="ignoring event" container=642fec7c9a1724962afac0aa504b0b49603653c1afc98340d483931a9608a484 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:16 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:16.975047900Z" level=info msg="ignoring event" container=d8859416ade9776871b8e327caeaf1900f9a4a97b413a28345247f358f4b4208 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:17 default-k8s-diff-port-645100 dockerd[931]: time="2023-09-14T23:08:17.382347000Z" level=info msg="ignoring event" container=79c151be63772b4c23974f1064860db0b3e368cb18e1d01b217f1ba4f6041d14 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 14 23:08:24 default-k8s-diff-port-645100 cri-dockerd[1162]: time="2023-09-14T23:08:24Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/a7d052ca972252507739e4c3620f48cc1076f04b4f52b4d3381355def6669e7c/resolv.conf as [nameserver 192.168.65.254 options ndots:0]"
Sep 14 23:08:24 default-k8s-diff-port-645100 cri-dockerd[1162]: time="2023-09-14T23:08:24Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/2aa96e223b70cff7c7a74333765794f37ac3aa9198262770f4d799b24d721c80/resolv.conf as [nameserver 192.168.65.254 options ndots:0]"
Sep 14 23:08:24 default-k8s-diff-port-645100 cri-dockerd[1162]: time="2023-09-14T23:08:24Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/35de4538d559ed80d150d066f6d65d3b51e760d804e6fd29fd193f88afe69146/resolv.conf as [nameserver 192.168.65.254 options ndots:0]"
Sep 14 23:08:24 default-k8s-diff-port-645100 cri-dockerd[1162]: time="2023-09-14T23:08:24Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/5893cb883d7d41955b7f1abf247e1edfd71483c14c4afbdf576e4612dd60723e/resolv.conf as [nameserver 192.168.65.254 options ndots:0]"
Sep 14 23:08:58 default-k8s-diff-port-645100 cri-dockerd[1162]: time="2023-09-14T23:08:58Z" level=info msg="Docker cri received runtime config &RuntimeConfig{NetworkConfig:&NetworkConfig{PodCidr:10.244.0.0/24,},}"
*
* ==> container status <==
* time="2023-09-14T23:09:18Z" level=fatal msg="unable to determine image API version: rpc error: code = DeadlineExceeded desc = context deadline exceeded"
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
c8661759f44d registry.k8s.io/pause:3.9 "/pause" 28 seconds ago Created k8s_POD_coredns-5dd5756b68-2cqd5_kube-system_bc209e6d-7a69-4ce2-8608-9e1b6eabc690_0
cfca2e85373e registry.k8s.io/pause:3.9 "/pause" 28 seconds ago Created k8s_POD_coredns-5dd5756b68-49gkc_kube-system_30044d97-8437-46f0-90c9-63dcd7ecdb3e_0
b7c97d34b442 registry.k8s.io/pause:3.9 "/pause" 29 seconds ago Created k8s_POD_kube-proxy-k9m4c_kube-system_75c3b56a-bc32-4c4e-925d-e2a6cab163dd_0
b06b744d3c76 b462ce0c8b1f "kube-scheduler --au…" 54 seconds ago Up 53 seconds k8s_kube-scheduler_kube-scheduler-default-k8s-diff-port-645100_kube-system_3434e2dda23a236d3c997c4ef3cc5d77_0
ad94b7aac7d6 821b3dfea27b "kube-controller-man…" 54 seconds ago Up 53 seconds k8s_kube-controller-manager_kube-controller-manager-default-k8s-diff-port-645100_kube-system_8d38d6ff3107c39743c8bb613001fa19_0
043e156553d0 5c801295c21d "kube-apiserver --ad…" 54 seconds ago Up 53 seconds k8s_kube-apiserver_kube-apiserver-default-k8s-diff-port-645100_kube-system_9bd15cb8e026266d8c41ee83aed8c7ba_0
43c0064d6718 73deb9a3f702 "etcd --advertise-cl…" 54 seconds ago Up 53 seconds k8s_etcd_etcd-default-k8s-diff-port-645100_kube-system_4b8cb380e65264150444d6824d1278ec_0
5893cb883d7d registry.k8s.io/pause:3.9 "/pause" 55 seconds ago Up 54 seconds k8s_POD_kube-scheduler-default-k8s-diff-port-645100_kube-system_3434e2dda23a236d3c997c4ef3cc5d77_0
35de4538d559 registry.k8s.io/pause:3.9 "/pause" 55 seconds ago Up 54 seconds k8s_POD_kube-controller-manager-default-k8s-diff-port-645100_kube-system_8d38d6ff3107c39743c8bb613001fa19_0
2aa96e223b70 registry.k8s.io/pause:3.9 "/pause" 55 seconds ago Up 54 seconds k8s_POD_kube-apiserver-default-k8s-diff-port-645100_kube-system_9bd15cb8e026266d8c41ee83aed8c7ba_0
a7d052ca9722 registry.k8s.io/pause:3.9 "/pause" 55 seconds ago Up 54 seconds k8s_POD_etcd-default-k8s-diff-port-645100_kube-system_4b8cb380e65264150444d6824d1278ec_0
*
* ==> describe nodes <==
* Name: default-k8s-diff-port-645100
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=default-k8s-diff-port-645100
kubernetes.io/os=linux
minikube.k8s.io/commit=d7492f2ae2d9b6e62b385ffcd97ebad62c645e82
minikube.k8s.io/name=default-k8s-diff-port-645100
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2023_09_14T23_08_37_0700
minikube.k8s.io/version=v1.31.2
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 14 Sep 2023 23:08:31 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: default-k8s-diff-port-645100
AcquireTime: <unset>
RenewTime: Thu, 14 Sep 2023 23:09:16 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 14 Sep 2023 23:08:59 +0000 Thu, 14 Sep 2023 23:08:26 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 14 Sep 2023 23:08:59 +0000 Thu, 14 Sep 2023 23:08:26 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 14 Sep 2023 23:08:59 +0000 Thu, 14 Sep 2023 23:08:26 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 14 Sep 2023 23:08:59 +0000 Thu, 14 Sep 2023 23:08:48 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.103.2
Hostname: default-k8s-diff-port-645100
Capacity:
cpu: 16
ephemeral-storage: 263174212Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 52638988Ki
pods: 110
Allocatable:
cpu: 16
ephemeral-storage: 263174212Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 52638988Ki
pods: 110
System Info:
Machine ID: fb399aa1b1d74f749004a7e987d661af
System UUID: fb399aa1b1d74f749004a7e987d661af
Boot ID: e3b2f4df-a392-48f4-a6e6-b4b5cf5dd1c4
Kernel Version: 5.10.102.1-microsoft-standard-WSL2
OS Image: Ubuntu 22.04.3 LTS
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://24.0.6
Kubelet Version: v1.28.1
Kube-Proxy Version: v1.28.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (7 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system coredns-5dd5756b68-2cqd5 100m (0%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (0%!)(MISSING) 31s
kube-system coredns-5dd5756b68-49gkc 100m (0%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (0%!)(MISSING) 31s
kube-system etcd-default-k8s-diff-port-645100 100m (0%!)(MISSING) 0 (0%!)(MISSING) 100Mi (0%!)(MISSING) 0 (0%!)(MISSING) 42s
kube-system kube-apiserver-default-k8s-diff-port-645100 250m (1%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 42s
kube-system kube-controller-manager-default-k8s-diff-port-645100 200m (1%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 45s
kube-system kube-proxy-k9m4c 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 31s
kube-system kube-scheduler-default-k8s-diff-port-645100 100m (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 42s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (5%!)(MISSING) 0 (0%!)(MISSING)
memory 240Mi (0%!)(MISSING) 340Mi (0%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 57s (x8 over 57s) kubelet Node default-k8s-diff-port-645100 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 57s (x8 over 57s) kubelet Node default-k8s-diff-port-645100 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 57s (x7 over 57s) kubelet Node default-k8s-diff-port-645100 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 57s kubelet Updated Node Allocatable limit across pods
Normal Starting 43s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 43s kubelet Node default-k8s-diff-port-645100 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 43s kubelet Node default-k8s-diff-port-645100 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 43s kubelet Node default-k8s-diff-port-645100 status is now: NodeHasSufficientPID
Normal NodeNotReady 43s kubelet Node default-k8s-diff-port-645100 status is now: NodeNotReady
Normal NodeAllocatableEnforced 42s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 32s node-controller Node default-k8s-diff-port-645100 event: Registered Node default-k8s-diff-port-645100 in Controller
Normal NodeReady 32s kubelet Node default-k8s-diff-port-645100 status is now: NodeReady
*
* ==> dmesg <==
* [Sep14 22:30] WSL2: Performing memory compaction.
[Sep14 22:31] WSL2: Performing memory compaction.
[Sep14 22:32] WSL2: Performing memory compaction.
[Sep14 22:33] WSL2: Performing memory compaction.
[Sep14 22:34] WSL2: Performing memory compaction.
[Sep14 22:35] WSL2: Performing memory compaction.
[Sep14 22:36] WSL2: Performing memory compaction.
[Sep14 22:37] WSL2: Performing memory compaction.
[Sep14 22:38] WSL2: Performing memory compaction.
[Sep14 22:39] WSL2: Performing memory compaction.
[Sep14 22:40] process 'docker/tmp/qemu-check672964385/check' started with executable stack
[Sep14 22:41] WSL2: Performing memory compaction.
[Sep14 22:42] WSL2: Performing memory compaction.
[Sep14 22:45] WSL2: Performing memory compaction.
[Sep14 22:46] WSL2: Performing memory compaction.
[Sep14 22:47] hrtimer: interrupt took 388900 ns
[Sep14 22:48] WSL2: Performing memory compaction.
[Sep14 22:49] WSL2: Performing memory compaction.
[Sep14 22:50] WSL2: Performing memory compaction.
[Sep14 22:52] WSL2: Performing memory compaction.
[Sep14 22:54] WSL2: Performing memory compaction.
[Sep14 22:59] WSL2: Performing memory compaction.
[Sep14 23:01] WSL2: Performing memory compaction.
[Sep14 23:03] WSL2: Performing memory compaction.
[Sep14 23:08] WSL2: Performing memory compaction.
*
* ==> etcd [43c0064d6718] <==
* {"level":"info","ts":"2023-09-14T23:09:19.578688Z","caller":"traceutil/trace.go:171","msg":"trace[929197408] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-default-k8s-diff-port-645100.1784e6a03d1152a0; range_end:; response_count:1; response_revision:419; }","duration":"9.8885076s","start":"2023-09-14T23:09:09.690153Z","end":"2023-09-14T23:09:19.57866Z","steps":["trace[929197408] 'agreement among raft nodes before linearized reading' (duration: 9.8882264s)"],"step_count":1}
{"level":"warn","ts":"2023-09-14T23:09:19.578739Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-09-14T23:09:09.690144Z","time spent":"9.8885782s","remote":"127.0.0.1:43648","response type":"/etcdserverpb.KV/Range","request count":0,"request size":91,"response count":1,"response size":898,"request content":"key:\"/registry/events/kube-system/kube-apiserver-default-k8s-diff-port-645100.1784e6a03d1152a0\" "}
{"level":"warn","ts":"2023-09-14T23:09:19.943469Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-09-14T23:09:19.580125Z","time spent":"363.3368ms","remote":"127.0.0.1:43634","response type":"/etcdserverpb.Lease/LeaseGrant","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""}
{"level":"info","ts":"2023-09-14T23:09:19.968244Z","caller":"traceutil/trace.go:171","msg":"trace[1179321316] linearizableReadLoop","detail":"{readStateIndex:440; appliedIndex:437; }","duration":"316.5427ms","start":"2023-09-14T23:09:19.651672Z","end":"2023-09-14T23:09:19.968215Z","steps":["trace[1179321316] 'read index received' (duration: 289.2507ms)","trace[1179321316] 'applied index is now lower than readState.Index' (duration: 27.288ms)"],"step_count":2}
{"level":"info","ts":"2023-09-14T23:09:19.968408Z","caller":"traceutil/trace.go:171","msg":"trace[380218342] transaction","detail":"{read_only:false; response_revision:420; number_of_response:1; }","duration":"381.3761ms","start":"2023-09-14T23:09:19.587015Z","end":"2023-09-14T23:09:19.968392Z","steps":["trace[380218342] 'process raft request' (duration: 380.6447ms)"],"step_count":1}
{"level":"warn","ts":"2023-09-14T23:09:19.968556Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-09-14T23:09:19.58699Z","time spent":"381.4591ms","remote":"127.0.0.1:43648","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":860,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/events/kube-system/kube-apiserver-default-k8s-diff-port-645100.1784e6a03d1152a0\" mod_revision:415 > success:<request_put:<key:\"/registry/events/kube-system/kube-apiserver-default-k8s-diff-port-645100.1784e6a03d1152a0\" value_size:753 lease:4650400466883831736 >> failure:<request_range:<key:\"/registry/events/kube-system/kube-apiserver-default-k8s-diff-port-645100.1784e6a03d1152a0\" > >"}
{"level":"info","ts":"2023-09-14T23:09:19.969133Z","caller":"traceutil/trace.go:171","msg":"trace[699876883] transaction","detail":"{read_only:false; response_revision:421; number_of_response:1; }","duration":"319.1712ms","start":"2023-09-14T23:09:19.649936Z","end":"2023-09-14T23:09:19.969107Z","steps":["trace[699876883] 'process raft request' (duration: 318.165ms)"],"step_count":1}
{"level":"warn","ts":"2023-09-14T23:09:19.969196Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"317.5994ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/default-k8s-diff-port-645100\" ","response":"range_response_count:1 size:4647"}
{"level":"info","ts":"2023-09-14T23:09:19.96925Z","caller":"traceutil/trace.go:171","msg":"trace[1012061075] range","detail":"{range_begin:/registry/minions/default-k8s-diff-port-645100; range_end:; response_count:1; response_revision:421; }","duration":"317.6681ms","start":"2023-09-14T23:09:19.651568Z","end":"2023-09-14T23:09:19.969236Z","steps":["trace[1012061075] 'agreement among raft nodes before linearized reading' (duration: 317.5324ms)"],"step_count":1}
{"level":"warn","ts":"2023-09-14T23:09:19.969297Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-09-14T23:09:19.651552Z","time spent":"317.7281ms","remote":"127.0.0.1:43672","response type":"/etcdserverpb.KV/Range","request count":0,"request size":48,"response count":1,"response size":4670,"request content":"key:\"/registry/minions/default-k8s-diff-port-645100\" "}
{"level":"warn","ts":"2023-09-14T23:09:19.969291Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-09-14T23:09:19.64991Z","time spent":"319.3049ms","remote":"127.0.0.1:43674","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":7626,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/pods/kube-system/kube-apiserver-default-k8s-diff-port-645100\" mod_revision:336 > success:<request_put:<key:\"/registry/pods/kube-system/kube-apiserver-default-k8s-diff-port-645100\" value_size:7548 >> failure:<request_range:<key:\"/registry/pods/kube-system/kube-apiserver-default-k8s-diff-port-645100\" > >"}
{"level":"warn","ts":"2023-09-14T23:09:19.977635Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"325.0794ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2023-09-14T23:09:19.977714Z","caller":"traceutil/trace.go:171","msg":"trace[77015955] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:422; }","duration":"325.1762ms","start":"2023-09-14T23:09:19.652519Z","end":"2023-09-14T23:09:19.977695Z","steps":["trace[77015955] 'agreement among raft nodes before linearized reading' (duration: 324.9554ms)"],"step_count":1}
{"level":"warn","ts":"2023-09-14T23:09:19.977766Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-09-14T23:09:19.652505Z","time spent":"325.2434ms","remote":"127.0.0.1:43696","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":28,"request content":"key:\"/registry/health\" "}
{"level":"warn","ts":"2023-09-14T23:09:20.254277Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"209.1529ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2023-09-14T23:09:20.254373Z","caller":"traceutil/trace.go:171","msg":"trace[1521972728] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:422; }","duration":"209.272ms","start":"2023-09-14T23:09:20.04508Z","end":"2023-09-14T23:09:20.254353Z","steps":["trace[1521972728] 'range keys from in-memory index tree' (duration: 208.9949ms)"],"step_count":1}
{"level":"warn","ts":"2023-09-14T23:09:20.254725Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"193.7138ms","expected-duration":"100ms","prefix":"","request":"header:<ID:13873772503738608315 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/events/kube-system/kube-apiserver-default-k8s-diff-port-645100.1784e6a03d1152a0\" mod_revision:420 > success:<request_put:<key:\"/registry/events/kube-system/kube-apiserver-default-k8s-diff-port-645100.1784e6a03d1152a0\" value_size:753 lease:4650400466883831736 >> failure:<request_range:<key:\"/registry/events/kube-system/kube-apiserver-default-k8s-diff-port-645100.1784e6a03d1152a0\" > >>","response":"size:16"}
{"level":"info","ts":"2023-09-14T23:09:20.25489Z","caller":"traceutil/trace.go:171","msg":"trace[54993831] linearizableReadLoop","detail":"{readStateIndex:442; appliedIndex:441; }","duration":"208.1723ms","start":"2023-09-14T23:09:20.046699Z","end":"2023-09-14T23:09:20.254872Z","steps":["trace[54993831] 'read index received' (duration: 14.0358ms)","trace[54993831] 'applied index is now lower than readState.Index' (duration: 194.1311ms)"],"step_count":2}
{"level":"info","ts":"2023-09-14T23:09:20.254965Z","caller":"traceutil/trace.go:171","msg":"trace[1679878955] transaction","detail":"{read_only:false; response_revision:423; number_of_response:1; }","duration":"208.8221ms","start":"2023-09-14T23:09:20.046119Z","end":"2023-09-14T23:09:20.254941Z","steps":["trace[1679878955] 'process raft request' (duration: 14.6446ms)","trace[1679878955] 'compare' (duration: 193.5733ms)"],"step_count":2}
{"level":"warn","ts":"2023-09-14T23:09:20.255112Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"208.5024ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/default/kubernetes\" ","response":"range_response_count:1 size:421"}
{"level":"info","ts":"2023-09-14T23:09:20.255161Z","caller":"traceutil/trace.go:171","msg":"trace[1118424707] range","detail":"{range_begin:/registry/services/endpoints/default/kubernetes; range_end:; response_count:1; response_revision:423; }","duration":"208.5577ms","start":"2023-09-14T23:09:20.04659Z","end":"2023-09-14T23:09:20.255148Z","steps":["trace[1118424707] 'agreement among raft nodes before linearized reading' (duration: 208.3832ms)"],"step_count":1}
{"level":"warn","ts":"2023-09-14T23:09:20.255117Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"205.2629ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-apiserver-default-k8s-diff-port-645100\" ","response":"range_response_count:1 size:7641"}
{"level":"info","ts":"2023-09-14T23:09:20.255301Z","caller":"traceutil/trace.go:171","msg":"trace[1885047188] range","detail":"{range_begin:/registry/pods/kube-system/kube-apiserver-default-k8s-diff-port-645100; range_end:; response_count:1; response_revision:423; }","duration":"205.4494ms","start":"2023-09-14T23:09:20.049832Z","end":"2023-09-14T23:09:20.255282Z","steps":["trace[1885047188] 'agreement among raft nodes before linearized reading' (duration: 205.166ms)"],"step_count":1}
{"level":"warn","ts":"2023-09-14T23:09:20.255378Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"183.9982ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/\" range_end:\"/registry/events0\" limit:500 ","response":"range_response_count:39 size:30523"}
{"level":"info","ts":"2023-09-14T23:09:20.255426Z","caller":"traceutil/trace.go:171","msg":"trace[1466955849] range","detail":"{range_begin:/registry/events/; range_end:/registry/events0; response_count:39; response_revision:423; }","duration":"184.0535ms","start":"2023-09-14T23:09:20.07136Z","end":"2023-09-14T23:09:20.255414Z","steps":["trace[1466955849] 'agreement among raft nodes before linearized reading' (duration: 183.7844ms)"],"step_count":1}
*
* ==> kernel <==
* 23:09:20 up 1:33, 0 users, load average: 10.53, 7.44, 6.85
Linux default-k8s-diff-port-645100 5.10.102.1-microsoft-standard-WSL2 #1 SMP Wed Mar 2 00:30:59 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.3 LTS"
*
* ==> kube-apiserver [043e156553d0] <==
* Trace[1097934707]: [7.0096925s] [7.0096925s] END
I0914 23:09:19.579367 1 trace.go:236] Trace[1858699248]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d0613af8-dfed-4b0b-9e05-e29fa1a7c6fc,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-auk4bitusstsnytm5hoik5tbyq,user-agent:kube-apiserver/v1.28.1 (linux/amd64) kubernetes/8dc49c4,verb:PUT (14-Sep-2023 23:09:16.728) (total time: 2850ms):
Trace[1858699248]: ["GuaranteedUpdate etcd3" audit-id:d0613af8-dfed-4b0b-9e05-e29fa1a7c6fc,key:/leases/kube-system/apiserver-auk4bitusstsnytm5hoik5tbyq,type:*coordination.Lease,resource:leases.coordination.k8s.io 2850ms (23:09:16.728)
Trace[1858699248]: ---"Txn call completed" 2848ms (23:09:19.578)]
Trace[1858699248]: [2.8509549s] [2.8509549s] END
I0914 23:09:19.580450 1 trace.go:236] Trace[229548916]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c1dc6e76-8a78-465f-b32e-82261471a999,client:192.168.103.2,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-default-k8s-diff-port-645100,user-agent:kubelet/v1.28.1 (linux/amd64) kubernetes/8dc49c4,verb:GET (14-Sep-2023 23:09:13.491) (total time: 6088ms):
Trace[229548916]: ---"About to write a response" 6086ms (23:09:19.578)
Trace[229548916]: [6.0884835s] [6.0884835s] END
I0914 23:09:19.580513 1 trace.go:236] Trace[1400091775]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7d16be7f-2ade-49be-9de0-93dd9b667c3c,client:192.168.103.2,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/default-k8s-diff-port-645100,user-agent:kubelet/v1.28.1 (linux/amd64) kubernetes/8dc49c4,verb:PUT (14-Sep-2023 23:09:16.452) (total time: 3128ms):
Trace[1400091775]: ["GuaranteedUpdate etcd3" audit-id:7d16be7f-2ade-49be-9de0-93dd9b667c3c,key:/leases/kube-node-lease/default-k8s-diff-port-645100,type:*coordination.Lease,resource:leases.coordination.k8s.io 3127ms (23:09:16.452)
Trace[1400091775]: ---"Txn call completed" 3125ms (23:09:19.580)]
Trace[1400091775]: [3.1280774s] [3.1280774s] END
I0914 23:09:19.582695 1 trace.go:236] Trace[1649419229]: "List" accept:application/json,audit-id:5cedcd7c-6b97-4fb1-8f20-ddb8131382bd,client:127.0.0.1,protocol:HTTP/2.0,resource:nodes,scope:cluster,url:/api/v1/nodes,user-agent:kubectl/v1.28.1 (linux/amd64) kubernetes/8dc49c4,verb:LIST (14-Sep-2023 23:09:19.042) (total time: 539ms):
Trace[1649419229]: ["List(recursive=true) etcd3" audit-id:5cedcd7c-6b97-4fb1-8f20-ddb8131382bd,key:/minions,resourceVersion:,resourceVersionMatch:,limit:500,continue: 539ms (23:09:19.043)]
Trace[1649419229]: [539.6941ms] [539.6941ms] END
I0914 23:09:19.969758 1 trace.go:236] Trace[1193115133]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:76c13a32-112f-4528-8ecf-530c50babb24,client:192.168.103.2,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-default-k8s-diff-port-645100.1784e6a03d1152a0,user-agent:kubelet/v1.28.1 (linux/amd64) kubernetes/8dc49c4,verb:PATCH (14-Sep-2023 23:09:09.689) (total time: 10280ms):
Trace[1193115133]: ["GuaranteedUpdate etcd3" audit-id:76c13a32-112f-4528-8ecf-530c50babb24,key:/events/kube-system/kube-apiserver-default-k8s-diff-port-645100.1784e6a03d1152a0,type:*core.Event,resource:events 10280ms (23:09:09.689)
Trace[1193115133]: ---"initial value restored" 9892ms (23:09:19.581)
Trace[1193115133]: ---"Txn call completed" 383ms (23:09:19.969)]
Trace[1193115133]: ---"Object stored in database" 385ms (23:09:19.969)
Trace[1193115133]: [10.2806235s] [10.2806235s] END
I0914 23:09:19.980027 1 trace.go:236] Trace[353609441]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/192.168.103.2,type:*v1.Endpoints,resource:apiServerIPInfo (14-Sep-2023 23:09:14.759) (total time: 5220ms):
Trace[353609441]: ---"initial value restored" 4819ms (23:09:19.579)
Trace[353609441]: ---"Transaction prepared" 366ms (23:09:19.945)
Trace[353609441]: [5.2203761s] [5.2203761s] END
*
* ==> kube-controller-manager [ad94b7aac7d6] <==
* I0914 23:08:48.769210 1 event.go:307] "Event occurred" object="kube-system/kube-controller-manager-default-k8s-diff-port-645100" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0914 23:08:48.769460 1 event.go:307] "Event occurred" object="kube-system/kube-scheduler-default-k8s-diff-port-645100" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0914 23:08:48.787056 1 event.go:307] "Event occurred" object="kube-system/kube-apiserver-default-k8s-diff-port-645100" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0914 23:08:48.843403 1 shared_informer.go:318] Caches are synced for garbage collector
I0914 23:08:48.843438 1 garbagecollector.go:166] "All resource monitors have synced. Proceeding to collect garbage"
I0914 23:08:48.850451 1 shared_informer.go:318] Caches are synced for garbage collector
I0914 23:08:49.059936 1 event.go:307] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-5dd5756b68 to 2"
I0914 23:08:49.314002 1 event.go:307] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-k9m4c"
I0914 23:08:49.447315 1 event.go:307] "Event occurred" object="kube-system/coredns-5dd5756b68" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-5dd5756b68-49gkc"
I0914 23:08:49.484425 1 event.go:307] "Event occurred" object="kube-system/coredns-5dd5756b68" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-5dd5756b68-2cqd5"
I0914 23:08:49.645994 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="585.3206ms"
I0914 23:08:50.063606 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="417.3163ms"
I0914 23:08:50.063838 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="161.2µs"
I0914 23:08:50.079189 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="346.9µs"
I0914 23:08:50.145228 1 event.go:307] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-5dd5756b68 to 1 from 2"
I0914 23:08:50.263708 1 event.go:307] "Event occurred" object="kube-system/coredns-5dd5756b68" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-5dd5756b68-49gkc"
I0914 23:08:53.474908 1 node_lifecycle_controller.go:1048] "Controller detected that some Nodes are Ready. Exiting master disruption mode"
E0914 23:08:57.273894 1 event.go:280] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"coredns-5dd5756b68.1784e69ef97eb038", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-5dd5756b68", UID:"4e42b2e5-7339-40e9-9d94-32e2f1bb9c83", APIVersion:"apps/v1", ResourceVersion:"386", FieldPath:""}, Reason:"SuccessfulDelete", Message:"Deleted pod: coredns-5dd5756b68-49gkc", Source:v1.EventSource{Component:"replicaset-controller", Host:""}, FirstTimestamp:time.Date(2023, time.September, 14, 23, 8
, 50, 263199800, time.Local), LastTimestamp:time.Date(2023, time.September, 14, 23, 8, 50, 263199800, time.Local), Count:1, Type:"Normal", EventTime:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"replicaset-controller", ReportingInstance:""}': 'etcdserver: request timed out' (will not retry!)
I0914 23:09:04.421542 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="14.275141s"
E0914 23:09:04.421773 1 replica_set.go:557] sync "kube-system/coredns-5dd5756b68" failed with etcdserver: request timed out
I0914 23:09:06.322359 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="1.9004304s"
I0914 23:09:06.323023 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="372.5µs"
I0914 23:09:06.323492 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="214.8µs"
E0914 23:09:18.661817 1 resource_quota_controller.go:441] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0914 23:09:18.866014 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
*
* ==> kube-scheduler [b06b744d3c76] <==
* W0914 23:08:32.744779 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0914 23:08:32.745050 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
W0914 23:08:32.744779 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0914 23:08:32.745119 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
W0914 23:08:32.745876 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0914 23:08:32.746058 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W0914 23:08:32.871160 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0914 23:08:32.871388 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
W0914 23:08:32.873480 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0914 23:08:32.873823 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0914 23:08:32.912999 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0914 23:08:32.913113 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0914 23:08:32.945323 1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0914 23:08:32.945491 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
W0914 23:08:32.963553 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0914 23:08:32.963749 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0914 23:08:32.981746 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0914 23:08:32.981948 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0914 23:08:33.010140 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0914 23:08:33.010307 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W0914 23:08:33.068435 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0914 23:08:33.068608 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
W0914 23:08:33.145259 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0914 23:08:33.145382 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
I0914 23:08:35.554320 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
*
* ==> kubelet <==
* Sep 14 23:08:38 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:38.365243 11530 desired_state_of_world_populator.go:159] "Finished populating initial desired state of world"
Sep 14 23:08:38 default-k8s-diff-port-645100 kubelet[11530]: E0914 23:08:38.447691 11530 kubelet.go:1890] "Failed creating a mirror pod for" err="pods \"kube-controller-manager-default-k8s-diff-port-645100\" already exists" pod="kube-system/kube-controller-manager-default-k8s-diff-port-645100"
Sep 14 23:08:38 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:38.757521 11530 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-scheduler-default-k8s-diff-port-645100" podStartSLOduration=0.7573997 podCreationTimestamp="2023-09-14 23:08:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-09-14 23:08:38.7573101 +0000 UTC m=+1.971385001" watchObservedRunningTime="2023-09-14 23:08:38.7573997 +0000 UTC m=+1.971474201"
Sep 14 23:08:38 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:38.780731 11530 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/etcd-default-k8s-diff-port-645100" podStartSLOduration=0.780654 podCreationTimestamp="2023-09-14 23:08:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-09-14 23:08:38.7797864 +0000 UTC m=+1.993860901" watchObservedRunningTime="2023-09-14 23:08:38.780654 +0000 UTC m=+1.994728801"
Sep 14 23:08:38 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:38.962067 11530 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-apiserver-default-k8s-diff-port-645100" podStartSLOduration=0.9619928 podCreationTimestamp="2023-09-14 23:08:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-09-14 23:08:38.8866192 +0000 UTC m=+2.100694001" watchObservedRunningTime="2023-09-14 23:08:38.9619928 +0000 UTC m=+2.176067501"
Sep 14 23:08:49 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:49.348636 11530 topology_manager.go:215] "Topology Admit Handler" podUID="75c3b56a-bc32-4c4e-925d-e2a6cab163dd" podNamespace="kube-system" podName="kube-proxy-k9m4c"
Sep 14 23:08:49 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:49.451802 11530 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/75c3b56a-bc32-4c4e-925d-e2a6cab163dd-kube-proxy\") pod \"kube-proxy-k9m4c\" (UID: \"75c3b56a-bc32-4c4e-925d-e2a6cab163dd\") " pod="kube-system/kube-proxy-k9m4c"
Sep 14 23:08:49 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:49.451908 11530 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75c3b56a-bc32-4c4e-925d-e2a6cab163dd-lib-modules\") pod \"kube-proxy-k9m4c\" (UID: \"75c3b56a-bc32-4c4e-925d-e2a6cab163dd\") " pod="kube-system/kube-proxy-k9m4c"
Sep 14 23:08:49 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:49.452070 11530 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/75c3b56a-bc32-4c4e-925d-e2a6cab163dd-xtables-lock\") pod \"kube-proxy-k9m4c\" (UID: \"75c3b56a-bc32-4c4e-925d-e2a6cab163dd\") " pod="kube-system/kube-proxy-k9m4c"
Sep 14 23:08:49 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:49.452622 11530 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj46w\" (UniqueName: \"kubernetes.io/projected/75c3b56a-bc32-4c4e-925d-e2a6cab163dd-kube-api-access-bj46w\") pod \"kube-proxy-k9m4c\" (UID: \"75c3b56a-bc32-4c4e-925d-e2a6cab163dd\") " pod="kube-system/kube-proxy-k9m4c"
Sep 14 23:08:49 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:49.658705 11530 topology_manager.go:215] "Topology Admit Handler" podUID="30044d97-8437-46f0-90c9-63dcd7ecdb3e" podNamespace="kube-system" podName="coredns-5dd5756b68-49gkc"
Sep 14 23:08:49 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:49.659132 11530 topology_manager.go:215] "Topology Admit Handler" podUID="bc209e6d-7a69-4ce2-8608-9e1b6eabc690" podNamespace="kube-system" podName="coredns-5dd5756b68-2cqd5"
Sep 14 23:08:49 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:49.860231 11530 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bc209e6d-7a69-4ce2-8608-9e1b6eabc690-config-volume\") pod \"coredns-5dd5756b68-2cqd5\" (UID: \"bc209e6d-7a69-4ce2-8608-9e1b6eabc690\") " pod="kube-system/coredns-5dd5756b68-2cqd5"
Sep 14 23:08:49 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:49.860434 11530 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/30044d97-8437-46f0-90c9-63dcd7ecdb3e-config-volume\") pod \"coredns-5dd5756b68-49gkc\" (UID: \"30044d97-8437-46f0-90c9-63dcd7ecdb3e\") " pod="kube-system/coredns-5dd5756b68-49gkc"
Sep 14 23:08:49 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:49.860511 11530 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrhl9\" (UniqueName: \"kubernetes.io/projected/30044d97-8437-46f0-90c9-63dcd7ecdb3e-kube-api-access-rrhl9\") pod \"coredns-5dd5756b68-49gkc\" (UID: \"30044d97-8437-46f0-90c9-63dcd7ecdb3e\") " pod="kube-system/coredns-5dd5756b68-49gkc"
Sep 14 23:08:49 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:49.860572 11530 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5bh8\" (UniqueName: \"kubernetes.io/projected/bc209e6d-7a69-4ce2-8608-9e1b6eabc690-kube-api-access-n5bh8\") pod \"coredns-5dd5756b68-2cqd5\" (UID: \"bc209e6d-7a69-4ce2-8608-9e1b6eabc690\") " pod="kube-system/coredns-5dd5756b68-2cqd5"
Sep 14 23:08:57 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:57.172041 11530 status_manager.go:877] "Failed to update status for pod" pod="kube-system/coredns-5dd5756b68-2cqd5" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"bc209e6d-7a69-4ce2-8608-9e1b6eabc690\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2023-09-14T23:08:49Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2023-09-14T23:08:49Z\\\",\\\"message\\\":\\\"containers with unready status: [coredns]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2023-09-14T23:08:49Z\\\",\\\"message\\\":\\\"conta
iners with unready status: [coredns]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.k8s.io/coredns/coredns:v1.10.1\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"coredns\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}}}],\\\"hostIP\\\":\\\"192.168.103.2\\\",\\\"startTime\\\":\\\"2023-09-14T23:08:49Z\\\"}}\" for pod \"kube-system\"/\"coredns-5dd5756b68-2cqd5\": etcdserver: request timed out"
Sep 14 23:08:58 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:58.987350 11530 kuberuntime_manager.go:1463] "Updating runtime config through cri with podcidr" CIDR="10.244.0.0/24"
Sep 14 23:08:58 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:08:58.990844 11530 kubelet_network.go:61] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.244.0.0/24"
Sep 14 23:09:02 default-k8s-diff-port-645100 kubelet[11530]: E0914 23:09:02.708932 11530 event.go:280] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-apiserver-default-k8s-diff-port-645100.1784e6a03d1152a0", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-apiserver-default-k8s-diff-port-645100", UID:"9bd15cb8e026266d8c41ee83aed8c7ba", APIVersion:"v1", ResourceVersion:"", FieldPath:"spec.containers{kube-apiserver}"}, Reason:"Unhealthy", Message:"Readiness probe failed: HTTP probe failed with
statuscode: 500", Source:v1.EventSource{Component:"kubelet", Host:"default-k8s-diff-port-645100"}, FirstTimestamp:time.Date(2023, time.September, 14, 23, 8, 55, 691850400, time.Local), LastTimestamp:time.Date(2023, time.September, 14, 23, 8, 55, 691850400, time.Local), Count:1, Type:"Warning", EventTime:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"kubelet", ReportingInstance:"default-k8s-diff-port-645100"}': 'etcdserver: request timed out' (will not retry!)
Sep 14 23:09:04 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:09:04.419949 11530 status_manager.go:853] "Failed to get status for pod" podUID="bc209e6d-7a69-4ce2-8608-9e1b6eabc690" pod="kube-system/coredns-5dd5756b68-2cqd5" err="etcdserver: request timed out"
Sep 14 23:09:04 default-k8s-diff-port-645100 kubelet[11530]: E0914 23:09:04.960753 11530 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
Sep 14 23:09:05 default-k8s-diff-port-645100 kubelet[11530]: E0914 23:09:05.945051 11530 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"default-k8s-diff-port-645100\": the object has been modified; please apply your changes to the latest version and try again"
Sep 14 23:09:13 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:09:13.489549 11530 status_manager.go:877] "Failed to update status for pod" pod="kube-system/kube-controller-manager-default-k8s-diff-port-645100" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9e0c4a43-24c7-417b-be29-0e6fe11c5ff9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2023-09-14T23:08:42Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"}]}}\" for pod \"kube-system\"/\"kube-controller-manager-default-k8s-diff-port-645100\": etcdserver: request timed out"
Sep 14 23:09:19 default-k8s-diff-port-645100 kubelet[11530]: I0914 23:09:19.955215 11530 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7c97d34b4426edd307a4cd4ef7456f11aecc4213a8ec460a2047bc4db768c0a"
-- /stdout --
** stderr **
W0914 23:09:15.072907 5844 main.go:291] Unable to resolve the current Docker CLI context "default": context "default": context not found: open C:\Users\jenkins.minikube4\.docker\contexts\meta\37a8eec1ce19687d132fe29051dca629d164e2c4958ba141d5f4133a33f0688f\meta.json: The system cannot find the path specified.
** /stderr **
helpers_test.go:254: (dbg) Run: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p default-k8s-diff-port-645100 -n default-k8s-diff-port-645100
helpers_test.go:254: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p default-k8s-diff-port-645100 -n default-k8s-diff-port-645100: (1.7006933s)
helpers_test.go:261: (dbg) Run: kubectl --context default-k8s-diff-port-645100 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestStartStop/group/default-k8s-diff-port/serial/SecondStart FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (380.78s)