=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-windows-amd64.exe start -p old-k8s-version-321200 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p old-k8s-version-321200 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (9m23.6020685s)
-- stdout --
* [old-k8s-version-321200] minikube v1.32.0 on Microsoft Windows 10 Enterprise N 10.0.19045.4046 Build 19045.4046
- KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube
- MINIKUBE_LOCATION=18222
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node old-k8s-version-321200 in cluster old-k8s-version-321200
* Pulling base image v0.0.42-1708008208-17936 ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 25.0.3 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
X Problems detected in kubelet:
Feb 26 11:46:27 old-k8s-version-321200 kubelet[5770]: E0226 11:46:27.311901 5770 pod_workers.go:191] Error syncing pod 6388f061f25c003b1a04f0626fa921d8 ("kube-apiserver-old-k8s-version-321200_kube-system(6388f061f25c003b1a04f0626fa921d8)"), skipping: failed to "StartContainer" for "kube-apiserver" with ImageInspectError: "Failed to inspect image \"k8s.gcr.io/kube-apiserver:v1.16.0\": Id or size of image \"k8s.gcr.io/kube-apiserver:v1.16.0\" is not set"
Feb 26 11:46:28 old-k8s-version-321200 kubelet[5770]: E0226 11:46:28.306593 5770 pod_workers.go:191] Error syncing pod 9fc427d2e6746d2b3f18846f6f0fcafb ("kube-controller-manager-old-k8s-version-321200_kube-system(9fc427d2e6746d2b3f18846f6f0fcafb)"), skipping: failed to "StartContainer" for "kube-controller-manager" with ImageInspectError: "Failed to inspect image \"k8s.gcr.io/kube-controller-manager:v1.16.0\": Id or size of image \"k8s.gcr.io/kube-controller-manager:v1.16.0\" is not set"
Feb 26 11:46:35 old-k8s-version-321200 kubelet[5770]: E0226 11:46:35.300820 5770 pod_workers.go:191] Error syncing pod b3d303074fe0ca1d42a8bd9ed248df09 ("kube-scheduler-old-k8s-version-321200_kube-system(b3d303074fe0ca1d42a8bd9ed248df09)"), skipping: failed to "StartContainer" for "kube-scheduler" with ImageInspectError: "Failed to inspect image \"k8s.gcr.io/kube-scheduler:v1.16.0\": Id or size of image \"k8s.gcr.io/kube-scheduler:v1.16.0\" is not set"
-- /stdout --
** stderr **
W0226 11:37:27.555366 13020 main.go:291] Unable to resolve the current Docker CLI context "default": context "default": context not found: open C:\Users\jenkins.minikube7\.docker\contexts\meta\37a8eec1ce19687d132fe29051dca629d164e2c4958ba141d5f4133a33f0688f\meta.json: The system cannot find the path specified.
I0226 11:37:27.644408 13020 out.go:291] Setting OutFile to fd 1924 ...
I0226 11:37:27.645399 13020 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0226 11:37:27.645399 13020 out.go:304] Setting ErrFile to fd 1960...
I0226 11:37:27.645399 13020 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0226 11:37:27.670312 13020 out.go:298] Setting JSON to false
I0226 11:37:27.673545 13020 start.go:129] hostinfo: {"hostname":"minikube7","uptime":4724,"bootTime":1708942723,"procs":200,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.4046 Build 19045.4046","kernelVersion":"10.0.19045.4046 Build 19045.4046","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f66ed2ea-6c04-4a6b-8eea-b2fb0953e990"}
W0226 11:37:27.673545 13020 start.go:137] gopshost.Virtualization returned error: not implemented yet
I0226 11:37:28.021340 13020 out.go:177] * [old-k8s-version-321200] minikube v1.32.0 on Microsoft Windows 10 Enterprise N 10.0.19045.4046 Build 19045.4046
I0226 11:37:28.028931 13020 notify.go:220] Checking for updates...
I0226 11:37:28.031999 13020 out.go:177] - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig
I0226 11:37:28.037665 13020 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0226 11:37:28.052130 13020 out.go:177] - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube
I0226 11:37:28.060933 13020 out.go:177] - MINIKUBE_LOCATION=18222
I0226 11:37:28.071503 13020 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0226 11:37:28.076552 13020 config.go:182] Loaded profile config "cert-expiration-720300": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0226 11:37:28.077298 13020 config.go:182] Loaded profile config "cert-options-380200": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0226 11:37:28.077298 13020 config.go:182] Loaded profile config "kubernetes-upgrade-797800": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0226 11:37:28.078183 13020 driver.go:392] Setting default libvirt URI to qemu:///system
I0226 11:37:28.377445 13020 docker.go:122] docker version: linux-25.0.3:Docker Desktop 4.27.2 (137060)
I0226 11:37:28.388883 13020 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0226 11:37:28.795951 13020 info.go:266] docker info: {ID:0ef20c77-55be-412e-b76a-bd4063eba5cd Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:83 OomKillDisable:true NGoroutines:92 SystemTime:2024-02-26 11:37:28.745162558 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:5.15.133.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Inde
xServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657511936 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile
=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1-desktop.4] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.5-desktop.1] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.24] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:
Docker Inc. Version:v0.1.0] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.0.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.4.1]] Warning
s:<nil>}}
I0226 11:37:28.801946 13020 out.go:177] * Using the docker driver based on user configuration
I0226 11:37:28.805947 13020 start.go:299] selected driver: docker
I0226 11:37:28.805947 13020 start.go:903] validating driver "docker" against <nil>
I0226 11:37:28.805947 13020 start.go:914] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0226 11:37:28.886785 13020 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0226 11:37:29.236673 13020 info.go:266] docker info: {ID:0ef20c77-55be-412e-b76a-bd4063eba5cd Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:73 OomKillDisable:true NGoroutines:90 SystemTime:2024-02-26 11:37:29.194673336 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:5.15.133.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Inde
xServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657511936 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile
=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1-desktop.4] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.5-desktop.1] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.24] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:
Docker Inc. Version:v0.1.0] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.0.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.4.1]] Warning
s:<nil>}}
I0226 11:37:29.237310 13020 start_flags.go:309] no existing cluster config was found, will generate one from the flags
I0226 11:37:29.242951 13020 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0226 11:37:29.246746 13020 out.go:177] * Using Docker Desktop driver with root privileges
I0226 11:37:29.252339 13020 cni.go:84] Creating CNI manager for ""
I0226 11:37:29.252339 13020 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0226 11:37:29.252339 13020 start_flags.go:323] config:
{Name:old-k8s-version-321200 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708008208-17936@sha256:4ea1136332ba1476cda33a97bf12e2f96995cc120674fbafd3ade22d1118ecdf Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-321200 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0226 11:37:29.260858 13020 out.go:177] * Starting control plane node old-k8s-version-321200 in cluster old-k8s-version-321200
I0226 11:37:29.266524 13020 cache.go:121] Beginning downloading kic base image for docker with docker
I0226 11:37:29.271112 13020 out.go:177] * Pulling base image v0.0.42-1708008208-17936 ...
I0226 11:37:29.277599 13020 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0226 11:37:29.277599 13020 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708008208-17936@sha256:4ea1136332ba1476cda33a97bf12e2f96995cc120674fbafd3ade22d1118ecdf in local docker daemon
I0226 11:37:29.278756 13020 preload.go:148] Found local preload: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0226 11:37:29.278756 13020 cache.go:56] Caching tarball of preloaded images
I0226 11:37:29.278756 13020 preload.go:174] Found C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0226 11:37:29.279289 13020 cache.go:59] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0226 11:37:29.279400 13020 profile.go:148] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\config.json ...
I0226 11:37:29.279536 13020 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\config.json: {Name:mkaff96102becf5cfaf692b4242e82b960474d3a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0226 11:37:29.455934 13020 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708008208-17936@sha256:4ea1136332ba1476cda33a97bf12e2f96995cc120674fbafd3ade22d1118ecdf in local docker daemon, skipping pull
I0226 11:37:29.455934 13020 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708008208-17936@sha256:4ea1136332ba1476cda33a97bf12e2f96995cc120674fbafd3ade22d1118ecdf exists in daemon, skipping load
I0226 11:37:29.455934 13020 cache.go:194] Successfully downloaded all kic artifacts
I0226 11:37:29.455934 13020 start.go:365] acquiring machines lock for old-k8s-version-321200: {Name:mk55b0c0259e24b9978efabbdf90c76106474ba0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0226 11:37:29.455934 13020 start.go:369] acquired machines lock for "old-k8s-version-321200" in 0s
I0226 11:37:29.455934 13020 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-321200 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708008208-17936@sha256:4ea1136332ba1476cda33a97bf12e2f96995cc120674fbafd3ade22d1118ecdf Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-321200 Namespace:default APIServer
Name:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di
sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0226 11:37:29.455934 13020 start.go:125] createHost starting for "" (driver="docker")
I0226 11:37:29.462912 13020 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0226 11:37:29.462912 13020 start.go:159] libmachine.API.Create for "old-k8s-version-321200" (driver="docker")
I0226 11:37:29.462912 13020 client.go:168] LocalClient.Create starting
I0226 11:37:29.463590 13020 main.go:141] libmachine: Reading certificate data from C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem
I0226 11:37:29.463590 13020 main.go:141] libmachine: Decoding PEM data...
I0226 11:37:29.464118 13020 main.go:141] libmachine: Parsing certificate...
I0226 11:37:29.464983 13020 main.go:141] libmachine: Reading certificate data from C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem
I0226 11:37:29.464983 13020 main.go:141] libmachine: Decoding PEM data...
I0226 11:37:29.464983 13020 main.go:141] libmachine: Parsing certificate...
I0226 11:37:29.475840 13020 cli_runner.go:164] Run: docker network inspect old-k8s-version-321200 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0226 11:37:29.656789 13020 cli_runner.go:211] docker network inspect old-k8s-version-321200 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0226 11:37:29.665783 13020 network_create.go:281] running [docker network inspect old-k8s-version-321200] to gather additional debugging logs...
I0226 11:37:29.665783 13020 cli_runner.go:164] Run: docker network inspect old-k8s-version-321200
W0226 11:37:29.846833 13020 cli_runner.go:211] docker network inspect old-k8s-version-321200 returned with exit code 1
I0226 11:37:29.846833 13020 network_create.go:284] error running [docker network inspect old-k8s-version-321200]: docker network inspect old-k8s-version-321200: exit status 1
stdout:
[]
stderr:
Error response from daemon: network old-k8s-version-321200 not found
I0226 11:37:29.846833 13020 network_create.go:286] output of [docker network inspect old-k8s-version-321200]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network old-k8s-version-321200 not found
** /stderr **
I0226 11:37:29.860835 13020 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0226 11:37:30.087944 13020 network.go:210] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0226 11:37:30.111888 13020 network.go:207] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0022d66c0}
I0226 11:37:30.111888 13020 network_create.go:124] attempt to create docker network old-k8s-version-321200 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I0226 11:37:30.124351 13020 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-321200 old-k8s-version-321200
W0226 11:37:30.318680 13020 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-321200 old-k8s-version-321200 returned with exit code 1
W0226 11:37:30.319653 13020 network_create.go:149] failed to create docker network old-k8s-version-321200 192.168.58.0/24 with gateway 192.168.58.1 and mtu of 1500: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-321200 old-k8s-version-321200: exit status 1
stdout:
stderr:
Error response from daemon: Pool overlaps with other one on this address space
W0226 11:37:30.319653 13020 network_create.go:116] failed to create docker network old-k8s-version-321200 192.168.58.0/24, will retry: subnet is taken
I0226 11:37:30.351339 13020 network.go:210] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0226 11:37:30.382354 13020 network.go:210] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0226 11:37:30.407902 13020 network.go:207] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0021b4900}
I0226 11:37:30.408034 13020 network_create.go:124] attempt to create docker network old-k8s-version-321200 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0226 11:37:30.419718 13020 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-321200 old-k8s-version-321200
W0226 11:37:30.594098 13020 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-321200 old-k8s-version-321200 returned with exit code 1
W0226 11:37:30.594098 13020 network_create.go:149] failed to create docker network old-k8s-version-321200 192.168.76.0/24 with gateway 192.168.76.1 and mtu of 1500: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-321200 old-k8s-version-321200: exit status 1
stdout:
stderr:
Error response from daemon: Pool overlaps with other one on this address space
W0226 11:37:30.594098 13020 network_create.go:116] failed to create docker network old-k8s-version-321200 192.168.76.0/24, will retry: subnet is taken
I0226 11:37:30.632853 13020 network.go:210] skipping subnet 192.168.76.0/24 that is reserved: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0226 11:37:30.656597 13020 network.go:207] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0021b50e0}
I0226 11:37:30.656597 13020 network_create.go:124] attempt to create docker network old-k8s-version-321200 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I0226 11:37:30.668032 13020 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-321200 old-k8s-version-321200
I0226 11:37:31.076552 13020 network_create.go:108] docker network old-k8s-version-321200 192.168.85.0/24 created
I0226 11:37:31.076552 13020 kic.go:121] calculated static IP "192.168.85.2" for the "old-k8s-version-321200" container
I0226 11:37:31.098885 13020 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0226 11:37:31.288206 13020 cli_runner.go:164] Run: docker volume create old-k8s-version-321200 --label name.minikube.sigs.k8s.io=old-k8s-version-321200 --label created_by.minikube.sigs.k8s.io=true
I0226 11:37:31.557550 13020 oci.go:103] Successfully created a docker volume old-k8s-version-321200
I0226 11:37:31.567058 13020 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-321200-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-321200 --entrypoint /usr/bin/test -v old-k8s-version-321200:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708008208-17936@sha256:4ea1136332ba1476cda33a97bf12e2f96995cc120674fbafd3ade22d1118ecdf -d /var/lib
I0226 11:37:34.077725 13020 cli_runner.go:217] Completed: docker run --rm --name old-k8s-version-321200-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-321200 --entrypoint /usr/bin/test -v old-k8s-version-321200:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708008208-17936@sha256:4ea1136332ba1476cda33a97bf12e2f96995cc120674fbafd3ade22d1118ecdf -d /var/lib: (2.5106502s)
I0226 11:37:34.078259 13020 oci.go:107] Successfully prepared a docker volume old-k8s-version-321200
I0226 11:37:34.078259 13020 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0226 11:37:34.078388 13020 kic.go:194] Starting extracting preloaded images to volume ...
I0226 11:37:34.092094 13020 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-321200:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708008208-17936@sha256:4ea1136332ba1476cda33a97bf12e2f96995cc120674fbafd3ade22d1118ecdf -I lz4 -xf /preloaded.tar -C /extractDir
I0226 11:37:53.478971 13020 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-321200:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708008208-17936@sha256:4ea1136332ba1476cda33a97bf12e2f96995cc120674fbafd3ade22d1118ecdf -I lz4 -xf /preloaded.tar -C /extractDir: (19.3865425s)
I0226 11:37:53.479035 13020 kic.go:203] duration metric: took 19.400521 seconds to extract preloaded images to volume
I0226 11:37:53.487458 13020 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0226 11:37:53.841575 13020 info.go:266] docker info: {ID:0ef20c77-55be-412e-b76a-bd4063eba5cd Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:81 OomKillDisable:true NGoroutines:89 SystemTime:2024-02-26 11:37:53.802185035 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:5.15.133.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Inde
xServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657511936 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile
=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1-desktop.4] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.5-desktop.1] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.24] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:
Docker Inc. Version:v0.1.0] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.0.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.4.1]] Warning
s:<nil>}}
I0226 11:37:53.852100 13020 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0226 11:37:54.240496 13020 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-321200 --name old-k8s-version-321200 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-321200 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-321200 --network old-k8s-version-321200 --ip 192.168.85.2 --volume old-k8s-version-321200:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708008208-17936@sha256:4ea1136332ba1476cda33a97bf12e2f96995cc120674fbafd3ade22d1118ecdf
I0226 11:37:55.158250 13020 cli_runner.go:164] Run: docker container inspect old-k8s-version-321200 --format={{.State.Running}}
I0226 11:37:55.359207 13020 cli_runner.go:164] Run: docker container inspect old-k8s-version-321200 --format={{.State.Status}}
I0226 11:37:55.544375 13020 cli_runner.go:164] Run: docker exec old-k8s-version-321200 stat /var/lib/dpkg/alternatives/iptables
I0226 11:37:55.820382 13020 oci.go:144] the created container "old-k8s-version-321200" has a running status.
I0226 11:37:55.820382 13020 kic.go:225] Creating ssh key for kic: C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\old-k8s-version-321200\id_rsa...
I0226 11:37:56.184625 13020 kic_runner.go:191] docker (temp): C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\old-k8s-version-321200\id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0226 11:37:56.433546 13020 cli_runner.go:164] Run: docker container inspect old-k8s-version-321200 --format={{.State.Status}}
I0226 11:37:56.631545 13020 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0226 11:37:56.631545 13020 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-321200 chown docker:docker /home/docker/.ssh/authorized_keys]
I0226 11:37:56.898191 13020 kic.go:265] ensuring only current user has permissions to key file located at : C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\old-k8s-version-321200\id_rsa...
I0226 11:37:59.561834 13020 cli_runner.go:164] Run: docker container inspect old-k8s-version-321200 --format={{.State.Status}}
I0226 11:37:59.708851 13020 machine.go:88] provisioning docker machine ...
I0226 11:37:59.708946 13020 ubuntu.go:169] provisioning hostname "old-k8s-version-321200"
I0226 11:37:59.717707 13020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-321200
I0226 11:37:59.900350 13020 main.go:141] libmachine: Using SSH client type: native
I0226 11:37:59.910285 13020 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1119d80] 0x111c960 <nil> [] 0s} 127.0.0.1 53922 <nil> <nil>}
I0226 11:37:59.910285 13020 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-321200 && echo "old-k8s-version-321200" | sudo tee /etc/hostname
I0226 11:38:00.135430 13020 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-321200
I0226 11:38:00.145901 13020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-321200
I0226 11:38:00.331891 13020 main.go:141] libmachine: Using SSH client type: native
I0226 11:38:00.331891 13020 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1119d80] 0x111c960 <nil> [] 0s} 127.0.0.1 53922 <nil> <nil>}
I0226 11:38:00.332895 13020 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-321200' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-321200/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-321200' | sudo tee -a /etc/hosts;
fi
fi
I0226 11:38:00.515909 13020 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0226 11:38:00.515909 13020 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube7\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube7\minikube-integration\.minikube}
I0226 11:38:00.515909 13020 ubuntu.go:177] setting up certificates
I0226 11:38:00.515909 13020 provision.go:83] configureAuth start
I0226 11:38:00.528912 13020 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-321200
I0226 11:38:00.723175 13020 provision.go:138] copyHostCerts
I0226 11:38:00.723175 13020 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem, removing ...
I0226 11:38:00.723175 13020 exec_runner.go:203] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.pem
I0226 11:38:00.723175 13020 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem (1078 bytes)
I0226 11:38:00.725197 13020 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem, removing ...
I0226 11:38:00.725197 13020 exec_runner.go:203] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cert.pem
I0226 11:38:00.725197 13020 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem (1123 bytes)
I0226 11:38:00.726209 13020 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem, removing ...
I0226 11:38:00.726209 13020 exec_runner.go:203] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\key.pem
I0226 11:38:00.726209 13020 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem (1679 bytes)
I0226 11:38:00.727189 13020 provision.go:112] generating server cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.old-k8s-version-321200 san=[192.168.85.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-321200]
I0226 11:38:01.060946 13020 provision.go:172] copyRemoteCerts
I0226 11:38:01.076989 13020 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0226 11:38:01.088941 13020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-321200
I0226 11:38:01.265940 13020 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53922 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\old-k8s-version-321200\id_rsa Username:docker}
I0226 11:38:01.400941 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0226 11:38:01.441950 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1241 bytes)
I0226 11:38:01.480956 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0226 11:38:01.521937 13020 provision.go:86] duration metric: configureAuth took 1.0060209s
I0226 11:38:01.521937 13020 ubuntu.go:193] setting minikube options for container-runtime
I0226 11:38:01.522954 13020 config.go:182] Loaded profile config "old-k8s-version-321200": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0226 11:38:01.534962 13020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-321200
I0226 11:38:01.737953 13020 main.go:141] libmachine: Using SSH client type: native
I0226 11:38:01.738951 13020 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1119d80] 0x111c960 <nil> [] 0s} 127.0.0.1 53922 <nil> <nil>}
I0226 11:38:01.738951 13020 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0226 11:38:01.935668 13020 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0226 11:38:01.935668 13020 ubuntu.go:71] root file system type: overlay
I0226 11:38:01.935668 13020 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0226 11:38:01.945690 13020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-321200
I0226 11:38:02.153684 13020 main.go:141] libmachine: Using SSH client type: native
I0226 11:38:02.153684 13020 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1119d80] 0x111c960 <nil> [] 0s} 127.0.0.1 53922 <nil> <nil>}
I0226 11:38:02.153684 13020 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0226 11:38:02.374754 13020 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0226 11:38:02.386748 13020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-321200
I0226 11:38:02.568736 13020 main.go:141] libmachine: Using SSH client type: native
I0226 11:38:02.568736 13020 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1119d80] 0x111c960 <nil> [] 0s} 127.0.0.1 53922 <nil> <nil>}
I0226 11:38:02.568736 13020 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0226 11:38:05.401621 13020 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2024-02-06 21:12:51.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2024-02-26 11:38:02.357686472 +0000
@@ -1,46 +1,49 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
-Wants=network-online.target containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
+Wants=network-online.target
Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutStartSec=0
-RestartSec=2
-Restart=always
+Restart=on-failure
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
+LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0226 11:38:05.401621 13020 machine.go:91] provisioned docker machine in 5.6926381s
I0226 11:38:05.401621 13020 client.go:171] LocalClient.Create took 35.9384752s
I0226 11:38:05.401621 13020 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-321200" took 35.9384752s
I0226 11:38:05.401621 13020 start.go:300] post-start starting for "old-k8s-version-321200" (driver="docker")
I0226 11:38:05.401621 13020 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0226 11:38:05.419631 13020 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0226 11:38:05.433615 13020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-321200
I0226 11:38:05.636625 13020 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53922 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\old-k8s-version-321200\id_rsa Username:docker}
I0226 11:38:05.776668 13020 ssh_runner.go:195] Run: cat /etc/os-release
I0226 11:38:05.788616 13020 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0226 11:38:05.788616 13020 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0226 11:38:05.788616 13020 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0226 11:38:05.788616 13020 info.go:137] Remote host: Ubuntu 22.04.3 LTS
I0226 11:38:05.788616 13020 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\addons for local assets ...
I0226 11:38:05.788616 13020 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\files for local assets ...
I0226 11:38:05.790628 13020 filesync.go:149] local asset: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\118682.pem -> 118682.pem in /etc/ssl/certs
I0226 11:38:05.813622 13020 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0226 11:38:05.839618 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\118682.pem --> /etc/ssl/certs/118682.pem (1708 bytes)
I0226 11:38:05.902610 13020 start.go:303] post-start completed in 500.9854ms
I0226 11:38:05.923616 13020 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-321200
I0226 11:38:06.175615 13020 profile.go:148] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\config.json ...
I0226 11:38:06.202647 13020 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0226 11:38:06.219618 13020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-321200
I0226 11:38:06.493612 13020 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53922 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\old-k8s-version-321200\id_rsa Username:docker}
I0226 11:38:06.638633 13020 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0226 11:38:06.652633 13020 start.go:128] duration metric: createHost completed in 37.1964565s
I0226 11:38:06.652633 13020 start.go:83] releasing machines lock for "old-k8s-version-321200", held for 37.1964565s
I0226 11:38:06.661623 13020 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-321200
I0226 11:38:06.830486 13020 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0226 11:38:06.843622 13020 ssh_runner.go:195] Run: cat /version.json
I0226 11:38:06.843622 13020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-321200
I0226 11:38:06.855627 13020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-321200
I0226 11:38:07.061636 13020 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53922 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\old-k8s-version-321200\id_rsa Username:docker}
I0226 11:38:07.064622 13020 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53922 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\old-k8s-version-321200\id_rsa Username:docker}
I0226 11:38:07.198450 13020 ssh_runner.go:195] Run: systemctl --version
I0226 11:38:07.408443 13020 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0226 11:38:07.436441 13020 ssh_runner.go:195] Run: sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
W0226 11:38:07.460460 13020 start.go:419] unable to name loopback interface in configureRuntimes: unable to patch loopback cni config "/etc/cni/net.d/*loopback.conf*": sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;: Process exited with status 1
stdout:
stderr:
find: '\\etc\\cni\\net.d': No such file or directory
I0226 11:38:07.481467 13020 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
I0226 11:38:07.541555 13020 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
I0226 11:38:07.574575 13020 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0226 11:38:07.574575 13020 start.go:475] detecting cgroup driver to use...
I0226 11:38:07.574575 13020 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0226 11:38:07.575568 13020 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0226 11:38:07.633590 13020 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.1"|' /etc/containerd/config.toml"
I0226 11:38:07.741056 13020 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0226 11:38:07.759384 13020 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0226 11:38:07.775423 13020 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0226 11:38:07.807365 13020 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0226 11:38:07.841320 13020 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0226 11:38:07.881321 13020 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0226 11:38:07.912306 13020 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0226 11:38:07.943316 13020 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0226 11:38:07.973334 13020 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0226 11:38:08.011082 13020 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0226 11:38:08.042098 13020 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0226 11:38:08.206136 13020 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0226 11:38:08.367303 13020 start.go:475] detecting cgroup driver to use...
I0226 11:38:08.367474 13020 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0226 11:38:08.383423 13020 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0226 11:38:08.409972 13020 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0226 11:38:08.424852 13020 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0226 11:38:08.449692 13020 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0226 11:38:08.513148 13020 ssh_runner.go:195] Run: which cri-dockerd
I0226 11:38:08.542580 13020 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0226 11:38:08.561582 13020 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0226 11:38:08.611788 13020 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0226 11:38:08.797625 13020 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0226 11:38:09.026841 13020 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0226 11:38:09.027696 13020 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0226 11:38:09.105424 13020 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0226 11:38:09.275098 13020 ssh_runner.go:195] Run: sudo systemctl restart docker
I0226 11:38:10.172471 13020 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0226 11:38:10.233718 13020 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0226 11:38:10.287924 13020 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 25.0.3 ...
I0226 11:38:10.297930 13020 cli_runner.go:164] Run: docker exec -t old-k8s-version-321200 dig +short host.docker.internal
I0226 11:38:10.567517 13020 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254
I0226 11:38:10.578525 13020 ssh_runner.go:195] Run: grep 192.168.65.254 host.minikube.internal$ /etc/hosts
I0226 11:38:10.587538 13020 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0226 11:38:10.616528 13020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-321200
I0226 11:38:10.789613 13020 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0226 11:38:10.798627 13020 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0226 11:38:10.843630 13020 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0226 11:38:10.843630 13020 docker.go:691] registry.k8s.io/kube-apiserver:v1.16.0 wasn't preloaded
I0226 11:38:10.855618 13020 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I0226 11:38:10.887619 13020 ssh_runner.go:195] Run: which lz4
I0226 11:38:10.919502 13020 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0226 11:38:10.934066 13020 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0226 11:38:10.934066 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (369789069 bytes)
I0226 11:38:25.066982 13020 docker.go:649] Took 14.165681 seconds to copy over tarball
I0226 11:38:25.082408 13020 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0226 11:38:28.739221 13020 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.6567881s)
I0226 11:38:28.739221 13020 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0226 11:38:28.823755 13020 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I0226 11:38:28.843943 13020 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2499 bytes)
I0226 11:38:28.896994 13020 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0226 11:38:29.064408 13020 ssh_runner.go:195] Run: sudo systemctl restart docker
I0226 11:38:36.506032 13020 ssh_runner.go:235] Completed: sudo systemctl restart docker: (7.4415746s)
I0226 11:38:36.518562 13020 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0226 11:38:36.566515 13020 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0226 11:38:36.566515 13020 docker.go:691] registry.k8s.io/kube-apiserver:v1.16.0 wasn't preloaded
I0226 11:38:36.567495 13020 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.16.0 registry.k8s.io/kube-controller-manager:v1.16.0 registry.k8s.io/kube-scheduler:v1.16.0 registry.k8s.io/kube-proxy:v1.16.0 registry.k8s.io/pause:3.1 registry.k8s.io/etcd:3.3.15-0 registry.k8s.io/coredns:1.6.2 gcr.io/k8s-minikube/storage-provisioner:v5]
I0226 11:38:36.585504 13020 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.16.0
I0226 11:38:36.592519 13020 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0226 11:38:36.601510 13020 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.2
I0226 11:38:36.602506 13020 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.16.0
I0226 11:38:36.603496 13020 image.go:134] retrieving image: registry.k8s.io/etcd:3.3.15-0
I0226 11:38:36.607518 13020 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.16.0
I0226 11:38:36.609495 13020 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.16.0
I0226 11:38:36.611496 13020 image.go:134] retrieving image: registry.k8s.io/pause:3.1
I0226 11:38:36.612506 13020 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.16.0
I0226 11:38:36.617496 13020 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.2: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.2
I0226 11:38:36.618509 13020 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.16.0
I0226 11:38:36.619497 13020 image.go:177] daemon lookup for registry.k8s.io/etcd:3.3.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.3.15-0
I0226 11:38:36.625549 13020 image.go:177] daemon lookup for registry.k8s.io/pause:3.1: Error response from daemon: No such image: registry.k8s.io/pause:3.1
I0226 11:38:36.625549 13020 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.16.0
I0226 11:38:36.626521 13020 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.16.0
I0226 11:38:36.631499 13020 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
W0226 11:38:36.702774 13020 image.go:187] authn lookup for registry.k8s.io/kube-apiserver:v1.16.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
W0226 11:38:36.795649 13020 image.go:187] authn lookup for registry.k8s.io/coredns:1.6.2 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
W0226 11:38:36.889951 13020 image.go:187] authn lookup for registry.k8s.io/kube-proxy:v1.16.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
W0226 11:38:36.984090 13020 image.go:187] authn lookup for registry.k8s.io/etcd:3.3.15-0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
W0226 11:38:37.061552 13020 image.go:187] authn lookup for registry.k8s.io/pause:3.1 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
I0226 11:38:37.137804 13020 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.2
I0226 11:38:37.148591 13020 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.16.0
W0226 11:38:37.152495 13020 image.go:187] authn lookup for registry.k8s.io/kube-scheduler:v1.16.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
I0226 11:38:37.194168 13020 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.16.0
I0226 11:38:37.195156 13020 cache_images.go:116] "registry.k8s.io/coredns:1.6.2" needs transfer: "registry.k8s.io/coredns:1.6.2" does not exist at hash "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b" in container runtime
I0226 11:38:37.195156 13020 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\coredns:1.6.2 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\coredns_1.6.2
I0226 11:38:37.195156 13020 docker.go:337] Removing image: registry.k8s.io/coredns:1.6.2
I0226 11:38:37.198164 13020 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.3.15-0
I0226 11:38:37.202163 13020 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.16.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.16.0" does not exist at hash "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e" in container runtime
I0226 11:38:37.202163 13020 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-apiserver:v1.16.0 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-apiserver_v1.16.0
I0226 11:38:37.202163 13020 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.16.0
I0226 11:38:37.207154 13020 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.6.2
I0226 11:38:37.213159 13020 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.16.0
I0226 11:38:37.240182 13020 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.1
W0226 11:38:37.261914 13020 image.go:187] authn lookup for registry.k8s.io/kube-controller-manager:v1.16.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
I0226 11:38:37.279819 13020 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.16.0" needs transfer: "registry.k8s.io/kube-proxy:v1.16.0" does not exist at hash "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384" in container runtime
I0226 11:38:37.279819 13020 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-proxy:v1.16.0 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-proxy_v1.16.0
I0226 11:38:37.279944 13020 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.16.0
I0226 11:38:37.284158 13020 cache_images.go:116] "registry.k8s.io/etcd:3.3.15-0" needs transfer: "registry.k8s.io/etcd:3.3.15-0" does not exist at hash "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed" in container runtime
I0226 11:38:37.284158 13020 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\etcd:3.3.15-0 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\etcd_3.3.15-0
I0226 11:38:37.284158 13020 docker.go:337] Removing image: registry.k8s.io/etcd:3.3.15-0
I0226 11:38:37.293167 13020 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.16.0
I0226 11:38:37.299165 13020 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.3.15-0
W0226 11:38:37.355722 13020 image.go:187] authn lookup for gcr.io/k8s-minikube/storage-provisioner:v5 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
I0226 11:38:37.398527 13020 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\coredns_1.6.2
I0226 11:38:37.398527 13020 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\etcd_3.3.15-0
I0226 11:38:37.398527 13020 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-apiserver_v1.16.0
I0226 11:38:37.398527 13020 cache_images.go:116] "registry.k8s.io/pause:3.1" needs transfer: "registry.k8s.io/pause:3.1" does not exist at hash "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e" in container runtime
I0226 11:38:37.398527 13020 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-proxy_v1.16.0
I0226 11:38:37.398527 13020 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\pause:3.1 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\pause_3.1
I0226 11:38:37.398527 13020 docker.go:337] Removing image: registry.k8s.io/pause:3.1
I0226 11:38:37.409946 13020 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.1
I0226 11:38:37.427007 13020 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.16.0
I0226 11:38:37.456903 13020 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\pause_3.1
I0226 11:38:37.464890 13020 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.16.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.16.0" does not exist at hash "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a" in container runtime
I0226 11:38:37.464890 13020 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-scheduler:v1.16.0 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-scheduler_v1.16.0
I0226 11:38:37.464890 13020 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.16.0
I0226 11:38:37.472893 13020 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.16.0
I0226 11:38:37.490505 13020 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.16.0
I0226 11:38:37.522312 13020 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-scheduler_v1.16.0
I0226 11:38:37.531011 13020 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.16.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.16.0" does not exist at hash "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d" in container runtime
I0226 11:38:37.531011 13020 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-controller-manager:v1.16.0 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-controller-manager_v1.16.0
I0226 11:38:37.531011 13020 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.16.0
I0226 11:38:37.540382 13020 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.16.0
I0226 11:38:37.585043 13020 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-controller-manager_v1.16.0
I0226 11:38:37.618072 13020 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0226 11:38:37.661904 13020 cache_images.go:92] LoadImages completed in 1.0944023s
W0226 11:38:37.661904 13020 out.go:239] X Unable to load cached images: loading cached images: CreateFile C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\coredns_1.6.2: The system cannot find the file specified.
X Unable to load cached images: loading cached images: CreateFile C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\coredns_1.6.2: The system cannot find the file specified.
I0226 11:38:37.671460 13020 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0226 11:38:37.796708 13020 cni.go:84] Creating CNI manager for ""
I0226 11:38:37.796708 13020 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0226 11:38:37.796708 13020 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0226 11:38:37.796708 13020 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-321200 NodeName:old-k8s-version-321200 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP
odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0226 11:38:37.797695 13020 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-321200"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-321200
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.85.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0226 11:38:37.797695 13020 kubeadm.go:976] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-321200 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-321200 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0226 11:38:37.811687 13020 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0226 11:38:37.832695 13020 binaries.go:44] Found k8s binaries, skipping transfer
I0226 11:38:37.848692 13020 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0226 11:38:37.871120 13020 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (348 bytes)
I0226 11:38:37.904820 13020 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0226 11:38:37.938994 13020 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2174 bytes)
I0226 11:38:37.986625 13020 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0226 11:38:37.997548 13020 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0226 11:38:38.021918 13020 certs.go:56] Setting up C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200 for IP: 192.168.85.2
I0226 11:38:38.021918 13020 certs.go:190] acquiring lock for shared ca certs: {Name:mk3bd6e475aadf28590677101b36f61c132d4290 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0226 11:38:38.022930 13020 certs.go:199] skipping minikubeCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key
I0226 11:38:38.022930 13020 certs.go:199] skipping proxyClientCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key
I0226 11:38:38.023941 13020 certs.go:319] generating minikube-user signed cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\client.key
I0226 11:38:38.023941 13020 crypto.go:68] Generating cert C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\client.crt with IP's: []
I0226 11:38:38.552741 13020 crypto.go:156] Writing cert to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\client.crt ...
I0226 11:38:38.552741 13020 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\client.crt: {Name:mkc10b9454430202ee9b52b1b3a4bf1db8bde8b6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0226 11:38:38.553747 13020 crypto.go:164] Writing key to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\client.key ...
I0226 11:38:38.553747 13020 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\client.key: {Name:mkd2851ed06bcc7423400a7cc65c8a39303a61a8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0226 11:38:38.554746 13020 certs.go:319] generating minikube signed cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\apiserver.key.43b9df8c
I0226 11:38:38.555743 13020 crypto.go:68] Generating cert C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\apiserver.crt.43b9df8c with IP's: [192.168.85.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0226 11:38:38.865635 13020 crypto.go:156] Writing cert to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\apiserver.crt.43b9df8c ...
I0226 11:38:38.865635 13020 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\apiserver.crt.43b9df8c: {Name:mk87cf47668463d77788305b53e03d33c545d62d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0226 11:38:38.866633 13020 crypto.go:164] Writing key to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\apiserver.key.43b9df8c ...
I0226 11:38:38.866633 13020 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\apiserver.key.43b9df8c: {Name:mkb393301250e736865fc24d2ddbc2c3eb717e55 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0226 11:38:38.867638 13020 certs.go:337] copying C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\apiserver.crt.43b9df8c -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\apiserver.crt
I0226 11:38:38.880636 13020 certs.go:341] copying C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\apiserver.key.43b9df8c -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\apiserver.key
I0226 11:38:38.882624 13020 certs.go:319] generating aggregator signed cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\proxy-client.key
I0226 11:38:38.882624 13020 crypto.go:68] Generating cert C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\proxy-client.crt with IP's: []
I0226 11:38:39.037827 13020 crypto.go:156] Writing cert to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\proxy-client.crt ...
I0226 11:38:39.037827 13020 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\proxy-client.crt: {Name:mk0fdff0dd32fcc66652ca8a006350ee86abb808 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0226 11:38:39.039836 13020 crypto.go:164] Writing key to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\proxy-client.key ...
I0226 11:38:39.039836 13020 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\proxy-client.key: {Name:mk4523bd340bd2820fcca03b3bedb4a0130ae518 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0226 11:38:39.054825 13020 certs.go:437] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\11868.pem (1338 bytes)
W0226 11:38:39.054990 13020 certs.go:433] ignoring C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\11868_empty.pem, impossibly tiny 0 bytes
I0226 11:38:39.055340 13020 certs.go:437] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem (1679 bytes)
I0226 11:38:39.055340 13020 certs.go:437] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem (1078 bytes)
I0226 11:38:39.056004 13020 certs.go:437] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem (1123 bytes)
I0226 11:38:39.056213 13020 certs.go:437] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem (1679 bytes)
I0226 11:38:39.056521 13020 certs.go:437] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\118682.pem (1708 bytes)
I0226 11:38:39.059014 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0226 11:38:39.102944 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0226 11:38:39.149532 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0226 11:38:39.191329 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\old-k8s-version-321200\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0226 11:38:39.235398 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0226 11:38:39.271391 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0226 11:38:39.310400 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0226 11:38:39.352398 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0226 11:38:39.399408 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\118682.pem --> /usr/share/ca-certificates/118682.pem (1708 bytes)
I0226 11:38:39.449689 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0226 11:38:39.497664 13020 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\11868.pem --> /usr/share/ca-certificates/11868.pem (1338 bytes)
I0226 11:38:39.538701 13020 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0226 11:38:39.579698 13020 ssh_runner.go:195] Run: openssl version
I0226 11:38:39.606676 13020 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0226 11:38:39.639686 13020 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0226 11:38:39.650665 13020 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Feb 26 10:28 /usr/share/ca-certificates/minikubeCA.pem
I0226 11:38:39.663678 13020 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0226 11:38:39.689669 13020 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0226 11:38:39.724692 13020 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11868.pem && ln -fs /usr/share/ca-certificates/11868.pem /etc/ssl/certs/11868.pem"
I0226 11:38:39.754669 13020 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11868.pem
I0226 11:38:39.769486 13020 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Feb 26 10:37 /usr/share/ca-certificates/11868.pem
I0226 11:38:39.780459 13020 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11868.pem
I0226 11:38:39.815441 13020 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11868.pem /etc/ssl/certs/51391683.0"
I0226 11:38:39.849442 13020 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/118682.pem && ln -fs /usr/share/ca-certificates/118682.pem /etc/ssl/certs/118682.pem"
I0226 11:38:39.879442 13020 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/118682.pem
I0226 11:38:39.889442 13020 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Feb 26 10:37 /usr/share/ca-certificates/118682.pem
I0226 11:38:39.902453 13020 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/118682.pem
I0226 11:38:39.933456 13020 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/118682.pem /etc/ssl/certs/3ec20f2e.0"
I0226 11:38:39.966447 13020 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I0226 11:38:39.974446 13020 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
I0226 11:38:39.975469 13020 kubeadm.go:404] StartCluster: {Name:old-k8s-version-321200 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708008208-17936@sha256:4ea1136332ba1476cda33a97bf12e2f96995cc120674fbafd3ade22d1118ecdf Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-321200 Namespace:default APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptim
izations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0226 11:38:39.985454 13020 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0226 11:38:40.057444 13020 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0226 11:38:40.095496 13020 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0226 11:38:40.118459 13020 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I0226 11:38:40.133457 13020 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0226 11:38:40.154451 13020 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0226 11:38:40.154451 13020 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0226 11:38:40.548456 13020 kubeadm.go:322] [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
I0226 11:38:40.548456 13020 kubeadm.go:322] [WARNING Swap]: running with swap on is not supported. Please disable swap
I0226 11:38:40.667468 13020 kubeadm.go:322] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 18.09
I0226 11:38:40.875453 13020 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0226 11:42:45.267822 13020 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0226 11:42:45.268737 13020 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
I0226 11:42:45.277790 13020 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0226 11:42:45.278059 13020 kubeadm.go:322] [preflight] Running pre-flight checks
I0226 11:42:45.278453 13020 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0226 11:42:45.278453 13020 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0226 11:42:45.279005 13020 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0226 11:42:45.279567 13020 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0226 11:42:45.280026 13020 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0226 11:42:45.280323 13020 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0226 11:42:45.280588 13020 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0226 11:42:45.287364 13020 out.go:204] - Generating certificates and keys ...
I0226 11:42:45.287670 13020 kubeadm.go:322] [certs] Using existing ca certificate authority
I0226 11:42:45.287670 13020 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0226 11:42:45.287670 13020 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I0226 11:42:45.287670 13020 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I0226 11:42:45.288319 13020 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I0226 11:42:45.288439 13020 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I0226 11:42:45.288439 13020 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I0226 11:42:45.288439 13020 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-321200 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
I0226 11:42:45.288439 13020 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I0226 11:42:45.288439 13020 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-321200 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
I0226 11:42:45.288439 13020 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I0226 11:42:45.289545 13020 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I0226 11:42:45.289658 13020 kubeadm.go:322] [certs] Generating "sa" key and public key
I0226 11:42:45.289658 13020 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0226 11:42:45.289658 13020 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0226 11:42:45.289658 13020 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0226 11:42:45.289658 13020 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0226 11:42:45.290367 13020 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0226 11:42:45.290535 13020 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0226 11:42:45.295093 13020 out.go:204] - Booting up control plane ...
I0226 11:42:45.295617 13020 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0226 11:42:45.296023 13020 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0226 11:42:45.296442 13020 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0226 11:42:45.296586 13020 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0226 11:42:45.297180 13020 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0226 11:42:45.297354 13020 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0226 11:42:45.297408 13020 kubeadm.go:322]
I0226 11:42:45.297618 13020 kubeadm.go:322] Unfortunately, an error has occurred:
I0226 11:42:45.297776 13020 kubeadm.go:322] timed out waiting for the condition
I0226 11:42:45.297776 13020 kubeadm.go:322]
I0226 11:42:45.297776 13020 kubeadm.go:322] This error is likely caused by:
I0226 11:42:45.297776 13020 kubeadm.go:322] - The kubelet is not running
I0226 11:42:45.298363 13020 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0226 11:42:45.298363 13020 kubeadm.go:322]
I0226 11:42:45.298570 13020 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0226 11:42:45.298570 13020 kubeadm.go:322] - 'systemctl status kubelet'
I0226 11:42:45.298570 13020 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0226 11:42:45.299017 13020 kubeadm.go:322]
I0226 11:42:45.299109 13020 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0226 11:42:45.299662 13020 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0226 11:42:45.299849 13020 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0226 11:42:45.299849 13020 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0226 11:42:45.299849 13020 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0226 11:42:45.300520 13020 kubeadm.go:322] - 'docker logs CONTAINERID'
W0226 11:42:45.300742 13020 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-321200 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-321200 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-321200 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-321200 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0226 11:42:45.300970 13020 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0226 11:42:46.800127 13020 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force": (1.4991475s)
I0226 11:42:46.812968 13020 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0226 11:42:46.837454 13020 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I0226 11:42:46.848440 13020 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0226 11:42:46.868418 13020 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0226 11:42:46.868418 13020 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0226 11:42:47.192595 13020 kubeadm.go:322] [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
I0226 11:42:47.193185 13020 kubeadm.go:322] [WARNING Swap]: running with swap on is not supported. Please disable swap
I0226 11:42:47.302879 13020 kubeadm.go:322] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 18.09
I0226 11:42:47.497797 13020 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0226 11:46:49.937869 13020 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0226 11:46:49.938878 13020 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
I0226 11:46:49.943855 13020 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0226 11:46:49.944864 13020 kubeadm.go:322] [preflight] Running pre-flight checks
I0226 11:46:49.944864 13020 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0226 11:46:49.945873 13020 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0226 11:46:49.945873 13020 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0226 11:46:49.945873 13020 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0226 11:46:49.945873 13020 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0226 11:46:49.945873 13020 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0226 11:46:49.946865 13020 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0226 11:46:49.948855 13020 out.go:204] - Generating certificates and keys ...
I0226 11:46:49.949889 13020 kubeadm.go:322] [certs] Using existing ca certificate authority
I0226 11:46:49.949889 13020 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0226 11:46:49.949889 13020 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0226 11:46:49.949889 13020 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0226 11:46:49.950851 13020 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0226 11:46:49.950851 13020 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0226 11:46:49.950851 13020 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0226 11:46:49.950851 13020 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0226 11:46:49.951852 13020 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0226 11:46:49.951852 13020 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0226 11:46:49.951852 13020 kubeadm.go:322] [certs] Using the existing "sa" key
I0226 11:46:49.951852 13020 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0226 11:46:49.951852 13020 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0226 11:46:49.952866 13020 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0226 11:46:49.952866 13020 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0226 11:46:49.952866 13020 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0226 11:46:49.952866 13020 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0226 11:46:49.955880 13020 out.go:204] - Booting up control plane ...
I0226 11:46:49.955880 13020 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0226 11:46:49.955880 13020 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0226 11:46:49.956875 13020 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0226 11:46:49.956875 13020 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0226 11:46:49.956875 13020 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0226 11:46:49.957856 13020 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0226 11:46:49.957856 13020 kubeadm.go:322]
I0226 11:46:49.957856 13020 kubeadm.go:322] Unfortunately, an error has occurred:
I0226 11:46:49.957856 13020 kubeadm.go:322] timed out waiting for the condition
I0226 11:46:49.957856 13020 kubeadm.go:322]
I0226 11:46:49.957856 13020 kubeadm.go:322] This error is likely caused by:
I0226 11:46:49.957856 13020 kubeadm.go:322] - The kubelet is not running
I0226 11:46:49.957856 13020 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0226 11:46:49.957856 13020 kubeadm.go:322]
I0226 11:46:49.958865 13020 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0226 11:46:49.958865 13020 kubeadm.go:322] - 'systemctl status kubelet'
I0226 11:46:49.958865 13020 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0226 11:46:49.958865 13020 kubeadm.go:322]
I0226 11:46:49.958865 13020 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0226 11:46:49.959853 13020 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0226 11:46:49.959853 13020 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0226 11:46:49.959853 13020 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0226 11:46:49.959853 13020 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0226 11:46:49.959853 13020 kubeadm.go:322] - 'docker logs CONTAINERID'
I0226 11:46:49.959853 13020 kubeadm.go:406] StartCluster complete in 8m9.9810643s
I0226 11:46:49.973872 13020 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0226 11:46:50.032850 13020 logs.go:276] 0 containers: []
W0226 11:46:50.032850 13020 logs.go:278] No container was found matching "kube-apiserver"
I0226 11:46:50.045860 13020 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0226 11:46:50.109870 13020 logs.go:276] 0 containers: []
W0226 11:46:50.109870 13020 logs.go:278] No container was found matching "etcd"
I0226 11:46:50.121862 13020 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0226 11:46:50.178904 13020 logs.go:276] 0 containers: []
W0226 11:46:50.178904 13020 logs.go:278] No container was found matching "coredns"
I0226 11:46:50.194854 13020 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0226 11:46:50.245871 13020 logs.go:276] 0 containers: []
W0226 11:46:50.245871 13020 logs.go:278] No container was found matching "kube-scheduler"
I0226 11:46:50.258863 13020 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0226 11:46:50.324856 13020 logs.go:276] 0 containers: []
W0226 11:46:50.324856 13020 logs.go:278] No container was found matching "kube-proxy"
I0226 11:46:50.339856 13020 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0226 11:46:50.388884 13020 logs.go:276] 0 containers: []
W0226 11:46:50.388884 13020 logs.go:278] No container was found matching "kube-controller-manager"
I0226 11:46:50.406875 13020 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0226 11:46:50.458860 13020 logs.go:276] 0 containers: []
W0226 11:46:50.458860 13020 logs.go:278] No container was found matching "kindnet"
I0226 11:46:50.458860 13020 logs.go:123] Gathering logs for kubelet ...
I0226 11:46:50.458860 13020 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0226 11:46:50.513169 13020 logs.go:138] Found kubelet problem: Feb 26 11:46:27 old-k8s-version-321200 kubelet[5770]: E0226 11:46:27.311901 5770 pod_workers.go:191] Error syncing pod 6388f061f25c003b1a04f0626fa921d8 ("kube-apiserver-old-k8s-version-321200_kube-system(6388f061f25c003b1a04f0626fa921d8)"), skipping: failed to "StartContainer" for "kube-apiserver" with ImageInspectError: "Failed to inspect image \"k8s.gcr.io/kube-apiserver:v1.16.0\": Id or size of image \"k8s.gcr.io/kube-apiserver:v1.16.0\" is not set"
W0226 11:46:50.519181 13020 logs.go:138] Found kubelet problem: Feb 26 11:46:28 old-k8s-version-321200 kubelet[5770]: E0226 11:46:28.306593 5770 pod_workers.go:191] Error syncing pod 9fc427d2e6746d2b3f18846f6f0fcafb ("kube-controller-manager-old-k8s-version-321200_kube-system(9fc427d2e6746d2b3f18846f6f0fcafb)"), skipping: failed to "StartContainer" for "kube-controller-manager" with ImageInspectError: "Failed to inspect image \"k8s.gcr.io/kube-controller-manager:v1.16.0\": Id or size of image \"k8s.gcr.io/kube-controller-manager:v1.16.0\" is not set"
W0226 11:46:50.546168 13020 logs.go:138] Found kubelet problem: Feb 26 11:46:35 old-k8s-version-321200 kubelet[5770]: E0226 11:46:35.300820 5770 pod_workers.go:191] Error syncing pod b3d303074fe0ca1d42a8bd9ed248df09 ("kube-scheduler-old-k8s-version-321200_kube-system(b3d303074fe0ca1d42a8bd9ed248df09)"), skipping: failed to "StartContainer" for "kube-scheduler" with ImageInspectError: "Failed to inspect image \"k8s.gcr.io/kube-scheduler:v1.16.0\": Id or size of image \"k8s.gcr.io/kube-scheduler:v1.16.0\" is not set"
W0226 11:46:50.556174 13020 logs.go:138] Found kubelet problem: Feb 26 11:46:38 old-k8s-version-321200 kubelet[5770]: E0226 11:46:38.315402 5770 pod_workers.go:191] Error syncing pod 3409fb114a897785c2d1b6e0564bbb20 ("etcd-old-k8s-version-321200_kube-system(3409fb114a897785c2d1b6e0564bbb20)"), skipping: failed to "StartContainer" for "etcd" with ImageInspectError: "Failed to inspect image \"k8s.gcr.io/etcd:3.3.15-0\": Id or size of image \"k8s.gcr.io/etcd:3.3.15-0\" is not set"
W0226 11:46:50.564156 13020 logs.go:138] Found kubelet problem: Feb 26 11:46:40 old-k8s-version-321200 kubelet[5770]: E0226 11:46:40.314492 5770 pod_workers.go:191] Error syncing pod 9fc427d2e6746d2b3f18846f6f0fcafb ("kube-controller-manager-old-k8s-version-321200_kube-system(9fc427d2e6746d2b3f18846f6f0fcafb)"), skipping: failed to "StartContainer" for "kube-controller-manager" with ImageInspectError: "Failed to inspect image \"k8s.gcr.io/kube-controller-manager:v1.16.0\": Id or size of image \"k8s.gcr.io/kube-controller-manager:v1.16.0\" is not set"
W0226 11:46:50.569186 13020 logs.go:138] Found kubelet problem: Feb 26 11:46:41 old-k8s-version-321200 kubelet[5770]: E0226 11:46:41.306980 5770 pod_workers.go:191] Error syncing pod 6388f061f25c003b1a04f0626fa921d8 ("kube-apiserver-old-k8s-version-321200_kube-system(6388f061f25c003b1a04f0626fa921d8)"), skipping: failed to "StartContainer" for "kube-apiserver" with ImageInspectError: "Failed to inspect image \"k8s.gcr.io/kube-apiserver:v1.16.0\": Id or size of image \"k8s.gcr.io/kube-apiserver:v1.16.0\" is not set"
W0226 11:46:50.600156 13020 logs.go:138] Found kubelet problem: Feb 26 11:46:50 old-k8s-version-321200 kubelet[5770]: E0226 11:46:50.326095 5770 pod_workers.go:191] Error syncing pod b3d303074fe0ca1d42a8bd9ed248df09 ("kube-scheduler-old-k8s-version-321200_kube-system(b3d303074fe0ca1d42a8bd9ed248df09)"), skipping: failed to "StartContainer" for "kube-scheduler" with ImageInspectError: "Failed to inspect image \"k8s.gcr.io/kube-scheduler:v1.16.0\": Id or size of image \"k8s.gcr.io/kube-scheduler:v1.16.0\" is not set"
I0226 11:46:50.600156 13020 logs.go:123] Gathering logs for dmesg ...
I0226 11:46:50.600156 13020 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0226 11:46:50.635152 13020 logs.go:123] Gathering logs for describe nodes ...
I0226 11:46:50.635152 13020 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0226 11:46:50.795174 13020 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0226 11:46:50.795174 13020 logs.go:123] Gathering logs for Docker ...
I0226 11:46:50.796171 13020 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0226 11:46:50.840153 13020 logs.go:123] Gathering logs for container status ...
I0226 11:46:50.841159 13020 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0226 11:46:50.937163 13020 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0226 11:46:50.937163 13020 out.go:239] *
*
W0226 11:46:50.938162 13020 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0226 11:46:50.938162 13020 out.go:239] *
*
W0226 11:46:50.940156 13020 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0226 11:46:50.949185 13020 out.go:177] X Problems detected in kubelet:
I0226 11:46:50.957162 13020 out.go:177] Feb 26 11:46:27 old-k8s-version-321200 kubelet[5770]: E0226 11:46:27.311901 5770 pod_workers.go:191] Error syncing pod 6388f061f25c003b1a04f0626fa921d8 ("kube-apiserver-old-k8s-version-321200_kube-system(6388f061f25c003b1a04f0626fa921d8)"), skipping: failed to "StartContainer" for "kube-apiserver" with ImageInspectError: "Failed to inspect image \"k8s.gcr.io/kube-apiserver:v1.16.0\": Id or size of image \"k8s.gcr.io/kube-apiserver:v1.16.0\" is not set"
I0226 11:46:50.967174 13020 out.go:177] Feb 26 11:46:28 old-k8s-version-321200 kubelet[5770]: E0226 11:46:28.306593 5770 pod_workers.go:191] Error syncing pod 9fc427d2e6746d2b3f18846f6f0fcafb ("kube-controller-manager-old-k8s-version-321200_kube-system(9fc427d2e6746d2b3f18846f6f0fcafb)"), skipping: failed to "StartContainer" for "kube-controller-manager" with ImageInspectError: "Failed to inspect image \"k8s.gcr.io/kube-controller-manager:v1.16.0\": Id or size of image \"k8s.gcr.io/kube-controller-manager:v1.16.0\" is not set"
I0226 11:46:50.974167 13020 out.go:177] Feb 26 11:46:35 old-k8s-version-321200 kubelet[5770]: E0226 11:46:35.300820 5770 pod_workers.go:191] Error syncing pod b3d303074fe0ca1d42a8bd9ed248df09 ("kube-scheduler-old-k8s-version-321200_kube-system(b3d303074fe0ca1d42a8bd9ed248df09)"), skipping: failed to "StartContainer" for "kube-scheduler" with ImageInspectError: "Failed to inspect image \"k8s.gcr.io/kube-scheduler:v1.16.0\": Id or size of image \"k8s.gcr.io/kube-scheduler:v1.16.0\" is not set"
I0226 11:46:50.981157 13020 out.go:177]
W0226 11:46:50.983174 13020 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0226 11:46:50.984168 13020 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0226 11:46:50.984168 13020 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0226 11:46:50.989193 13020 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-windows-amd64.exe start -p old-k8s-version-321200 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-321200
helpers_test.go:235: (dbg) docker inspect old-k8s-version-321200:
-- stdout --
[
{
"Id": "9e96dc767099f65e5871d1cb57b92022dfc4f7638c23fd9cd5cfc972fc621242",
"Created": "2024-02-26T11:37:54.399460536Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 213973,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-02-26T11:37:55.093738611Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:78bbddd92c7656e5a7bf9651f59e6b47aa97241efd2e93247c457ec76b2185c5",
"ResolvConfPath": "/var/lib/docker/containers/9e96dc767099f65e5871d1cb57b92022dfc4f7638c23fd9cd5cfc972fc621242/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/9e96dc767099f65e5871d1cb57b92022dfc4f7638c23fd9cd5cfc972fc621242/hostname",
"HostsPath": "/var/lib/docker/containers/9e96dc767099f65e5871d1cb57b92022dfc4f7638c23fd9cd5cfc972fc621242/hosts",
"LogPath": "/var/lib/docker/containers/9e96dc767099f65e5871d1cb57b92022dfc4f7638c23fd9cd5cfc972fc621242/9e96dc767099f65e5871d1cb57b92022dfc4f7638c23fd9cd5cfc972fc621242-json.log",
"Name": "/old-k8s-version-321200",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-321200:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-321200",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/babf521722ae935ae85b94b9ef4c7966cf904617ca0e17bde085a8e31fdedd11-init/diff:/var/lib/docker/overlay2/a786c9685ff855515e3587508a6f2e6d7ddb83f4357560222dd23bc73e4b5ed1/diff",
"MergedDir": "/var/lib/docker/overlay2/babf521722ae935ae85b94b9ef4c7966cf904617ca0e17bde085a8e31fdedd11/merged",
"UpperDir": "/var/lib/docker/overlay2/babf521722ae935ae85b94b9ef4c7966cf904617ca0e17bde085a8e31fdedd11/diff",
"WorkDir": "/var/lib/docker/overlay2/babf521722ae935ae85b94b9ef4c7966cf904617ca0e17bde085a8e31fdedd11/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-321200",
"Source": "/var/lib/docker/volumes/old-k8s-version-321200/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-321200",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708008208-17936@sha256:4ea1136332ba1476cda33a97bf12e2f96995cc120674fbafd3ade22d1118ecdf",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-321200",
"name.minikube.sigs.k8s.io": "old-k8s-version-321200",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "9e04b780161b04981012972b68d9d29013b961dd206bbd400cf1ac47fbc23ac5",
"SandboxKey": "/var/run/docker/netns/9e04b780161b",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "53922"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "53923"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "53924"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "53920"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "53921"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-321200": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": [
"9e96dc767099",
"old-k8s-version-321200"
],
"MacAddress": "02:42:c0:a8:55:02",
"NetworkID": "3d8e32e292076657fa3147b08ea4473653a270d339de0a1d187a6074718ce682",
"EndpointID": "b8d4effe5d6ef0232e714e967b8757ec4a8fd16869940ba367ed00ad3d8a7ad3",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-321200",
"9e96dc767099"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-windows-amd64.exe status --format={{.Host}} -p old-k8s-version-321200 -n old-k8s-version-321200
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.Host}} -p old-k8s-version-321200 -n old-k8s-version-321200: exit status 6 (1.4500561s)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
W0226 11:46:52.079577 3044 main.go:291] Unable to resolve the current Docker CLI context "default": context "default": context not found: open C:\Users\jenkins.minikube7\.docker\contexts\meta\37a8eec1ce19687d132fe29051dca629d164e2c4958ba141d5f4133a33f0688f\meta.json: The system cannot find the path specified.
E0226 11:46:53.281656 3044 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-321200" does not appear in C:\Users\jenkins.minikube7\minikube-integration\kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-321200" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (565.91s)