=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-20220629183430-3015 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
E0629 18:34:58.597695 3015 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/auto-20220629181751-3015/client.crt: no such file or directory
E0629 18:34:58.603723 3015 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/auto-20220629181751-3015/client.crt: no such file or directory
E0629 18:34:58.614314 3015 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/auto-20220629181751-3015/client.crt: no such file or directory
E0629 18:34:58.635251 3015 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/auto-20220629181751-3015/client.crt: no such file or directory
E0629 18:34:58.675382 3015 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/auto-20220629181751-3015/client.crt: no such file or directory
E0629 18:34:58.757592 3015 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/auto-20220629181751-3015/client.crt: no such file or directory
E0629 18:34:58.917744 3015 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/auto-20220629181751-3015/client.crt: no such file or directory
E0629 18:34:59.239567 3015 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/auto-20220629181751-3015/client.crt: no such file or directory
E0629 18:34:59.881155 3015 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/auto-20220629181751-3015/client.crt: no such file or directory
E0629 18:35:01.161338 3015 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/auto-20220629181751-3015/client.crt: no such file or directory
E0629 18:35:03.723116 3015 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/auto-20220629181751-3015/client.crt: no such file or directory
E0629 18:35:08.843530 3015 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/auto-20220629181751-3015/client.crt: no such file or directory
E0629 18:35:19.084483 3015 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/auto-20220629181751-3015/client.crt: no such file or directory
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-20220629183430-3015 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m9.912005985s)
-- stdout --
* [old-k8s-version-20220629183430-3015] minikube v1.26.0 on Darwin 12.4
- MINIKUBE_LOCATION=14420
- KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node old-k8s-version-20220629183430-3015 in cluster old-k8s-version-20220629183430-3015
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 20.10.17 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0629 18:34:30.910166 16380 out.go:296] Setting OutFile to fd 1 ...
I0629 18:34:30.910358 16380 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0629 18:34:30.910363 16380 out.go:309] Setting ErrFile to fd 2...
I0629 18:34:30.910367 16380 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0629 18:34:30.910675 16380 root.go:329] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/bin
I0629 18:34:30.910988 16380 out.go:303] Setting JSON to false
I0629 18:34:30.926966 16380 start.go:115] hostinfo: {"hostname":"MacOS-Agent-3.local","uptime":3825,"bootTime":1656549045,"procs":348,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"12.4","kernelVersion":"21.5.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}
W0629 18:34:30.927069 16380 start.go:123] gopshost.Virtualization returned error: not implemented yet
I0629 18:34:30.948785 16380 out.go:177] * [old-k8s-version-20220629183430-3015] minikube v1.26.0 on Darwin 12.4
I0629 18:34:30.990840 16380 notify.go:193] Checking for updates...
I0629 18:34:31.011514 16380 out.go:177] - MINIKUBE_LOCATION=14420
I0629 18:34:31.032758 16380 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/kubeconfig
I0629 18:34:31.053947 16380 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0629 18:34:31.075565 16380 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0629 18:34:31.096807 16380 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube
I0629 18:34:31.118150 16380 config.go:178] Loaded profile config "kubenet-20220629181751-3015": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.2
I0629 18:34:31.118205 16380 driver.go:360] Setting default libvirt URI to qemu:///system
I0629 18:34:31.190522 16380 docker.go:137] docker version: linux-20.10.16
I0629 18:34:31.190673 16380 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0629 18:34:31.320024 16380 info.go:265] docker info: {ID:3Y52:WJCE:UNMS:TER6:BW7U:J6A4:TK46:JAOG:XDT6:U6ZW:PJDA:VZHB Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:51 SystemTime:2022-06-30 01:34:31.265934932 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.16 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0629 18:34:31.341851 16380 out.go:177] * Using the docker driver based on user configuration
I0629 18:34:31.362766 16380 start.go:284] selected driver: docker
I0629 18:34:31.362807 16380 start.go:808] validating driver "docker" against <nil>
I0629 18:34:31.362836 16380 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0629 18:34:31.366076 16380 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0629 18:34:31.493048 16380 info.go:265] docker info: {ID:3Y52:WJCE:UNMS:TER6:BW7U:J6A4:TK46:JAOG:XDT6:U6ZW:PJDA:VZHB Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:51 SystemTime:2022-06-30 01:34:31.439002165 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.16 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0629 18:34:31.493193 16380 start_flags.go:296] no existing cluster config was found, will generate one from the flags
I0629 18:34:31.493426 16380 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0629 18:34:31.515216 16380 out.go:177] * Using Docker Desktop driver with root privileges
I0629 18:34:31.536025 16380 cni.go:95] Creating CNI manager for ""
I0629 18:34:31.536060 16380 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0629 18:34:31.536075 16380 start_flags.go:310] config:
{Name:old-k8s-version-20220629183430-3015 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220629183430-3015 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDom
ain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0629 18:34:31.558206 16380 out.go:177] * Starting control plane node old-k8s-version-20220629183430-3015 in cluster old-k8s-version-20220629183430-3015
I0629 18:34:31.602017 16380 cache.go:120] Beginning downloading kic base image for docker with docker
I0629 18:34:31.622847 16380 out.go:177] * Pulling base image ...
I0629 18:34:31.664704 16380 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0629 18:34:31.664709 16380 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
I0629 18:34:31.664756 16380 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0629 18:34:31.664772 16380 cache.go:57] Caching tarball of preloaded images
I0629 18:34:31.664895 16380 preload.go:174] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0629 18:34:31.664907 16380 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0629 18:34:31.665456 16380 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/config.json ...
I0629 18:34:31.665529 16380 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/config.json: {Name:mke71bb024f92f667128d4280cdae5438ed7dc53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0629 18:34:31.729775 16380 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
I0629 18:34:31.729799 16380 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
I0629 18:34:31.729811 16380 cache.go:208] Successfully downloaded all kic artifacts
I0629 18:34:31.729856 16380 start.go:352] acquiring machines lock for old-k8s-version-20220629183430-3015: {Name:mkfd84759ea136c12e41f1c5f034d72c01cef973 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0629 18:34:31.730006 16380 start.go:356] acquired machines lock for "old-k8s-version-20220629183430-3015" in 137.703µs
I0629 18:34:31.730041 16380 start.go:91] Provisioning new machine with config: &{Name:old-k8s-version-20220629183430-3015 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220629183430-3015 N
amespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirr
or: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0629 18:34:31.730108 16380 start.go:131] createHost starting for "" (driver="docker")
I0629 18:34:31.755913 16380 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0629 18:34:31.756295 16380 start.go:165] libmachine.API.Create for "old-k8s-version-20220629183430-3015" (driver="docker")
I0629 18:34:31.756352 16380 client.go:168] LocalClient.Create starting
I0629 18:34:31.756509 16380 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/ca.pem
I0629 18:34:31.756577 16380 main.go:134] libmachine: Decoding PEM data...
I0629 18:34:31.756603 16380 main.go:134] libmachine: Parsing certificate...
I0629 18:34:31.756712 16380 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/cert.pem
I0629 18:34:31.756773 16380 main.go:134] libmachine: Decoding PEM data...
I0629 18:34:31.756794 16380 main.go:134] libmachine: Parsing certificate...
I0629 18:34:31.757549 16380 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220629183430-3015 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0629 18:34:31.833385 16380 cli_runner.go:211] docker network inspect old-k8s-version-20220629183430-3015 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0629 18:34:31.833471 16380 network_create.go:272] running [docker network inspect old-k8s-version-20220629183430-3015] to gather additional debugging logs...
I0629 18:34:31.833491 16380 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220629183430-3015
W0629 18:34:31.898651 16380 cli_runner.go:211] docker network inspect old-k8s-version-20220629183430-3015 returned with exit code 1
I0629 18:34:31.898680 16380 network_create.go:275] error running [docker network inspect old-k8s-version-20220629183430-3015]: docker network inspect old-k8s-version-20220629183430-3015: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-20220629183430-3015
I0629 18:34:31.898697 16380 network_create.go:277] output of [docker network inspect old-k8s-version-20220629183430-3015]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-20220629183430-3015
** /stderr **
I0629 18:34:31.898796 16380 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0629 18:34:31.961771 16380 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc000aa8db0] misses:0}
I0629 18:34:31.961807 16380 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0629 18:34:31.961826 16380 network_create.go:115] attempt to create docker network old-k8s-version-20220629183430-3015 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0629 18:34:31.961890 16380 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220629183430-3015 old-k8s-version-20220629183430-3015
W0629 18:34:32.028106 16380 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220629183430-3015 old-k8s-version-20220629183430-3015 returned with exit code 1
W0629 18:34:32.028153 16380 network_create.go:107] failed to create docker network old-k8s-version-20220629183430-3015 192.168.49.0/24, will retry: subnet is taken
I0629 18:34:32.028440 16380 network.go:279] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000aa8db0] amended:false}} dirty:map[] misses:0}
I0629 18:34:32.028456 16380 network.go:238] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0629 18:34:32.028653 16380 network.go:288] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000aa8db0] amended:true}} dirty:map[192.168.49.0:0xc000aa8db0 192.168.58.0:0xc000136ee8] misses:0}
I0629 18:34:32.028664 16380 network.go:235] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0629 18:34:32.028671 16380 network_create.go:115] attempt to create docker network old-k8s-version-20220629183430-3015 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I0629 18:34:32.028733 16380 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220629183430-3015 old-k8s-version-20220629183430-3015
W0629 18:34:32.093668 16380 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220629183430-3015 old-k8s-version-20220629183430-3015 returned with exit code 1
W0629 18:34:32.093721 16380 network_create.go:107] failed to create docker network old-k8s-version-20220629183430-3015 192.168.58.0/24, will retry: subnet is taken
I0629 18:34:32.093981 16380 network.go:279] skipping subnet 192.168.58.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000aa8db0] amended:true}} dirty:map[192.168.49.0:0xc000aa8db0 192.168.58.0:0xc000136ee8] misses:1}
I0629 18:34:32.093995 16380 network.go:238] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0629 18:34:32.094207 16380 network.go:288] reserving subnet 192.168.67.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000aa8db0] amended:true}} dirty:map[192.168.49.0:0xc000aa8db0 192.168.58.0:0xc000136ee8 192.168.67.0:0xc000d3e230] misses:1}
I0629 18:34:32.094222 16380 network.go:235] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0629 18:34:32.094231 16380 network_create.go:115] attempt to create docker network old-k8s-version-20220629183430-3015 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I0629 18:34:32.094292 16380 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220629183430-3015 old-k8s-version-20220629183430-3015
W0629 18:34:32.157163 16380 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220629183430-3015 old-k8s-version-20220629183430-3015 returned with exit code 1
W0629 18:34:32.157200 16380 network_create.go:107] failed to create docker network old-k8s-version-20220629183430-3015 192.168.67.0/24, will retry: subnet is taken
I0629 18:34:32.157447 16380 network.go:279] skipping subnet 192.168.67.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000aa8db0] amended:true}} dirty:map[192.168.49.0:0xc000aa8db0 192.168.58.0:0xc000136ee8 192.168.67.0:0xc000d3e230] misses:2}
I0629 18:34:32.157466 16380 network.go:238] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0629 18:34:32.157662 16380 network.go:288] reserving subnet 192.168.76.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000aa8db0] amended:true}} dirty:map[192.168.49.0:0xc000aa8db0 192.168.58.0:0xc000136ee8 192.168.67.0:0xc000d3e230 192.168.76.0:0xc000fa4058] misses:2}
I0629 18:34:32.157674 16380 network.go:235] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0629 18:34:32.157681 16380 network_create.go:115] attempt to create docker network old-k8s-version-20220629183430-3015 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0629 18:34:32.157760 16380 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220629183430-3015 old-k8s-version-20220629183430-3015
I0629 18:34:32.256868 16380 network_create.go:99] docker network old-k8s-version-20220629183430-3015 192.168.76.0/24 created
I0629 18:34:32.257091 16380 kic.go:106] calculated static IP "192.168.76.2" for the "old-k8s-version-20220629183430-3015" container
I0629 18:34:32.257178 16380 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0629 18:34:32.330673 16380 cli_runner.go:164] Run: docker volume create old-k8s-version-20220629183430-3015 --label name.minikube.sigs.k8s.io=old-k8s-version-20220629183430-3015 --label created_by.minikube.sigs.k8s.io=true
I0629 18:34:32.398116 16380 oci.go:103] Successfully created a docker volume old-k8s-version-20220629183430-3015
I0629 18:34:32.398415 16380 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-20220629183430-3015-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220629183430-3015 --entrypoint /usr/bin/test -v old-k8s-version-20220629183430-3015:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -d /var/lib
I0629 18:34:32.898926 16380 oci.go:107] Successfully prepared a docker volume old-k8s-version-20220629183430-3015
I0629 18:34:32.899075 16380 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0629 18:34:32.899090 16380 kic.go:179] Starting extracting preloaded images to volume ...
I0629 18:34:32.899186 16380 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220629183430-3015:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir
I0629 18:34:37.312362 16380 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220629183430-3015:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir: (4.4129696s)
I0629 18:34:37.312431 16380 kic.go:188] duration metric: took 4.413240 seconds to extract preloaded images to volume
I0629 18:34:37.312574 16380 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0629 18:34:37.443398 16380 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-20220629183430-3015 --name old-k8s-version-20220629183430-3015 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220629183430-3015 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-20220629183430-3015 --network old-k8s-version-20220629183430-3015 --ip 192.168.76.2 --volume old-k8s-version-20220629183430-3015:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=8443 --publish=22 --publish=2376 --publish=5000 --publish=32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e
I0629 18:34:37.875384 16380 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220629183430-3015 --format={{.State.Running}}
I0629 18:34:37.956240 16380 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220629183430-3015 --format={{.State.Status}}
I0629 18:34:38.038781 16380 cli_runner.go:164] Run: docker exec old-k8s-version-20220629183430-3015 stat /var/lib/dpkg/alternatives/iptables
I0629 18:34:38.176817 16380 oci.go:144] the created container "old-k8s-version-20220629183430-3015" has a running status.
I0629 18:34:38.176849 16380 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/machines/old-k8s-version-20220629183430-3015/id_rsa...
I0629 18:34:38.277266 16380 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/machines/old-k8s-version-20220629183430-3015/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0629 18:34:38.400429 16380 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220629183430-3015 --format={{.State.Status}}
I0629 18:34:38.477498 16380 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0629 18:34:38.477520 16380 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-20220629183430-3015 chown docker:docker /home/docker/.ssh/authorized_keys]
I0629 18:34:38.603910 16380 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220629183430-3015 --format={{.State.Status}}
I0629 18:34:38.678059 16380 machine.go:88] provisioning docker machine ...
I0629 18:34:38.678155 16380 ubuntu.go:169] provisioning hostname "old-k8s-version-20220629183430-3015"
I0629 18:34:38.678374 16380 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629183430-3015
I0629 18:34:38.755228 16380 main.go:134] libmachine: Using SSH client type: native
I0629 18:34:38.755478 16380 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2d60] 0x13d5dc0 <nil> [] 0s} 127.0.0.1 61007 <nil> <nil>}
I0629 18:34:38.755494 16380 main.go:134] libmachine: About to run SSH command:
sudo hostname old-k8s-version-20220629183430-3015 && echo "old-k8s-version-20220629183430-3015" | sudo tee /etc/hostname
I0629 18:34:38.882146 16380 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-20220629183430-3015
I0629 18:34:38.882246 16380 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629183430-3015
I0629 18:34:38.962565 16380 main.go:134] libmachine: Using SSH client type: native
I0629 18:34:38.962740 16380 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2d60] 0x13d5dc0 <nil> [] 0s} 127.0.0.1 61007 <nil> <nil>}
I0629 18:34:38.962757 16380 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-20220629183430-3015' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-20220629183430-3015/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-20220629183430-3015' | sudo tee -a /etc/hosts;
fi
fi
I0629 18:34:39.079651 16380 main.go:134] libmachine: SSH cmd err, output: <nil>:
I0629 18:34:39.079673 16380 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/se
rver.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube}
I0629 18:34:39.079698 16380 ubuntu.go:177] setting up certificates
I0629 18:34:39.079706 16380 provision.go:83] configureAuth start
I0629 18:34:39.079770 16380 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220629183430-3015
I0629 18:34:39.153266 16380 provision.go:138] copyHostCerts
I0629 18:34:39.153365 16380 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/ca.pem, removing ...
I0629 18:34:39.153374 16380 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/ca.pem
I0629 18:34:39.153474 16380 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/ca.pem (1078 bytes)
I0629 18:34:39.153660 16380 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/cert.pem, removing ...
I0629 18:34:39.153668 16380 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/cert.pem
I0629 18:34:39.153727 16380 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/cert.pem (1123 bytes)
I0629 18:34:39.153910 16380 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/key.pem, removing ...
I0629 18:34:39.153916 16380 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/key.pem
I0629 18:34:39.153975 16380 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/key.pem (1679 bytes)
I0629 18:34:39.154098 16380 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-20220629183430-3015 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-20220629183430-3015]
I0629 18:34:39.295076 16380 provision.go:172] copyRemoteCerts
I0629 18:34:39.295134 16380 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0629 18:34:39.295209 16380 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629183430-3015
I0629 18:34:39.368537 16380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:61007 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/machines/old-k8s-version-20220629183430-3015/id_rsa Username:docker}
I0629 18:34:39.455271 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0629 18:34:39.473781 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/machines/server.pem --> /etc/docker/server.pem (1277 bytes)
I0629 18:34:39.491579 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0629 18:34:39.509067 16380 provision.go:86] duration metric: configureAuth took 429.340456ms
I0629 18:34:39.509080 16380 ubuntu.go:193] setting minikube options for container-runtime
I0629 18:34:39.509212 16380 config.go:178] Loaded profile config "old-k8s-version-20220629183430-3015": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0629 18:34:39.509263 16380 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629183430-3015
I0629 18:34:39.585642 16380 main.go:134] libmachine: Using SSH client type: native
I0629 18:34:39.585794 16380 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2d60] 0x13d5dc0 <nil> [] 0s} 127.0.0.1 61007 <nil> <nil>}
I0629 18:34:39.585812 16380 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0629 18:34:39.705935 16380 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I0629 18:34:39.705956 16380 ubuntu.go:71] root file system type: overlay
I0629 18:34:39.706105 16380 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0629 18:34:39.706181 16380 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629183430-3015
I0629 18:34:39.780549 16380 main.go:134] libmachine: Using SSH client type: native
I0629 18:34:39.780743 16380 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2d60] 0x13d5dc0 <nil> [] 0s} 127.0.0.1 61007 <nil> <nil>}
I0629 18:34:39.780800 16380 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0629 18:34:39.910184 16380 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0629 18:34:39.910278 16380 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629183430-3015
I0629 18:34:39.984140 16380 main.go:134] libmachine: Using SSH client type: native
I0629 18:34:39.984312 16380 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2d60] 0x13d5dc0 <nil> [] 0s} 127.0.0.1 61007 <nil> <nil>}
I0629 18:34:39.984326 16380 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0629 18:34:40.615913 16380 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-06-06 23:01:03.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2022-06-30 01:34:39.927761044 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0629 18:34:40.615935 16380 machine.go:91] provisioned docker machine in 1.937812428s
I0629 18:34:40.615941 16380 client.go:171] LocalClient.Create took 8.859380326s
I0629 18:34:40.615961 16380 start.go:173] duration metric: libmachine.API.Create for "old-k8s-version-20220629183430-3015" took 8.859467875s
I0629 18:34:40.615970 16380 start.go:306] post-start starting for "old-k8s-version-20220629183430-3015" (driver="docker")
I0629 18:34:40.615975 16380 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0629 18:34:40.616047 16380 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0629 18:34:40.616100 16380 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629183430-3015
I0629 18:34:40.694605 16380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:61007 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/machines/old-k8s-version-20220629183430-3015/id_rsa Username:docker}
I0629 18:34:40.781293 16380 ssh_runner.go:195] Run: cat /etc/os-release
I0629 18:34:40.785057 16380 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0629 18:34:40.785073 16380 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0629 18:34:40.785080 16380 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0629 18:34:40.785084 16380 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0629 18:34:40.785095 16380 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/addons for local assets ...
I0629 18:34:40.785212 16380 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/files for local assets ...
I0629 18:34:40.785368 16380 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/files/etc/ssl/certs/30152.pem -> 30152.pem in /etc/ssl/certs
I0629 18:34:40.785530 16380 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0629 18:34:40.793189 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/files/etc/ssl/certs/30152.pem --> /etc/ssl/certs/30152.pem (1708 bytes)
I0629 18:34:40.811591 16380 start.go:309] post-start completed in 195.607531ms
I0629 18:34:40.812179 16380 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220629183430-3015
I0629 18:34:40.886848 16380 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/config.json ...
I0629 18:34:40.887255 16380 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0629 18:34:40.887299 16380 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629183430-3015
I0629 18:34:40.963570 16380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:61007 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/machines/old-k8s-version-20220629183430-3015/id_rsa Username:docker}
I0629 18:34:41.046782 16380 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0629 18:34:41.051522 16380 start.go:134] duration metric: createHost completed in 9.321193266s
I0629 18:34:41.051544 16380 start.go:81] releasing machines lock for "old-k8s-version-20220629183430-3015", held for 9.321317904s
I0629 18:34:41.051623 16380 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220629183430-3015
I0629 18:34:41.127542 16380 ssh_runner.go:195] Run: systemctl --version
I0629 18:34:41.127555 16380 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0629 18:34:41.127627 16380 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629183430-3015
I0629 18:34:41.127630 16380 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629183430-3015
I0629 18:34:41.211128 16380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:61007 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/machines/old-k8s-version-20220629183430-3015/id_rsa Username:docker}
I0629 18:34:41.214219 16380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:61007 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/machines/old-k8s-version-20220629183430-3015/id_rsa Username:docker}
I0629 18:34:41.770499 16380 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0629 18:34:41.779941 16380 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0629 18:34:41.780003 16380 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0629 18:34:41.788923 16380 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0629 18:34:41.801278 16380 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0629 18:34:41.867064 16380 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0629 18:34:41.939209 16380 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0629 18:34:42.007001 16380 ssh_runner.go:195] Run: sudo systemctl restart docker
I0629 18:34:42.232431 16380 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0629 18:34:42.268045 16380 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0629 18:34:42.349866 16380 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 20.10.17 ...
I0629 18:34:42.350032 16380 cli_runner.go:164] Run: docker exec -t old-k8s-version-20220629183430-3015 dig +short host.docker.internal
I0629 18:34:42.476041 16380 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0629 18:34:42.476141 16380 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0629 18:34:42.480280 16380 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0629 18:34:42.490120 16380 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-20220629183430-3015
I0629 18:34:42.562644 16380 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0629 18:34:42.562730 16380 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0629 18:34:42.593114 16380 docker.go:602] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0629 18:34:42.593131 16380 docker.go:533] Images already preloaded, skipping extraction
I0629 18:34:42.593207 16380 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0629 18:34:42.622992 16380 docker.go:602] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0629 18:34:42.623013 16380 cache_images.go:84] Images are preloaded, skipping loading
I0629 18:34:42.623081 16380 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0629 18:34:42.702153 16380 cni.go:95] Creating CNI manager for ""
I0629 18:34:42.702166 16380 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0629 18:34:42.702184 16380 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0629 18:34:42.702211 16380 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-20220629183430-3015 NodeName:old-k8s-version-20220629183430-3015 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.76.2 CgroupDriver:systemd ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I0629 18:34:42.702359 16380 kubeadm.go:162] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-20220629183430-3015"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-20220629183430-3015
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.76.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0629 18:34:42.702442 16380 kubeadm.go:961] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-20220629183430-3015 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220629183430-3015 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0629 18:34:42.702486 16380 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0629 18:34:42.710922 16380 binaries.go:44] Found k8s binaries, skipping transfer
I0629 18:34:42.710981 16380 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0629 18:34:42.717961 16380 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (361 bytes)
I0629 18:34:42.730646 16380 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0629 18:34:42.743618 16380 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2146 bytes)
I0629 18:34:42.756678 16380 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0629 18:34:42.760461 16380 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0629 18:34:42.770088 16380 certs.go:54] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015 for IP: 192.168.76.2
I0629 18:34:42.770189 16380 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/ca.key
I0629 18:34:42.770234 16380 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/proxy-client-ca.key
I0629 18:34:42.770276 16380 certs.go:302] generating minikube-user signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/client.key
I0629 18:34:42.770288 16380 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/client.crt with IP's: []
I0629 18:34:42.973524 16380 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/client.crt ...
I0629 18:34:42.973542 16380 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/client.crt: {Name:mka09d7eba47c42888c10356e993b0ec1b9da128 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0629 18:34:42.976828 16380 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/client.key ...
I0629 18:34:42.976852 16380 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/client.key: {Name:mk385a44f1850cb20c41510d60cf395f66e023eb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0629 18:34:42.977147 16380 certs.go:302] generating minikube signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/apiserver.key.31bdca25
I0629 18:34:42.977167 16380 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/apiserver.crt.31bdca25 with IP's: [192.168.76.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0629 18:34:43.038613 16380 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/apiserver.crt.31bdca25 ...
I0629 18:34:43.038626 16380 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/apiserver.crt.31bdca25: {Name:mkebe13d6b4d09ecc03f8e6196c07a1860a04b0b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0629 18:34:43.038899 16380 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/apiserver.key.31bdca25 ...
I0629 18:34:43.038908 16380 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/apiserver.key.31bdca25: {Name:mk8155e180759a0346b5f6f45dbb6be81290e295 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0629 18:34:43.039105 16380 certs.go:320] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/apiserver.crt.31bdca25 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/apiserver.crt
I0629 18:34:43.039310 16380 certs.go:324] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/apiserver.key.31bdca25 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/apiserver.key
I0629 18:34:43.039469 16380 certs.go:302] generating aggregator signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/proxy-client.key
I0629 18:34:43.039483 16380 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/proxy-client.crt with IP's: []
I0629 18:34:43.096717 16380 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/proxy-client.crt ...
I0629 18:34:43.096724 16380 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/proxy-client.crt: {Name:mkf7c02d596e45b7c4b2610fdc6d0a25adcfb65f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0629 18:34:43.096916 16380 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/proxy-client.key ...
I0629 18:34:43.096923 16380 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/proxy-client.key: {Name:mk963e5e696aa151d5288026d5be03ebda64366e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0629 18:34:43.097302 16380 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/3015.pem (1338 bytes)
W0629 18:34:43.097343 16380 certs.go:384] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/3015_empty.pem, impossibly tiny 0 bytes
I0629 18:34:43.097353 16380 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/ca-key.pem (1679 bytes)
I0629 18:34:43.097383 16380 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/ca.pem (1078 bytes)
I0629 18:34:43.097416 16380 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/cert.pem (1123 bytes)
I0629 18:34:43.097446 16380 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/key.pem (1679 bytes)
I0629 18:34:43.097516 16380 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/files/etc/ssl/certs/30152.pem (1708 bytes)
I0629 18:34:43.098003 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0629 18:34:43.116448 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0629 18:34:43.134209 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0629 18:34:43.150909 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/profiles/old-k8s-version-20220629183430-3015/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0629 18:34:43.167722 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0629 18:34:43.184177 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0629 18:34:43.200691 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0629 18:34:43.218475 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0629 18:34:43.237755 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0629 18:34:43.257168 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/certs/3015.pem --> /usr/share/ca-certificates/3015.pem (1338 bytes)
I0629 18:34:43.273621 16380 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/.minikube/files/etc/ssl/certs/30152.pem --> /usr/share/ca-certificates/30152.pem (1708 bytes)
I0629 18:34:43.290235 16380 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0629 18:34:43.302772 16380 ssh_runner.go:195] Run: openssl version
I0629 18:34:43.307869 16380 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0629 18:34:43.316187 16380 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0629 18:34:43.321105 16380 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 30 00:36 /usr/share/ca-certificates/minikubeCA.pem
I0629 18:34:43.321158 16380 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0629 18:34:43.326413 16380 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0629 18:34:43.334051 16380 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3015.pem && ln -fs /usr/share/ca-certificates/3015.pem /etc/ssl/certs/3015.pem"
I0629 18:34:43.341461 16380 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3015.pem
I0629 18:34:43.345206 16380 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 30 00:40 /usr/share/ca-certificates/3015.pem
I0629 18:34:43.345255 16380 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3015.pem
I0629 18:34:43.350087 16380 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/3015.pem /etc/ssl/certs/51391683.0"
I0629 18:34:43.357621 16380 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/30152.pem && ln -fs /usr/share/ca-certificates/30152.pem /etc/ssl/certs/30152.pem"
I0629 18:34:43.365723 16380 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/30152.pem
I0629 18:34:43.369526 16380 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 30 00:40 /usr/share/ca-certificates/30152.pem
I0629 18:34:43.369580 16380 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/30152.pem
I0629 18:34:43.374799 16380 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/30152.pem /etc/ssl/certs/3ec20f2e.0"
I0629 18:34:43.382733 16380 kubeadm.go:395] StartCluster: {Name:old-k8s-version-20220629183430-3015 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220629183430-3015 Namespace:default APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disabl
eOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0629 18:34:43.382830 16380 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0629 18:34:43.411581 16380 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0629 18:34:43.419197 16380 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0629 18:34:43.426468 16380 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0629 18:34:43.426515 16380 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0629 18:34:43.433730 16380 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0629 18:34:43.433755 16380 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0629 18:34:44.151791 16380 out.go:204] - Generating certificates and keys ...
I0629 18:34:46.449854 16380 out.go:204] - Booting up control plane ...
W0629 18:36:41.388533 16380 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220629183430-3015 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220629183430-3015 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220629183430-3015 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220629183430-3015 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0629 18:36:41.388565 16380 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0629 18:36:41.811915 16380 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0629 18:36:41.821255 16380 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0629 18:36:41.821299 16380 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0629 18:36:41.828592 16380 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0629 18:36:41.828611 16380 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0629 18:36:42.607792 16380 out.go:204] - Generating certificates and keys ...
I0629 18:36:43.218789 16380 out.go:204] - Booting up control plane ...
I0629 18:38:38.135959 16380 kubeadm.go:397] StartCluster complete in 3m54.747937535s
I0629 18:38:38.136039 16380 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0629 18:38:38.170511 16380 logs.go:274] 0 containers: []
W0629 18:38:38.170523 16380 logs.go:276] No container was found matching "kube-apiserver"
I0629 18:38:38.170585 16380 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0629 18:38:38.198668 16380 logs.go:274] 0 containers: []
W0629 18:38:38.198681 16380 logs.go:276] No container was found matching "etcd"
I0629 18:38:38.198738 16380 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0629 18:38:38.227319 16380 logs.go:274] 0 containers: []
W0629 18:38:38.227332 16380 logs.go:276] No container was found matching "coredns"
I0629 18:38:38.227389 16380 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0629 18:38:38.257054 16380 logs.go:274] 0 containers: []
W0629 18:38:38.257067 16380 logs.go:276] No container was found matching "kube-scheduler"
I0629 18:38:38.257123 16380 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0629 18:38:38.285450 16380 logs.go:274] 0 containers: []
W0629 18:38:38.285463 16380 logs.go:276] No container was found matching "kube-proxy"
I0629 18:38:38.285525 16380 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0629 18:38:38.313117 16380 logs.go:274] 0 containers: []
W0629 18:38:38.313129 16380 logs.go:276] No container was found matching "kubernetes-dashboard"
I0629 18:38:38.313187 16380 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0629 18:38:38.342623 16380 logs.go:274] 0 containers: []
W0629 18:38:38.342634 16380 logs.go:276] No container was found matching "storage-provisioner"
I0629 18:38:38.342690 16380 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0629 18:38:38.370862 16380 logs.go:274] 0 containers: []
W0629 18:38:38.370874 16380 logs.go:276] No container was found matching "kube-controller-manager"
I0629 18:38:38.370881 16380 logs.go:123] Gathering logs for describe nodes ...
I0629 18:38:38.370888 16380 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0629 18:38:38.426185 16380 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0629 18:38:38.426197 16380 logs.go:123] Gathering logs for Docker ...
I0629 18:38:38.426207 16380 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0629 18:38:38.441845 16380 logs.go:123] Gathering logs for container status ...
I0629 18:38:38.441857 16380 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0629 18:38:40.494663 16380 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.052748319s)
I0629 18:38:40.494794 16380 logs.go:123] Gathering logs for kubelet ...
I0629 18:38:40.494802 16380 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0629 18:38:40.533154 16380 logs.go:123] Gathering logs for dmesg ...
I0629 18:38:40.533168 16380 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
W0629 18:38:40.544807 16380 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0629 18:38:40.544825 16380 out.go:239] *
*
W0629 18:38:40.544932 16380 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0629 18:38:40.544945 16380 out.go:239] *
*
W0629 18:38:40.545461 16380 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0629 18:38:40.608395 16380 out.go:177]
W0629 18:38:40.651159 16380 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0629 18:38:40.651236 16380 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0629 18:38:40.651282 16380 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0629 18:38:40.693227 16380 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-20220629183430-3015 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-20220629183430-3015
helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220629183430-3015:
-- stdout --
[
{
"Id": "8f033eea5d59b0e84fe4c11707932d611772f6d73a082d67d3209e901d6af59e",
"Created": "2022-06-30T01:34:37.559858102Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 230471,
"ExitCode": 0,
"Error": "",
"StartedAt": "2022-06-30T01:34:37.883077296Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
"ResolvConfPath": "/var/lib/docker/containers/8f033eea5d59b0e84fe4c11707932d611772f6d73a082d67d3209e901d6af59e/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/8f033eea5d59b0e84fe4c11707932d611772f6d73a082d67d3209e901d6af59e/hostname",
"HostsPath": "/var/lib/docker/containers/8f033eea5d59b0e84fe4c11707932d611772f6d73a082d67d3209e901d6af59e/hosts",
"LogPath": "/var/lib/docker/containers/8f033eea5d59b0e84fe4c11707932d611772f6d73a082d67d3209e901d6af59e/8f033eea5d59b0e84fe4c11707932d611772f6d73a082d67d3209e901d6af59e-json.log",
"Name": "/old-k8s-version-20220629183430-3015",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-20220629183430-3015:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-20220629183430-3015",
"PortBindings": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/26dd7ddc1f8f0d8c472f7603550b38e34e3f1ef35ad43919b82261a5a5a40b0f-init/diff:/var/lib/docker/overlay2/e20e5999531046d81a7a0158ae03456bc1c0e8473e0c44ef984117ae0441799b/diff:/var/lib/docker/overlay2/a18251d65a92e93187c11839d8deb01ecabf37ae29488fee8b85b6569dce6860/diff:/var/lib/docker/overlay2/e6dd4617b3e71759006a77b59e84b9c0da9205f06ede5dc1583ebb865862ba65/diff:/var/lib/docker/overlay2/f84e2927b2024117d577c83228f3c4c681f84961925dad5b588e3137dec289d4/diff:/var/lib/docker/overlay2/39b88de7fbefdc039aced46c7304c5da3a177582e456cbf2f8772e05299b7efb/diff:/var/lib/docker/overlay2/5ee783cd109eaba17d5581f4f889a11c5090b096b936633f60d65defc2821344/diff:/var/lib/docker/overlay2/c8d7aa2ef70b0a8cdd5d6338d200075d47100c81eaf27a1dceb56eb78575d7d0/diff:/var/lib/docker/overlay2/1bd4bdbef6d550b1c439b74057431472f862bbb374c0426445cf454dd056bf9e/diff:/var/lib/docker/overlay2/2a776a08be1b4581ad9b37c7ad4b91790cfa3975d3b8d3ba6688730553a50093/diff:/var/lib/docker/overlay2/c66415
6631551e7ed7c6e22e59aea7d24d523fa0c5ab8335848218c83eeccdfe/diff:/var/lib/docker/overlay2/262428fc2e1defc2b2d0f7f93c232935c950c38ea43ee74cb86db2910774de3d/diff:/var/lib/docker/overlay2/f80ca12827964f51920dbe48dca5078b40c8b8750bbc26cae46551054eaef335/diff:/var/lib/docker/overlay2/f9d1b7967e4c54ea05d399ef3e8fb31b5db05697b21d87cd56b42f8b5fe08935/diff:/var/lib/docker/overlay2/05c8be3131383b1042312a72e4892d83a6454a75825cac986ffee64019981dfe/diff:/var/lib/docker/overlay2/c80cfb322c572f3df47e16336fd5d3a5fb0bc02e172599403b16106ab77f6346/diff:/var/lib/docker/overlay2/d5f4d594005e6b6ee17f3e9370186de7d634fa656751b914a685b57fa2ec4215/diff:/var/lib/docker/overlay2/ceef4cb79e90b517a8eb97d26a183239e623d09b288f2f60aaca760c86cca458/diff:/var/lib/docker/overlay2/65535d1543daa7b2c4ac6be74ec66b70267c6c331646cbbc7ede280d898ab7d8/diff:/var/lib/docker/overlay2/748a7f9fb5d427d8a84b901a688f150f08f7a28f8110ef4e151eb7f8090664f2/diff:/var/lib/docker/overlay2/08556b39eb327d2b9c8763962c74579da6c9b35b792f5be65a918c4d9c8148b0/diff:/var/lib/d
ocker/overlay2/46e3295e83e52aa6dd90e2d2e071f4d7044ad34546a70c2bfae8d4e80fe14932/diff:/var/lib/docker/overlay2/c8034c224400174dd9cda20619be6681c4c9781f97dfc81656f7fd9e9c07d813/diff:/var/lib/docker/overlay2/da2e8222c4cc0898d90bdad13ad59045c132dd146c7107c28f316d64d96ca3c6/diff:/var/lib/docker/overlay2/27c0fc0e730f631aa7e6883260faa1af64719ccb11d11f51dbbc0558af7da8f1/diff:/var/lib/docker/overlay2/80f1ddd4c0a3fc9e1bd65517f9da4401c26fdb11abfef3ea4a4aa29d1ed1c4b7/diff:/var/lib/docker/overlay2/fabb1087f63f9692af943bdee19045b9cffddbdc7cfbd54dd545b954e6e8ab88/diff:/var/lib/docker/overlay2/62ea257ed671a476c95214f9f7dc98ad9a569953d49faae3add4aad0d23ecc02/diff:/var/lib/docker/overlay2/1ca573953a054a94d713390d8d2c219a6623b8f5653334e04e2ca22a833c3a80/diff:/var/lib/docker/overlay2/a145fccd564f30002914fe69f0d55e4dbe38a5678ca0becabd7f3535d2c8e3a6/diff:/var/lib/docker/overlay2/ba09cee35a1c268974bed688f0007316eb3e95ca9c50a0778b36332a061283e0/diff:/var/lib/docker/overlay2/01b2217dd91977945f0015b9329478693f814790e5c44146ad06f017061
0a7ec/diff:/var/lib/docker/overlay2/578b58254a5d3d736458759ee75e80a68b97a66c12d25ad390509fddd963faa3/diff:/var/lib/docker/overlay2/9ed7c52da11e166d996e6661eb3c771aaf944aab2cbe445b0f3d149e1bc0111a/diff:/var/lib/docker/overlay2/f001e79f1ecba6481a07384fa7e1df73dc6fbaa88e3db9b4c3d68e3f3d623514/diff:/var/lib/docker/overlay2/a06a07e0bb9247b8e96f435b4255d6b928ff52288fa1576997b8643e007e4e45/diff:/var/lib/docker/overlay2/4df2d2975449b5a15fb5c5e2d2fa51a53247c036999906dff7c5a377edf385d4/diff:/var/lib/docker/overlay2/f563a22b53e8c2aba633efcb1a3c29814ef5c38bb03a7a36cdc7020986083102/diff:/var/lib/docker/overlay2/84995cbdf6bc99b92bbd8fb51464ac3f28026557cbb8b7baeb13d3f256d0690a/diff:/var/lib/docker/overlay2/cbc3426974feb97394d24bb939948d72a2affe3820aa6f26d9e56d0790f5c8c3/diff:/var/lib/docker/overlay2/b3d48f73a37e16080a1f5405243da82478eced586261d184a0663cc6dd6fe36f/diff:/var/lib/docker/overlay2/49830600322d7b81b5ffbb8ac7eb2c8134dff677a8e9504a93349d25d86fbc45/diff",
"MergedDir": "/var/lib/docker/overlay2/26dd7ddc1f8f0d8c472f7603550b38e34e3f1ef35ad43919b82261a5a5a40b0f/merged",
"UpperDir": "/var/lib/docker/overlay2/26dd7ddc1f8f0d8c472f7603550b38e34e3f1ef35ad43919b82261a5a5a40b0f/diff",
"WorkDir": "/var/lib/docker/overlay2/26dd7ddc1f8f0d8c472f7603550b38e34e3f1ef35ad43919b82261a5a5a40b0f/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-20220629183430-3015",
"Source": "/var/lib/docker/volumes/old-k8s-version-20220629183430-3015/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-20220629183430-3015",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-20220629183430-3015",
"name.minikube.sigs.k8s.io": "old-k8s-version-20220629183430-3015",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "5a4864018cb7997ae399467978fecd4d44e5ba201e3d0089b29f7fbbcdd0d47b",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "61007"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "61008"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "61009"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "61010"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "61011"
}
]
},
"SandboxKey": "/var/run/docker/netns/5a4864018cb7",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-20220629183430-3015": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"8f033eea5d59",
"old-k8s-version-20220629183430-3015"
],
"NetworkID": "be2bb5bc7c5eb5a4b996248707a7afd803cfe69a6ac408cd6dc0a8b8b0a11282",
"EndpointID": "13b14721b37bd823459a8765149478fbef2590c1b71a0ed5d213e1f95a08077e",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220629183430-3015 -n old-k8s-version-20220629183430-3015
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220629183430-3015 -n old-k8s-version-20220629183430-3015: exit status 6 (441.167284ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0629 18:38:41.312134 17089 status.go:413] kubeconfig endpoint: extract IP: "old-k8s-version-20220629183430-3015" does not appear in /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-1353-50f8f9da1eeeab4cb62c946b86560a78cbc9c658/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-20220629183430-3015" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (250.46s)