=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:188: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-20220531110241-2169 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
E0531 11:03:03.061973 2169 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/functional-20220531101620-2169/client.crt: no such file or directory
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:188: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-20220531110241-2169 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m10.237221656s)
-- stdout --
* [old-k8s-version-20220531110241-2169] minikube v1.26.0-beta.1 on Darwin 12.4
- MINIKUBE_LOCATION=14079
- KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube
* Using the docker driver based on user configuration
* Using Docker Desktop driver with the root privilege
* Starting control plane node old-k8s-version-20220531110241-2169 in cluster old-k8s-version-20220531110241-2169
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 20.10.16 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0531 11:02:41.335616 12612 out.go:296] Setting OutFile to fd 1 ...
I0531 11:02:41.335832 12612 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0531 11:02:41.335838 12612 out.go:309] Setting ErrFile to fd 2...
I0531 11:02:41.335842 12612 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0531 11:02:41.335964 12612 root.go:322] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/bin
I0531 11:02:41.336306 12612 out.go:303] Setting JSON to false
I0531 11:02:41.352245 12612 start.go:115] hostinfo: {"hostname":"37309.local","uptime":3730,"bootTime":1654016431,"procs":357,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"12.4","kernelVersion":"21.5.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
W0531 11:02:41.352347 12612 start.go:123] gopshost.Virtualization returned error: not implemented yet
I0531 11:02:41.374532 12612 out.go:177] * [old-k8s-version-20220531110241-2169] minikube v1.26.0-beta.1 on Darwin 12.4
I0531 11:02:41.417708 12612 notify.go:193] Checking for updates...
I0531 11:02:41.417734 12612 out.go:177] - MINIKUBE_LOCATION=14079
I0531 11:02:41.439790 12612 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/kubeconfig
I0531 11:02:41.467989 12612 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0531 11:02:41.525322 12612 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0531 11:02:41.569141 12612 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube
I0531 11:02:41.590757 12612 config.go:178] Loaded profile config "kubenet-20220531104925-2169": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6
I0531 11:02:41.590836 12612 driver.go:358] Setting default libvirt URI to qemu:///system
I0531 11:02:41.664511 12612 docker.go:137] docker version: linux-20.10.14
I0531 11:02:41.664641 12612 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0531 11:02:41.789681 12612 info.go:265] docker info: {ID:XCCD:OR4G:KEVC:WHGD:QIVO:NNA4:4PNA:G662:ML55:LM4H:W5O5:ZVYD Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:57 OomKillDisable:false NGoroutines:51 SystemTime:2022-05-31 18:02:41.738966422 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0531 11:02:41.811590 12612 out.go:177] * Using the docker driver based on user configuration
I0531 11:02:41.832097 12612 start.go:284] selected driver: docker
I0531 11:02:41.832111 12612 start.go:806] validating driver "docker" against <nil>
I0531 11:02:41.832128 12612 start.go:817] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0531 11:02:41.834439 12612 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0531 11:02:41.959626 12612 info.go:265] docker info: {ID:XCCD:OR4G:KEVC:WHGD:QIVO:NNA4:4PNA:G662:ML55:LM4H:W5O5:ZVYD Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:57 OomKillDisable:false NGoroutines:51 SystemTime:2022-05-31 18:02:41.909329623 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0531 11:02:41.959762 12612 start_flags.go:292] no existing cluster config was found, will generate one from the flags
I0531 11:02:41.959912 12612 start_flags.go:847] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0531 11:02:41.981195 12612 out.go:177] * Using Docker Desktop driver with the root privilege
I0531 11:02:42.002270 12612 cni.go:95] Creating CNI manager for ""
I0531 11:02:42.002338 12612 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0531 11:02:42.002367 12612 start_flags.go:306] config:
{Name:old-k8s-version-20220531110241-2169 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220531110241-2169 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDom
ain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}
I0531 11:02:42.024150 12612 out.go:177] * Starting control plane node old-k8s-version-20220531110241-2169 in cluster old-k8s-version-20220531110241-2169
I0531 11:02:42.066292 12612 cache.go:120] Beginning downloading kic base image for docker with docker
I0531 11:02:42.087107 12612 out.go:177] * Pulling base image ...
I0531 11:02:42.129317 12612 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 in local docker daemon
I0531 11:02:42.129320 12612 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0531 11:02:42.129447 12612 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0531 11:02:42.129464 12612 cache.go:57] Caching tarball of preloaded images
I0531 11:02:42.129661 12612 preload.go:174] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0531 11:02:42.129678 12612 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0531 11:02:42.130632 12612 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/config.json ...
I0531 11:02:42.130728 12612 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/config.json: {Name:mkd054687a1a27ec23fea8e8d48464df5a66a839 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0531 11:02:42.192698 12612 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 in local docker daemon, skipping pull
I0531 11:02:42.192717 12612 cache.go:141] gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 exists in daemon, skipping load
I0531 11:02:42.192728 12612 cache.go:206] Successfully downloaded all kic artifacts
I0531 11:02:42.192763 12612 start.go:352] acquiring machines lock for old-k8s-version-20220531110241-2169: {Name:mkde0b1c8a03f8862b5675925132e687b92ccd7f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0531 11:02:42.192894 12612 start.go:356] acquired machines lock for "old-k8s-version-20220531110241-2169" in 121.139µs
I0531 11:02:42.192921 12612 start.go:91] Provisioning new machine with config: &{Name:old-k8s-version-20220531110241-2169 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220531110241-2169 N
amespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirr
or: DisableOptimizations:false DisableMetrics:false} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0531 11:02:42.192972 12612 start.go:131] createHost starting for "" (driver="docker")
I0531 11:02:42.214778 12612 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0531 11:02:42.215023 12612 start.go:165] libmachine.API.Create for "old-k8s-version-20220531110241-2169" (driver="docker")
I0531 11:02:42.215061 12612 client.go:168] LocalClient.Create starting
I0531 11:02:42.215179 12612 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/ca.pem
I0531 11:02:42.215224 12612 main.go:134] libmachine: Decoding PEM data...
I0531 11:02:42.215242 12612 main.go:134] libmachine: Parsing certificate...
I0531 11:02:42.215322 12612 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/cert.pem
I0531 11:02:42.215368 12612 main.go:134] libmachine: Decoding PEM data...
I0531 11:02:42.215403 12612 main.go:134] libmachine: Parsing certificate...
I0531 11:02:42.215994 12612 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220531110241-2169 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0531 11:02:42.277620 12612 cli_runner.go:211] docker network inspect old-k8s-version-20220531110241-2169 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0531 11:02:42.277712 12612 network_create.go:272] running [docker network inspect old-k8s-version-20220531110241-2169] to gather additional debugging logs...
I0531 11:02:42.277729 12612 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220531110241-2169
W0531 11:02:42.339495 12612 cli_runner.go:211] docker network inspect old-k8s-version-20220531110241-2169 returned with exit code 1
I0531 11:02:42.339521 12612 network_create.go:275] error running [docker network inspect old-k8s-version-20220531110241-2169]: docker network inspect old-k8s-version-20220531110241-2169: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-20220531110241-2169
I0531 11:02:42.339536 12612 network_create.go:277] output of [docker network inspect old-k8s-version-20220531110241-2169]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-20220531110241-2169
** /stderr **
I0531 11:02:42.339615 12612 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0531 11:02:42.401739 12612 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc000552600] misses:0}
I0531 11:02:42.401776 12612 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0531 11:02:42.401793 12612 network_create.go:115] attempt to create docker network old-k8s-version-20220531110241-2169 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0531 11:02:42.401850 12612 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true old-k8s-version-20220531110241-2169
I0531 11:02:42.494449 12612 network_create.go:99] docker network old-k8s-version-20220531110241-2169 192.168.49.0/24 created
I0531 11:02:42.494497 12612 kic.go:106] calculated static IP "192.168.49.2" for the "old-k8s-version-20220531110241-2169" container
I0531 11:02:42.494599 12612 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0531 11:02:42.559534 12612 cli_runner.go:164] Run: docker volume create old-k8s-version-20220531110241-2169 --label name.minikube.sigs.k8s.io=old-k8s-version-20220531110241-2169 --label created_by.minikube.sigs.k8s.io=true
I0531 11:02:42.681977 12612 oci.go:103] Successfully created a docker volume old-k8s-version-20220531110241-2169
I0531 11:02:42.682103 12612 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-20220531110241-2169-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220531110241-2169 --entrypoint /usr/bin/test -v old-k8s-version-20220531110241-2169:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -d /var/lib
I0531 11:02:43.144350 12612 oci.go:107] Successfully prepared a docker volume old-k8s-version-20220531110241-2169
I0531 11:02:43.144387 12612 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0531 11:02:43.144400 12612 kic.go:179] Starting extracting preloaded images to volume ...
I0531 11:02:43.144495 12612 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220531110241-2169:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -I lz4 -xf /preloaded.tar -C /extractDir
I0531 11:02:47.177161 12612 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220531110241-2169:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -I lz4 -xf /preloaded.tar -C /extractDir: (4.03264661s)
I0531 11:02:47.177185 12612 kic.go:188] duration metric: took 4.032833 seconds to extract preloaded images to volume
I0531 11:02:47.177280 12612 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0531 11:02:47.301647 12612 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-20220531110241-2169 --name old-k8s-version-20220531110241-2169 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220531110241-2169 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-20220531110241-2169 --network old-k8s-version-20220531110241-2169 --ip 192.168.49.2 --volume old-k8s-version-20220531110241-2169:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418
I0531 11:02:47.684874 12612 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220531110241-2169 --format={{.State.Running}}
I0531 11:02:47.756280 12612 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220531110241-2169 --format={{.State.Status}}
I0531 11:02:47.831241 12612 cli_runner.go:164] Run: docker exec old-k8s-version-20220531110241-2169 stat /var/lib/dpkg/alternatives/iptables
I0531 11:02:47.963919 12612 oci.go:247] the created container "old-k8s-version-20220531110241-2169" has a running status.
I0531 11:02:47.963946 12612 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/machines/old-k8s-version-20220531110241-2169/id_rsa...
I0531 11:02:48.225946 12612 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/machines/old-k8s-version-20220531110241-2169/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0531 11:02:48.337666 12612 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220531110241-2169 --format={{.State.Status}}
I0531 11:02:48.407540 12612 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0531 11:02:48.407559 12612 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-20220531110241-2169 chown docker:docker /home/docker/.ssh/authorized_keys]
I0531 11:02:48.529432 12612 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220531110241-2169 --format={{.State.Status}}
I0531 11:02:48.598130 12612 machine.go:88] provisioning docker machine ...
I0531 11:02:48.598170 12612 ubuntu.go:169] provisioning hostname "old-k8s-version-20220531110241-2169"
I0531 11:02:48.598253 12612 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220531110241-2169
I0531 11:02:48.668461 12612 main.go:134] libmachine: Using SSH client type: native
I0531 11:02:48.668638 12612 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d21c0] 0x13d5220 <nil> [] 0s} 127.0.0.1 51147 <nil> <nil>}
I0531 11:02:48.668666 12612 main.go:134] libmachine: About to run SSH command:
sudo hostname old-k8s-version-20220531110241-2169 && echo "old-k8s-version-20220531110241-2169" | sudo tee /etc/hostname
I0531 11:02:48.789150 12612 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-20220531110241-2169
I0531 11:02:48.789268 12612 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220531110241-2169
I0531 11:02:48.859652 12612 main.go:134] libmachine: Using SSH client type: native
I0531 11:02:48.859794 12612 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d21c0] 0x13d5220 <nil> [] 0s} 127.0.0.1 51147 <nil> <nil>}
I0531 11:02:48.859808 12612 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-20220531110241-2169' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-20220531110241-2169/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-20220531110241-2169' | sudo tee -a /etc/hosts;
fi
fi
I0531 11:02:48.972774 12612 main.go:134] libmachine: SSH cmd err, output: <nil>:
I0531 11:02:48.972800 12612 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/se
rver.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube}
I0531 11:02:48.972825 12612 ubuntu.go:177] setting up certificates
I0531 11:02:48.972837 12612 provision.go:83] configureAuth start
I0531 11:02:48.972902 12612 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220531110241-2169
I0531 11:02:49.042183 12612 provision.go:138] copyHostCerts
I0531 11:02:49.042267 12612 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/ca.pem, removing ...
I0531 11:02:49.042275 12612 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/ca.pem
I0531 11:02:49.042370 12612 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/ca.pem (1078 bytes)
I0531 11:02:49.042604 12612 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/cert.pem, removing ...
I0531 11:02:49.042613 12612 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/cert.pem
I0531 11:02:49.042675 12612 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/cert.pem (1123 bytes)
I0531 11:02:49.042803 12612 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/key.pem, removing ...
I0531 11:02:49.042809 12612 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/key.pem
I0531 11:02:49.042870 12612 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/key.pem (1675 bytes)
I0531 11:02:49.042976 12612 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-20220531110241-2169 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-20220531110241-2169]
I0531 11:02:49.286207 12612 provision.go:172] copyRemoteCerts
I0531 11:02:49.286270 12612 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0531 11:02:49.286311 12612 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220531110241-2169
I0531 11:02:49.355858 12612 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51147 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/machines/old-k8s-version-20220531110241-2169/id_rsa Username:docker}
I0531 11:02:49.439794 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0531 11:02:49.457258 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/machines/server.pem --> /etc/docker/server.pem (1277 bytes)
I0531 11:02:49.474307 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0531 11:02:49.491666 12612 provision.go:86] duration metric: configureAuth took 518.822987ms
I0531 11:02:49.491679 12612 ubuntu.go:193] setting minikube options for container-runtime
I0531 11:02:49.491818 12612 config.go:178] Loaded profile config "old-k8s-version-20220531110241-2169": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0531 11:02:49.491876 12612 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220531110241-2169
I0531 11:02:49.561413 12612 main.go:134] libmachine: Using SSH client type: native
I0531 11:02:49.561582 12612 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d21c0] 0x13d5220 <nil> [] 0s} 127.0.0.1 51147 <nil> <nil>}
I0531 11:02:49.561599 12612 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0531 11:02:49.676588 12612 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I0531 11:02:49.676600 12612 ubuntu.go:71] root file system type: overlay
I0531 11:02:49.676755 12612 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0531 11:02:49.676826 12612 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220531110241-2169
I0531 11:02:49.746518 12612 main.go:134] libmachine: Using SSH client type: native
I0531 11:02:49.746674 12612 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d21c0] 0x13d5220 <nil> [] 0s} 127.0.0.1 51147 <nil> <nil>}
I0531 11:02:49.746722 12612 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0531 11:02:49.866818 12612 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0531 11:02:49.866910 12612 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220531110241-2169
I0531 11:02:49.937200 12612 main.go:134] libmachine: Using SSH client type: native
I0531 11:02:49.937348 12612 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d21c0] 0x13d5220 <nil> [] 0s} 127.0.0.1 51147 <nil> <nil>}
I0531 11:02:49.937361 12612 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0531 11:02:50.542855 12612 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-05-12 09:15:28.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2022-05-31 18:02:49.866158878 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0531 11:02:50.542886 12612 machine.go:91] provisioned docker machine in 1.944759793s
I0531 11:02:50.542894 12612 client.go:171] LocalClient.Create took 8.327928698s
I0531 11:02:50.542923 12612 start.go:173] duration metric: libmachine.API.Create for "old-k8s-version-20220531110241-2169" took 8.327991645s
I0531 11:02:50.542967 12612 start.go:306] post-start starting for "old-k8s-version-20220531110241-2169" (driver="docker")
I0531 11:02:50.542978 12612 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0531 11:02:50.543082 12612 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0531 11:02:50.543185 12612 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220531110241-2169
I0531 11:02:50.613221 12612 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51147 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/machines/old-k8s-version-20220531110241-2169/id_rsa Username:docker}
I0531 11:02:50.698581 12612 ssh_runner.go:195] Run: cat /etc/os-release
I0531 11:02:50.702137 12612 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0531 11:02:50.702151 12612 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0531 11:02:50.702158 12612 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0531 11:02:50.702165 12612 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0531 11:02:50.702177 12612 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/addons for local assets ...
I0531 11:02:50.702287 12612 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/files for local assets ...
I0531 11:02:50.702427 12612 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/files/etc/ssl/certs/21692.pem -> 21692.pem in /etc/ssl/certs
I0531 11:02:50.702577 12612 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0531 11:02:50.709643 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/files/etc/ssl/certs/21692.pem --> /etc/ssl/certs/21692.pem (1708 bytes)
I0531 11:02:50.726676 12612 start.go:309] post-start completed in 183.696787ms
I0531 11:02:50.727199 12612 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220531110241-2169
I0531 11:02:50.796165 12612 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/config.json ...
I0531 11:02:50.796547 12612 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0531 11:02:50.796596 12612 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220531110241-2169
I0531 11:02:50.866618 12612 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51147 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/machines/old-k8s-version-20220531110241-2169/id_rsa Username:docker}
I0531 11:02:50.951876 12612 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0531 11:02:50.956558 12612 start.go:134] duration metric: createHost completed in 8.763684908s
I0531 11:02:50.956577 12612 start.go:81] releasing machines lock for "old-k8s-version-20220531110241-2169", held for 8.763779519s
I0531 11:02:50.956654 12612 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220531110241-2169
I0531 11:02:51.025736 12612 ssh_runner.go:195] Run: systemctl --version
I0531 11:02:51.025741 12612 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0531 11:02:51.025805 12612 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220531110241-2169
I0531 11:02:51.025811 12612 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220531110241-2169
I0531 11:02:51.102166 12612 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51147 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/machines/old-k8s-version-20220531110241-2169/id_rsa Username:docker}
I0531 11:02:51.103999 12612 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51147 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/machines/old-k8s-version-20220531110241-2169/id_rsa Username:docker}
I0531 11:02:51.310697 12612 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0531 11:02:51.320181 12612 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0531 11:02:51.331138 12612 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0531 11:02:51.331185 12612 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0531 11:02:51.341360 12612 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0531 11:02:51.371147 12612 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0531 11:02:51.447136 12612 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0531 11:02:51.522066 12612 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0531 11:02:51.532228 12612 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0531 11:02:51.597859 12612 ssh_runner.go:195] Run: sudo systemctl start docker
I0531 11:02:51.607630 12612 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0531 11:02:51.643276 12612 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0531 11:02:51.720373 12612 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 20.10.16 ...
I0531 11:02:51.720479 12612 cli_runner.go:164] Run: docker exec -t old-k8s-version-20220531110241-2169 dig +short host.docker.internal
I0531 11:02:51.855586 12612 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0531 11:02:51.855791 12612 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0531 11:02:51.860110 12612 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0531 11:02:51.873865 12612 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-20220531110241-2169
I0531 11:02:51.948455 12612 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0531 11:02:51.948527 12612 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0531 11:02:51.993068 12612 docker.go:610] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0531 11:02:51.993103 12612 docker.go:541] Images already preloaded, skipping extraction
I0531 11:02:51.993196 12612 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0531 11:02:52.023478 12612 docker.go:610] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0531 11:02:52.023495 12612 cache_images.go:84] Images are preloaded, skipping loading
I0531 11:02:52.023574 12612 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0531 11:02:52.119702 12612 cni.go:95] Creating CNI manager for ""
I0531 11:02:52.119714 12612 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0531 11:02:52.119726 12612 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0531 11:02:52.119743 12612 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-20220531110241-2169 NodeName:old-k8s-version-20220531110241-2169 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:systemd ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I0531 11:02:52.119848 12612 kubeadm.go:162] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-20220531110241-2169"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-20220531110241-2169
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.49.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0531 11:02:52.119921 12612 kubeadm.go:961] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-20220531110241-2169 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220531110241-2169 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0531 11:02:52.119981 12612 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0531 11:02:52.128071 12612 binaries.go:44] Found k8s binaries, skipping transfer
I0531 11:02:52.128128 12612 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0531 11:02:52.135614 12612 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (361 bytes)
I0531 11:02:52.148501 12612 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0531 11:02:52.165917 12612 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2146 bytes)
I0531 11:02:52.181680 12612 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0531 11:02:52.186734 12612 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0531 11:02:52.198584 12612 certs.go:54] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169 for IP: 192.168.49.2
I0531 11:02:52.198712 12612 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/ca.key
I0531 11:02:52.198764 12612 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/proxy-client-ca.key
I0531 11:02:52.198818 12612 certs.go:302] generating minikube-user signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/client.key
I0531 11:02:52.198832 12612 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/client.crt with IP's: []
I0531 11:02:52.323334 12612 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/client.crt ...
I0531 11:02:52.323348 12612 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/client.crt: {Name:mkf76d740cb6c1fbb557b7d44bf1bb3b3fc5f5c0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0531 11:02:52.323637 12612 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/client.key ...
I0531 11:02:52.323644 12612 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/client.key: {Name:mkc40b89d1b79f932dafed5cee226a10b353316b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0531 11:02:52.323837 12612 certs.go:302] generating minikube signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/apiserver.key.dd3b5fb2
I0531 11:02:52.323852 12612 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0531 11:02:52.464390 12612 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/apiserver.crt.dd3b5fb2 ...
I0531 11:02:52.464408 12612 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/apiserver.crt.dd3b5fb2: {Name:mk7a9351e11a1993199e3e95ffef82b61e120a50 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0531 11:02:52.464695 12612 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/apiserver.key.dd3b5fb2 ...
I0531 11:02:52.464703 12612 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/apiserver.key.dd3b5fb2: {Name:mke781dccb0182290de9497261560a06c33c276b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0531 11:02:52.464917 12612 certs.go:320] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/apiserver.crt.dd3b5fb2 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/apiserver.crt
I0531 11:02:52.465118 12612 certs.go:324] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/apiserver.key.dd3b5fb2 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/apiserver.key
I0531 11:02:52.465277 12612 certs.go:302] generating aggregator signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/proxy-client.key
I0531 11:02:52.465293 12612 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/proxy-client.crt with IP's: []
I0531 11:02:52.708781 12612 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/proxy-client.crt ...
I0531 11:02:52.708798 12612 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/proxy-client.crt: {Name:mk9a19cf355581ed14decc0f50c147c33602a1c3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0531 11:02:52.709101 12612 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/proxy-client.key ...
I0531 11:02:52.709110 12612 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/proxy-client.key: {Name:mk763154eac24ed3d9739ca7bacd150fe6c4cd2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0531 11:02:52.709520 12612 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/2169.pem (1338 bytes)
W0531 11:02:52.709564 12612 certs.go:384] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/2169_empty.pem, impossibly tiny 0 bytes
I0531 11:02:52.709576 12612 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/ca-key.pem (1675 bytes)
I0531 11:02:52.709605 12612 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/ca.pem (1078 bytes)
I0531 11:02:52.709633 12612 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/cert.pem (1123 bytes)
I0531 11:02:52.709674 12612 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/key.pem (1675 bytes)
I0531 11:02:52.709758 12612 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/files/etc/ssl/certs/21692.pem (1708 bytes)
I0531 11:02:52.710242 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0531 11:02:52.731318 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0531 11:02:52.752001 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0531 11:02:52.776332 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/profiles/old-k8s-version-20220531110241-2169/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0531 11:02:52.797776 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0531 11:02:52.816828 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0531 11:02:52.836265 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0531 11:02:52.858183 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0531 11:02:52.878406 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/files/etc/ssl/certs/21692.pem --> /usr/share/ca-certificates/21692.pem (1708 bytes)
I0531 11:02:52.898491 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0531 11:02:52.917563 12612 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/.minikube/certs/2169.pem --> /usr/share/ca-certificates/2169.pem (1338 bytes)
I0531 11:02:52.937690 12612 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)
I0531 11:02:52.951159 12612 ssh_runner.go:195] Run: openssl version
I0531 11:02:52.957508 12612 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/21692.pem && ln -fs /usr/share/ca-certificates/21692.pem /etc/ssl/certs/21692.pem"
I0531 11:02:52.967752 12612 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/21692.pem
I0531 11:02:52.972853 12612 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 May 31 17:16 /usr/share/ca-certificates/21692.pem
I0531 11:02:52.972946 12612 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/21692.pem
I0531 11:02:52.981615 12612 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/21692.pem /etc/ssl/certs/3ec20f2e.0"
I0531 11:02:52.996629 12612 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0531 11:02:53.008970 12612 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0531 11:02:53.015857 12612 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 May 31 17:12 /usr/share/ca-certificates/minikubeCA.pem
I0531 11:02:53.015938 12612 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0531 11:02:53.024183 12612 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0531 11:02:53.037587 12612 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2169.pem && ln -fs /usr/share/ca-certificates/2169.pem /etc/ssl/certs/2169.pem"
I0531 11:02:53.052508 12612 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2169.pem
I0531 11:02:53.059655 12612 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 May 31 17:16 /usr/share/ca-certificates/2169.pem
I0531 11:02:53.059732 12612 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2169.pem
I0531 11:02:53.068940 12612 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2169.pem /etc/ssl/certs/51391683.0"
I0531 11:02:53.078716 12612 kubeadm.go:395] StartCluster: {Name:old-k8s-version-20220531110241-2169 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220531110241-2169 Namespace:default APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disabl
eOptimizations:false DisableMetrics:false}
I0531 11:02:53.078824 12612 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0531 11:02:53.107800 12612 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0531 11:02:53.119580 12612 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0531 11:02:53.130429 12612 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0531 11:02:53.130499 12612 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0531 11:02:53.146402 12612 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0531 11:02:53.146449 12612 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0531 11:04:51.945034 12612 out.go:204] - Generating certificates and keys ...
I0531 11:04:51.987482 12612 out.go:204] - Booting up control plane ...
W0531 11:04:51.990853 12612 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220531110241-2169 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220531110241-2169 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.16. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220531110241-2169 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220531110241-2169 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.16. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0531 11:04:51.990896 12612 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0531 11:04:52.416300 12612 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0531 11:04:52.425558 12612 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0531 11:04:52.425607 12612 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0531 11:04:52.432569 12612 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0531 11:04:52.432602 12612 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0531 11:04:53.147480 12612 out.go:204] - Generating certificates and keys ...
I0531 11:04:53.958986 12612 out.go:204] - Booting up control plane ...
I0531 11:06:48.872941 12612 kubeadm.go:397] StartCluster complete in 3m55.797092049s
I0531 11:06:48.873016 12612 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0531 11:06:48.903130 12612 logs.go:274] 0 containers: []
W0531 11:06:48.903144 12612 logs.go:276] No container was found matching "kube-apiserver"
I0531 11:06:48.903203 12612 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0531 11:06:48.932003 12612 logs.go:274] 0 containers: []
W0531 11:06:48.932014 12612 logs.go:276] No container was found matching "etcd"
I0531 11:06:48.932067 12612 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0531 11:06:48.961748 12612 logs.go:274] 0 containers: []
W0531 11:06:48.961762 12612 logs.go:276] No container was found matching "coredns"
I0531 11:06:48.961832 12612 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0531 11:06:48.991608 12612 logs.go:274] 0 containers: []
W0531 11:06:48.991621 12612 logs.go:276] No container was found matching "kube-scheduler"
I0531 11:06:48.991673 12612 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0531 11:06:49.020247 12612 logs.go:274] 0 containers: []
W0531 11:06:49.020259 12612 logs.go:276] No container was found matching "kube-proxy"
I0531 11:06:49.020313 12612 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0531 11:06:49.050668 12612 logs.go:274] 0 containers: []
W0531 11:06:49.050685 12612 logs.go:276] No container was found matching "kubernetes-dashboard"
I0531 11:06:49.050741 12612 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0531 11:06:49.079763 12612 logs.go:274] 0 containers: []
W0531 11:06:49.079775 12612 logs.go:276] No container was found matching "storage-provisioner"
I0531 11:06:49.079830 12612 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0531 11:06:49.108894 12612 logs.go:274] 0 containers: []
W0531 11:06:49.108907 12612 logs.go:276] No container was found matching "kube-controller-manager"
I0531 11:06:49.108914 12612 logs.go:123] Gathering logs for kubelet ...
I0531 11:06:49.108922 12612 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0531 11:06:49.149288 12612 logs.go:123] Gathering logs for dmesg ...
I0531 11:06:49.149301 12612 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0531 11:06:49.162539 12612 logs.go:123] Gathering logs for describe nodes ...
I0531 11:06:49.162552 12612 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0531 11:06:49.215025 12612 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0531 11:06:49.215040 12612 logs.go:123] Gathering logs for Docker ...
I0531 11:06:49.215048 12612 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0531 11:06:49.229022 12612 logs.go:123] Gathering logs for container status ...
I0531 11:06:49.229034 12612 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0531 11:06:51.286145 12612 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.057124059s)
W0531 11:06:51.286258 12612 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.16. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0531 11:06:51.286272 12612 out.go:239] *
*
W0531 11:06:51.286398 12612 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.16. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.16. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0531 11:06:51.286411 12612 out.go:239] *
*
W0531 11:06:51.286919 12612 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0531 11:06:51.349651 12612 out.go:177]
W0531 11:06:51.392004 12612 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.16. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.16. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0531 11:06:51.412673 12612 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0531 11:06:51.412769 12612 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0531 11:06:51.454927 12612 out.go:177]
** /stderr **
start_stop_delete_test.go:190: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-20220531110241-2169 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-20220531110241-2169
helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220531110241-2169:
-- stdout --
[
{
"Id": "df301a213db61cf66cc0970233a18eb6a72386f20393b94f3ff55ff8b0bc8815",
"Created": "2022-05-31T18:02:47.387078025Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 195446,
"ExitCode": 0,
"Error": "",
"StartedAt": "2022-05-31T18:02:47.697577313Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:aedbaa58534633065a66af6f01ba15f6c7dc1b8a285b6938f9d04325ceab9ed4",
"ResolvConfPath": "/var/lib/docker/containers/df301a213db61cf66cc0970233a18eb6a72386f20393b94f3ff55ff8b0bc8815/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/df301a213db61cf66cc0970233a18eb6a72386f20393b94f3ff55ff8b0bc8815/hostname",
"HostsPath": "/var/lib/docker/containers/df301a213db61cf66cc0970233a18eb6a72386f20393b94f3ff55ff8b0bc8815/hosts",
"LogPath": "/var/lib/docker/containers/df301a213db61cf66cc0970233a18eb6a72386f20393b94f3ff55ff8b0bc8815/df301a213db61cf66cc0970233a18eb6a72386f20393b94f3ff55ff8b0bc8815-json.log",
"Name": "/old-k8s-version-20220531110241-2169",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-20220531110241-2169:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-20220531110241-2169",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/1f59e64d30cdaac3826823dee1bc788379af982abab3f34f979d0f9184f93428-init/diff:/var/lib/docker/overlay2/e9236ac2c8288edd356d491038859bb7b041caf2af4db686b5a369984cd72c7a/diff:/var/lib/docker/overlay2/9583a36102d597beec28eedc4595cd1894a38b7f2f977136a1db0d9279787834/diff:/var/lib/docker/overlay2/1910392279f776d7119f28b1da556d13ca658b69e1e41b3507098eb04986989a/diff:/var/lib/docker/overlay2/726cfb6c8268ab6b419a127af98543ed0e007dd73abc7657074c803ea3e72111/diff:/var/lib/docker/overlay2/3252ec1ac98e8c7adcbfc1f8dd2e5066559bb420e7590a9a7140a8e4f2616df4/diff:/var/lib/docker/overlay2/7ffeda290a1ddaf5f37f463abd306472ef3996f100e9d877ea37dfeb7bac3305/diff:/var/lib/docker/overlay2/67deff9d213ce915a44ed74b4258db8724cae9fb1c4350a3e0b0992c78f1e1cb/diff:/var/lib/docker/overlay2/7fae3f5b1e40a6b2186a50fe2f1118e775a7b5398f336a975aead4c9e584558f/diff:/var/lib/docker/overlay2/c5eb8740d6ddbf9661674f0780b3e350044c1b324021ddb90c6855692c4ab640/diff:/var/lib/docker/overlay2/276ff0
e489fcbdc52a5f1fcc3be2f2326e94a4982e453b724a337d50bf52eb3d/diff:/var/lib/docker/overlay2/d6aef1152a663bc7d5f067f5fe4b24044b4a02c5347c43caff2575cd589113b8/diff:/var/lib/docker/overlay2/a2452c33f209b77b71bfc37303741ebf457fd51f564cb5a037a8424a8ce25c07/diff:/var/lib/docker/overlay2/9e744ad586c9ac75bdce5f524a563cfcc44d64ecf745e00faa6d3b68ce2d6f26/diff:/var/lib/docker/overlay2/63c5ca51c4edca5a8b3540c1d94140a0405a1f93884c2e724b2eea0cc1a13427/diff:/var/lib/docker/overlay2/f058e08bfebb5a2e0de90a4c0776530ff390a31d67cc53b1a1a46cf564565612/diff:/var/lib/docker/overlay2/13949d47879ca0c2aa7b22b4a5d0724e077d3c986e8c855a8ece54b0ecb19ab6/diff:/var/lib/docker/overlay2/6f6b92a9cd1ae7141ef5e0f104fe78cb2306fd6a4ec3774a2814bc01b8a6eb63/diff:/var/lib/docker/overlay2/9637cafb8fb45b01bcc69e7fbe495dfedda118f48b3a7f59fe8c98fd940d2d00/diff:/var/lib/docker/overlay2/4b29feee1b31be18c7ef5fa25676f134aa0e4b773d02d5da7ee0475a7140e610/diff:/var/lib/docker/overlay2/05559122fed6de027ba73a4e1942bf9f548a08d3b34d0af8f0b86dcd6c42bea9/diff:/var/lib/d
ocker/overlay2/ce49d161daafc6ba4ecd8cdb6397ec63bffb59f2e18df9b749a66e5969c68070/diff:/var/lib/docker/overlay2/92528940c1b38142a7c444bab261669899de190d91344740f163c3fc8b034c94/diff:/var/lib/docker/overlay2/213d9aaca46bb96714b6c2b6834c9856068bf3b2808de7d72a5ef16c510cb88b/diff:/var/lib/docker/overlay2/f3b807d5e369ba4dc82a418bbb1a6a94a2d03648271201ec072a35789d6dce6c/diff:/var/lib/docker/overlay2/cdd5e2d059a4c7ea35a272fe0be016e91ababa31fea7fd92a5e439d6a71c8f5a/diff:/var/lib/docker/overlay2/81427a1d82997492e887fa4c5dc5efe18afea2e781415c09871343929a7e2bb4/diff:/var/lib/docker/overlay2/e69dff205635b2608858fa350c39ac2a4ade43e49c2d763d0ae4ac40e988fe64/diff:/var/lib/docker/overlay2/d94ce2070bfa0f1a4fc27f1c3f85432edb9d3cb6f29ebcd17b55568360312bf1/diff:/var/lib/docker/overlay2/34f42e7d85bb93a9320d94111a1381db9349da2a97103e2ad6d3ffaa4fda7dde/diff:/var/lib/docker/overlay2/422546d5dec87eb31c4bb28995c99ab55cfd8c2bc37d163f4d3b0671d7a839a3/diff:/var/lib/docker/overlay2/cd140b76bb4d6a5542198336ac5b3a2f3bfaeb635d87254dc77fb1ef350
93e76/diff:/var/lib/docker/overlay2/86226c3ca95e11447436ab52b705105aeaf86ee1d00ad33407928341087359fa/diff:/var/lib/docker/overlay2/6ef3509340435f9a8324c324f8b2044881dd1ebc80e42c4f825fe5dcd0731959/diff:/var/lib/docker/overlay2/aec95268413baa5f7ed43f0952ea22bf552b63f0512dad2ea36bd12c05bf3897/diff:/var/lib/docker/overlay2/3610e476078737e1a7323c8c7779b228cc3068d82c7dcc0b53728e3a228762a4/diff:/var/lib/docker/overlay2/2416c31436c0f817eb20213db328f2fffce16f7b5983ae8d9c520aea87ea6bfa/diff:/var/lib/docker/overlay2/a6e9860639b3c4314d23c278b859d82b4ed39abde781c1bed7b1062951c27ad7/diff:/var/lib/docker/overlay2/6556118214bbe4f83fbc99a3461679b72d9d7e467e01aca0a1c3a37ab8bbe801/diff:/var/lib/docker/overlay2/e46b69b82a00dd790bf30de0a046bfdd1e78e1dde33976d576232177a7eeee3e/diff:/var/lib/docker/overlay2/4e44a564d5dc52a3da062061a9f27f56a5ed8dd4f266b30b4b09c9cc0aeb1e1e/diff",
"MergedDir": "/var/lib/docker/overlay2/1f59e64d30cdaac3826823dee1bc788379af982abab3f34f979d0f9184f93428/merged",
"UpperDir": "/var/lib/docker/overlay2/1f59e64d30cdaac3826823dee1bc788379af982abab3f34f979d0f9184f93428/diff",
"WorkDir": "/var/lib/docker/overlay2/1f59e64d30cdaac3826823dee1bc788379af982abab3f34f979d0f9184f93428/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-20220531110241-2169",
"Source": "/var/lib/docker/volumes/old-k8s-version-20220531110241-2169/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-20220531110241-2169",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-20220531110241-2169",
"name.minikube.sigs.k8s.io": "old-k8s-version-20220531110241-2169",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "99c60f27f5ff42fbe095a3999df8b77dd1e171cb46c0a1c5e1b9ff11c0670e9a",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "51147"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "51148"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "51149"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "51150"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "51151"
}
]
},
"SandboxKey": "/var/run/docker/netns/99c60f27f5ff",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-20220531110241-2169": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": [
"df301a213db6",
"old-k8s-version-20220531110241-2169"
],
"NetworkID": "371f88932f2f86b1e4c7d7ee4813eb521c132449a1b646e6adc62c4e1df95fe6",
"EndpointID": "8d86a29510e832262aa35fd78bc0185e767442c6f9338fb511f6bac2eb09d8f7",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220531110241-2169 -n old-k8s-version-20220531110241-2169
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220531110241-2169 -n old-k8s-version-20220531110241-2169: exit status 6 (436.070132ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0531 11:06:52.049951 13014 status.go:413] kubeconfig endpoint: extract IP: "old-k8s-version-20220531110241-2169" does not appear in /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1018-bc7278193255a66f30064dc56185dbbc87656da8/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-20220531110241-2169" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (250.78s)