=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:188: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-20220601040844-2342 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:188: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-20220601040844-2342 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m9.897997593s)
-- stdout --
* [old-k8s-version-20220601040844-2342] minikube v1.26.0-beta.1 on Darwin 12.4
- MINIKUBE_LOCATION=14079
- KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube
* Using the docker driver based on user configuration
* Using Docker Desktop driver with the root privilege
* Starting control plane node old-k8s-version-20220601040844-2342 in cluster old-k8s-version-20220601040844-2342
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 20.10.16 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0601 04:08:44.907842 13010 out.go:296] Setting OutFile to fd 1 ...
I0601 04:08:44.908059 13010 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0601 04:08:44.908068 13010 out.go:309] Setting ErrFile to fd 2...
I0601 04:08:44.908073 13010 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0601 04:08:44.908176 13010 root.go:322] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/bin
I0601 04:08:44.908503 13010 out.go:303] Setting JSON to false
I0601 04:08:44.923474 13010 start.go:115] hostinfo: {"hostname":"administrators-Mac-mini.local","uptime":4094,"bootTime":1654077630,"procs":349,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"12.4","kernelVersion":"21.5.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
W0601 04:08:44.923592 13010 start.go:123] gopshost.Virtualization returned error: not implemented yet
I0601 04:08:44.961188 13010 out.go:177] * [old-k8s-version-20220601040844-2342] minikube v1.26.0-beta.1 on Darwin 12.4
I0601 04:08:45.019992 13010 notify.go:193] Checking for updates...
I0601 04:08:45.058114 13010 out.go:177] - MINIKUBE_LOCATION=14079
I0601 04:08:45.115979 13010 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/kubeconfig
I0601 04:08:45.175010 13010 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0601 04:08:45.234095 13010 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0601 04:08:45.308801 13010 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube
I0601 04:08:45.346879 13010 config.go:178] Loaded profile config "kubenet-20220601035306-2342": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6
I0601 04:08:45.346974 13010 driver.go:358] Setting default libvirt URI to qemu:///system
I0601 04:08:45.446338 13010 docker.go:137] docker version: linux-20.10.14
I0601 04:08:45.446480 13010 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0601 04:08:45.573023 13010 info.go:265] docker info: {ID:OSPM:CVZQ:HET7:TQWM:FDTX:UXYA:EVZD:IXWP:AUUF:VCIR:LE27:YQJQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:5 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:57 OomKillDisable:false NGoroutines:51 SystemTime:2022-06-01 11:08:45.525456619 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0601 04:08:45.596606 13010 out.go:177] * Using the docker driver based on user configuration
I0601 04:08:45.617911 13010 start.go:284] selected driver: docker
I0601 04:08:45.617931 13010 start.go:806] validating driver "docker" against <nil>
I0601 04:08:45.617959 13010 start.go:817] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0601 04:08:45.621465 13010 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0601 04:08:45.753512 13010 info.go:265] docker info: {ID:OSPM:CVZQ:HET7:TQWM:FDTX:UXYA:EVZD:IXWP:AUUF:VCIR:LE27:YQJQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:5 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:57 OomKillDisable:false NGoroutines:51 SystemTime:2022-06-01 11:08:45.700743664 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0601 04:08:45.753629 13010 start_flags.go:292] no existing cluster config was found, will generate one from the flags
I0601 04:08:45.753828 13010 start_flags.go:847] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0601 04:08:45.776041 13010 out.go:177] * Using Docker Desktop driver with the root privilege
I0601 04:08:45.795538 13010 cni.go:95] Creating CNI manager for ""
I0601 04:08:45.795558 13010 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0601 04:08:45.795574 13010 start_flags.go:306] config:
{Name:old-k8s-version-20220601040844-2342 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653677545-13807@sha256:312115a5663b1250effab8ed8ada9435fca80af41962223c98bf66f86b32c52a Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220601040844-2342 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDom
ain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}
I0601 04:08:45.832739 13010 out.go:177] * Starting control plane node old-k8s-version-20220601040844-2342 in cluster old-k8s-version-20220601040844-2342
I0601 04:08:45.889690 13010 cache.go:120] Beginning downloading kic base image for docker with docker
I0601 04:08:46.005938 13010 out.go:177] * Pulling base image ...
I0601 04:08:46.064635 13010 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0601 04:08:46.064666 13010 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653677545-13807@sha256:312115a5663b1250effab8ed8ada9435fca80af41962223c98bf66f86b32c52a in local docker daemon
I0601 04:08:46.064707 13010 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0601 04:08:46.064751 13010 cache.go:57] Caching tarball of preloaded images
I0601 04:08:46.065192 13010 preload.go:174] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0601 04:08:46.065308 13010 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0601 04:08:46.065609 13010 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/config.json ...
I0601 04:08:46.065647 13010 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/config.json: {Name:mkf57a4b00cc0f3b9b593472b63442dfed30b12f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0601 04:08:46.234360 13010 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653677545-13807@sha256:312115a5663b1250effab8ed8ada9435fca80af41962223c98bf66f86b32c52a in local docker daemon, skipping pull
I0601 04:08:46.234398 13010 cache.go:141] gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653677545-13807@sha256:312115a5663b1250effab8ed8ada9435fca80af41962223c98bf66f86b32c52a exists in daemon, skipping load
I0601 04:08:46.234449 13010 cache.go:206] Successfully downloaded all kic artifacts
I0601 04:08:46.234597 13010 start.go:352] acquiring machines lock for old-k8s-version-20220601040844-2342: {Name:mkf87fe8c4a511c3ef565c4140ef4a74b527ad92 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0601 04:08:46.234827 13010 start.go:356] acquired machines lock for "old-k8s-version-20220601040844-2342" in 211.768µs
I0601 04:08:46.234866 13010 start.go:91] Provisioning new machine with config: &{Name:old-k8s-version-20220601040844-2342 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653677545-13807@sha256:312115a5663b1250effab8ed8ada9435fca80af41962223c98bf66f86b32c52a Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220601040844-2342 N
amespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirr
or: DisableOptimizations:false DisableMetrics:false} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0601 04:08:46.234993 13010 start.go:131] createHost starting for "" (driver="docker")
I0601 04:08:46.293638 13010 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0601 04:08:46.293864 13010 start.go:165] libmachine.API.Create for "old-k8s-version-20220601040844-2342" (driver="docker")
I0601 04:08:46.293895 13010 client.go:168] LocalClient.Create starting
I0601 04:08:46.293964 13010 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/ca.pem
I0601 04:08:46.293998 13010 main.go:134] libmachine: Decoding PEM data...
I0601 04:08:46.294013 13010 main.go:134] libmachine: Parsing certificate...
I0601 04:08:46.294071 13010 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/cert.pem
I0601 04:08:46.294096 13010 main.go:134] libmachine: Decoding PEM data...
I0601 04:08:46.294104 13010 main.go:134] libmachine: Parsing certificate...
I0601 04:08:46.294516 13010 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220601040844-2342 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0601 04:08:46.398139 13010 cli_runner.go:211] docker network inspect old-k8s-version-20220601040844-2342 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0601 04:08:46.398229 13010 network_create.go:272] running [docker network inspect old-k8s-version-20220601040844-2342] to gather additional debugging logs...
I0601 04:08:46.398258 13010 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220601040844-2342
W0601 04:08:46.472788 13010 cli_runner.go:211] docker network inspect old-k8s-version-20220601040844-2342 returned with exit code 1
I0601 04:08:46.472823 13010 network_create.go:275] error running [docker network inspect old-k8s-version-20220601040844-2342]: docker network inspect old-k8s-version-20220601040844-2342: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-20220601040844-2342
I0601 04:08:46.472849 13010 network_create.go:277] output of [docker network inspect old-k8s-version-20220601040844-2342]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-20220601040844-2342
** /stderr **
I0601 04:08:46.472929 13010 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0601 04:08:46.544189 13010 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc00046cfd0] misses:0}
I0601 04:08:46.544243 13010 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0601 04:08:46.544271 13010 network_create.go:115] attempt to create docker network old-k8s-version-20220601040844-2342 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0601 04:08:46.544372 13010 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true old-k8s-version-20220601040844-2342
W0601 04:08:46.611417 13010 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true old-k8s-version-20220601040844-2342 returned with exit code 1
W0601 04:08:46.611483 13010 network_create.go:107] failed to create docker network old-k8s-version-20220601040844-2342 192.168.49.0/24, will retry: subnet is taken
I0601 04:08:46.611892 13010 network.go:279] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00046cfd0] amended:false}} dirty:map[] misses:0}
I0601 04:08:46.611926 13010 network.go:238] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0601 04:08:46.612217 13010 network.go:288] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00046cfd0] amended:true}} dirty:map[192.168.49.0:0xc00046cfd0 192.168.58.0:0xc0003b8508] misses:0}
I0601 04:08:46.612233 13010 network.go:235] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0601 04:08:46.612241 13010 network_create.go:115] attempt to create docker network old-k8s-version-20220601040844-2342 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I0601 04:08:46.612335 13010 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true old-k8s-version-20220601040844-2342
I0601 04:08:46.747881 13010 network_create.go:99] docker network old-k8s-version-20220601040844-2342 192.168.58.0/24 created
I0601 04:08:46.747941 13010 kic.go:106] calculated static IP "192.168.58.2" for the "old-k8s-version-20220601040844-2342" container
I0601 04:08:46.748069 13010 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0601 04:08:46.820614 13010 cli_runner.go:164] Run: docker volume create old-k8s-version-20220601040844-2342 --label name.minikube.sigs.k8s.io=old-k8s-version-20220601040844-2342 --label created_by.minikube.sigs.k8s.io=true
I0601 04:08:46.893191 13010 oci.go:103] Successfully created a docker volume old-k8s-version-20220601040844-2342
I0601 04:08:46.893309 13010 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-20220601040844-2342-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220601040844-2342 --entrypoint /usr/bin/test -v old-k8s-version-20220601040844-2342:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653677545-13807@sha256:312115a5663b1250effab8ed8ada9435fca80af41962223c98bf66f86b32c52a -d /var/lib
I0601 04:08:47.448981 13010 oci.go:107] Successfully prepared a docker volume old-k8s-version-20220601040844-2342
I0601 04:08:47.449068 13010 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0601 04:08:47.449088 13010 kic.go:179] Starting extracting preloaded images to volume ...
I0601 04:08:47.449240 13010 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220601040844-2342:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653677545-13807@sha256:312115a5663b1250effab8ed8ada9435fca80af41962223c98bf66f86b32c52a -I lz4 -xf /preloaded.tar -C /extractDir
I0601 04:08:51.520216 13010 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220601040844-2342:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653677545-13807@sha256:312115a5663b1250effab8ed8ada9435fca80af41962223c98bf66f86b32c52a -I lz4 -xf /preloaded.tar -C /extractDir: (4.070872505s)
I0601 04:08:51.520236 13010 kic.go:188] duration metric: took 4.071105 seconds to extract preloaded images to volume
I0601 04:08:51.520324 13010 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0601 04:08:51.646567 13010 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-20220601040844-2342 --name old-k8s-version-20220601040844-2342 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220601040844-2342 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-20220601040844-2342 --network old-k8s-version-20220601040844-2342 --ip 192.168.58.2 --volume old-k8s-version-20220601040844-2342:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653677545-13807@sha256:312115a5663b1250effab8ed8ada9435fca80af41962223c98bf66f86b32c52a
I0601 04:08:52.045532 13010 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220601040844-2342 --format={{.State.Running}}
I0601 04:08:52.124952 13010 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220601040844-2342 --format={{.State.Status}}
I0601 04:08:52.207821 13010 cli_runner.go:164] Run: docker exec old-k8s-version-20220601040844-2342 stat /var/lib/dpkg/alternatives/iptables
I0601 04:08:52.351655 13010 oci.go:247] the created container "old-k8s-version-20220601040844-2342" has a running status.
I0601 04:08:52.351680 13010 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/machines/old-k8s-version-20220601040844-2342/id_rsa...
I0601 04:08:52.419161 13010 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/machines/old-k8s-version-20220601040844-2342/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0601 04:08:52.540473 13010 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220601040844-2342 --format={{.State.Status}}
I0601 04:08:52.612507 13010 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0601 04:08:52.612524 13010 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-20220601040844-2342 chown docker:docker /home/docker/.ssh/authorized_keys]
I0601 04:08:52.741034 13010 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220601040844-2342 --format={{.State.Status}}
I0601 04:08:52.812186 13010 machine.go:88] provisioning docker machine ...
I0601 04:08:52.812251 13010 ubuntu.go:169] provisioning hostname "old-k8s-version-20220601040844-2342"
I0601 04:08:52.812363 13010 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220601040844-2342
I0601 04:08:52.885824 13010 main.go:134] libmachine: Using SSH client type: native
I0601 04:08:52.886025 13010 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d21c0] 0x13d5220 <nil> [] 0s} 127.0.0.1 51586 <nil> <nil>}
I0601 04:08:52.886039 13010 main.go:134] libmachine: About to run SSH command:
sudo hostname old-k8s-version-20220601040844-2342 && echo "old-k8s-version-20220601040844-2342" | sudo tee /etc/hostname
I0601 04:08:53.013958 13010 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-20220601040844-2342
I0601 04:08:53.014039 13010 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220601040844-2342
I0601 04:08:53.085837 13010 main.go:134] libmachine: Using SSH client type: native
I0601 04:08:53.085995 13010 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d21c0] 0x13d5220 <nil> [] 0s} 127.0.0.1 51586 <nil> <nil>}
I0601 04:08:53.086026 13010 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-20220601040844-2342' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-20220601040844-2342/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-20220601040844-2342' | sudo tee -a /etc/hosts;
fi
fi
I0601 04:08:53.201643 13010 main.go:134] libmachine: SSH cmd err, output: <nil>:
I0601 04:08:53.201665 13010 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/se
rver.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube}
I0601 04:08:53.201712 13010 ubuntu.go:177] setting up certificates
I0601 04:08:53.201726 13010 provision.go:83] configureAuth start
I0601 04:08:53.201793 13010 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220601040844-2342
I0601 04:08:53.273218 13010 provision.go:138] copyHostCerts
I0601 04:08:53.273294 13010 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/ca.pem, removing ...
I0601 04:08:53.273303 13010 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/ca.pem
I0601 04:08:53.273403 13010 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/ca.pem (1078 bytes)
I0601 04:08:53.273607 13010 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/cert.pem, removing ...
I0601 04:08:53.273618 13010 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/cert.pem
I0601 04:08:53.273678 13010 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/cert.pem (1123 bytes)
I0601 04:08:53.273841 13010 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/key.pem, removing ...
I0601 04:08:53.273849 13010 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/key.pem
I0601 04:08:53.273911 13010 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/key.pem (1679 bytes)
I0601 04:08:53.274034 13010 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-20220601040844-2342 san=[192.168.58.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-20220601040844-2342]
I0601 04:08:53.457994 13010 provision.go:172] copyRemoteCerts
I0601 04:08:53.458051 13010 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0601 04:08:53.458096 13010 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220601040844-2342
I0601 04:08:53.529624 13010 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51586 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/machines/old-k8s-version-20220601040844-2342/id_rsa Username:docker}
I0601 04:08:53.617769 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0601 04:08:53.634880 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/machines/server.pem --> /etc/docker/server.pem (1277 bytes)
I0601 04:08:53.651876 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0601 04:08:53.668482 13010 provision.go:86] duration metric: configureAuth took 466.738402ms
I0601 04:08:53.668495 13010 ubuntu.go:193] setting minikube options for container-runtime
I0601 04:08:53.668629 13010 config.go:178] Loaded profile config "old-k8s-version-20220601040844-2342": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0601 04:08:53.668681 13010 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220601040844-2342
I0601 04:08:53.740986 13010 main.go:134] libmachine: Using SSH client type: native
I0601 04:08:53.741194 13010 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d21c0] 0x13d5220 <nil> [] 0s} 127.0.0.1 51586 <nil> <nil>}
I0601 04:08:53.741210 13010 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0601 04:08:53.858753 13010 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I0601 04:08:53.858768 13010 ubuntu.go:71] root file system type: overlay
I0601 04:08:53.858915 13010 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0601 04:08:53.859000 13010 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220601040844-2342
I0601 04:08:53.930872 13010 main.go:134] libmachine: Using SSH client type: native
I0601 04:08:53.931034 13010 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d21c0] 0x13d5220 <nil> [] 0s} 127.0.0.1 51586 <nil> <nil>}
I0601 04:08:53.931096 13010 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0601 04:08:54.057512 13010 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0601 04:08:54.057602 13010 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220601040844-2342
I0601 04:08:54.130956 13010 main.go:134] libmachine: Using SSH client type: native
I0601 04:08:54.131092 13010 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d21c0] 0x13d5220 <nil> [] 0s} 127.0.0.1 51586 <nil> <nil>}
I0601 04:08:54.131106 13010 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0601 04:08:54.720887 13010 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-05-12 09:15:28.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2022-06-01 11:08:54.060942455 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0601 04:08:54.720913 13010 machine.go:91] provisioned docker machine in 1.908688293s
I0601 04:08:54.720921 13010 client.go:171] LocalClient.Create took 8.426928735s
I0601 04:08:54.720939 13010 start.go:173] duration metric: libmachine.API.Create for "old-k8s-version-20220601040844-2342" took 8.426980975s
I0601 04:08:54.720945 13010 start.go:306] post-start starting for "old-k8s-version-20220601040844-2342" (driver="docker")
I0601 04:08:54.720949 13010 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0601 04:08:54.721046 13010 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0601 04:08:54.721124 13010 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220601040844-2342
I0601 04:08:54.794377 13010 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51586 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/machines/old-k8s-version-20220601040844-2342/id_rsa Username:docker}
I0601 04:08:54.881203 13010 ssh_runner.go:195] Run: cat /etc/os-release
I0601 04:08:54.884698 13010 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0601 04:08:54.884716 13010 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0601 04:08:54.884723 13010 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0601 04:08:54.884728 13010 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0601 04:08:54.884736 13010 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/addons for local assets ...
I0601 04:08:54.884840 13010 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/files for local assets ...
I0601 04:08:54.885000 13010 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/files/etc/ssl/certs/23422.pem -> 23422.pem in /etc/ssl/certs
I0601 04:08:54.885145 13010 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0601 04:08:54.892092 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/files/etc/ssl/certs/23422.pem --> /etc/ssl/certs/23422.pem (1708 bytes)
I0601 04:08:54.909495 13010 start.go:309] post-start completed in 188.540154ms
I0601 04:08:54.935250 13010 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220601040844-2342
I0601 04:08:55.007769 13010 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/config.json ...
I0601 04:08:55.008189 13010 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0601 04:08:55.008241 13010 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220601040844-2342
I0601 04:08:55.080200 13010 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51586 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/machines/old-k8s-version-20220601040844-2342/id_rsa Username:docker}
I0601 04:08:55.164732 13010 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0601 04:08:55.169243 13010 start.go:134] duration metric: createHost completed in 8.934143719s
I0601 04:08:55.169265 13010 start.go:81] releasing machines lock for "old-k8s-version-20220601040844-2342", held for 8.934323487s
I0601 04:08:55.169344 13010 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220601040844-2342
I0601 04:08:55.239974 13010 ssh_runner.go:195] Run: systemctl --version
I0601 04:08:55.239974 13010 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0601 04:08:55.240036 13010 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220601040844-2342
I0601 04:08:55.240040 13010 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220601040844-2342
I0601 04:08:55.319409 13010 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51586 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/machines/old-k8s-version-20220601040844-2342/id_rsa Username:docker}
I0601 04:08:55.320706 13010 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51586 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/machines/old-k8s-version-20220601040844-2342/id_rsa Username:docker}
I0601 04:08:55.403933 13010 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0601 04:08:55.539625 13010 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0601 04:08:55.549728 13010 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0601 04:08:55.549782 13010 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0601 04:08:55.559077 13010 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0601 04:08:55.572462 13010 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0601 04:08:55.640645 13010 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0601 04:08:55.712974 13010 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0601 04:08:55.722510 13010 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0601 04:08:55.791264 13010 ssh_runner.go:195] Run: sudo systemctl start docker
I0601 04:08:55.800846 13010 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0601 04:08:55.837379 13010 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0601 04:08:55.916899 13010 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 20.10.16 ...
I0601 04:08:55.917067 13010 cli_runner.go:164] Run: docker exec -t old-k8s-version-20220601040844-2342 dig +short host.docker.internal
I0601 04:08:56.062832 13010 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0601 04:08:56.062926 13010 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0601 04:08:56.067229 13010 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0601 04:08:56.077213 13010 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-20220601040844-2342
I0601 04:08:56.148783 13010 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0601 04:08:56.148845 13010 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0601 04:08:56.181401 13010 docker.go:610] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0601 04:08:56.181416 13010 docker.go:541] Images already preloaded, skipping extraction
I0601 04:08:56.181487 13010 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0601 04:08:56.212904 13010 docker.go:610] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0601 04:08:56.212922 13010 cache_images.go:84] Images are preloaded, skipping loading
I0601 04:08:56.212997 13010 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0601 04:08:56.285514 13010 cni.go:95] Creating CNI manager for ""
I0601 04:08:56.285527 13010 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0601 04:08:56.285540 13010 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0601 04:08:56.285561 13010 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.58.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-20220601040844-2342 NodeName:old-k8s-version-20220601040844-2342 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.58.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.58.2 CgroupDriver:systemd ClientC
AFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I0601 04:08:56.285676 13010 kubeadm.go:162] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.58.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-20220601040844-2342"
kubeletExtraArgs:
node-ip: 192.168.58.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.58.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-20220601040844-2342
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.58.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0601 04:08:56.285757 13010 kubeadm.go:961] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-20220601040844-2342 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.58.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220601040844-2342 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0601 04:08:56.285813 13010 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0601 04:08:56.293624 13010 binaries.go:44] Found k8s binaries, skipping transfer
I0601 04:08:56.293675 13010 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0601 04:08:56.301150 13010 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (361 bytes)
I0601 04:08:56.313858 13010 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0601 04:08:56.326399 13010 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2146 bytes)
I0601 04:08:56.339053 13010 ssh_runner.go:195] Run: grep 192.168.58.2 control-plane.minikube.internal$ /etc/hosts
I0601 04:08:56.344944 13010 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.58.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0601 04:08:56.355457 13010 certs.go:54] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342 for IP: 192.168.58.2
I0601 04:08:56.355561 13010 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/ca.key
I0601 04:08:56.355612 13010 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/proxy-client-ca.key
I0601 04:08:56.355655 13010 certs.go:302] generating minikube-user signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/client.key
I0601 04:08:56.355664 13010 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/client.crt with IP's: []
I0601 04:08:56.500519 13010 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/client.crt ...
I0601 04:08:56.500537 13010 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/client.crt: {Name:mk0cc30adddfa5c143dc1528adb59a488da55086 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0601 04:08:56.500869 13010 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/client.key ...
I0601 04:08:56.500879 13010 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/client.key: {Name:mk3f63964b8f2e22538f45801b3d01802c1c96c0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0601 04:08:56.501118 13010 certs.go:302] generating minikube signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/apiserver.key.cee25041
I0601 04:08:56.501133 13010 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/apiserver.crt.cee25041 with IP's: [192.168.58.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0601 04:08:56.626598 13010 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/apiserver.crt.cee25041 ...
I0601 04:08:56.626610 13010 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/apiserver.crt.cee25041: {Name:mk61dc7aa5bdca9d1b4a7c14af7d305bfec271a5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0601 04:08:56.626855 13010 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/apiserver.key.cee25041 ...
I0601 04:08:56.626865 13010 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/apiserver.key.cee25041: {Name:mk80eb9289568b799f881a0a4de207f10a16f162 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0601 04:08:56.627095 13010 certs.go:320] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/apiserver.crt.cee25041 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/apiserver.crt
I0601 04:08:56.627246 13010 certs.go:324] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/apiserver.key.cee25041 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/apiserver.key
I0601 04:08:56.627415 13010 certs.go:302] generating aggregator signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/proxy-client.key
I0601 04:08:56.627430 13010 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/proxy-client.crt with IP's: []
I0601 04:08:56.726045 13010 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/proxy-client.crt ...
I0601 04:08:56.726054 13010 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/proxy-client.crt: {Name:mk3fa15b95b824005659f5b495d1c50cff098cb2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0601 04:08:56.726311 13010 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/proxy-client.key ...
I0601 04:08:56.726318 13010 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/proxy-client.key: {Name:mk2ddf2d6ad0429321e0124f9acdd31cbedc513f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0601 04:08:56.726740 13010 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/2342.pem (1338 bytes)
W0601 04:08:56.726779 13010 certs.go:384] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/2342_empty.pem, impossibly tiny 0 bytes
I0601 04:08:56.726788 13010 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/ca-key.pem (1679 bytes)
I0601 04:08:56.726817 13010 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/ca.pem (1078 bytes)
I0601 04:08:56.726846 13010 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/cert.pem (1123 bytes)
I0601 04:08:56.726875 13010 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/key.pem (1679 bytes)
I0601 04:08:56.726933 13010 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/files/etc/ssl/certs/23422.pem (1708 bytes)
I0601 04:08:56.727426 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0601 04:08:56.746346 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0601 04:08:56.766486 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0601 04:08:56.786440 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/profiles/old-k8s-version-20220601040844-2342/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0601 04:08:56.814514 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0601 04:08:56.838067 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0601 04:08:56.862816 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0601 04:08:56.882262 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0601 04:08:56.901106 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/certs/2342.pem --> /usr/share/ca-certificates/2342.pem (1338 bytes)
I0601 04:08:56.920222 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/files/etc/ssl/certs/23422.pem --> /usr/share/ca-certificates/23422.pem (1708 bytes)
I0601 04:08:56.937876 13010 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0601 04:08:56.955429 13010 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)
I0601 04:08:56.969100 13010 ssh_runner.go:195] Run: openssl version
I0601 04:08:56.979396 13010 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2342.pem && ln -fs /usr/share/ca-certificates/2342.pem /etc/ssl/certs/2342.pem"
I0601 04:08:56.988974 13010 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2342.pem
I0601 04:08:56.993925 13010 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 1 10:24 /usr/share/ca-certificates/2342.pem
I0601 04:08:56.993983 13010 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2342.pem
I0601 04:08:56.999530 13010 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2342.pem /etc/ssl/certs/51391683.0"
I0601 04:08:57.008449 13010 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/23422.pem && ln -fs /usr/share/ca-certificates/23422.pem /etc/ssl/certs/23422.pem"
I0601 04:08:57.021969 13010 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/23422.pem
I0601 04:08:57.027460 13010 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 1 10:24 /usr/share/ca-certificates/23422.pem
I0601 04:08:57.027504 13010 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/23422.pem
I0601 04:08:57.033246 13010 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/23422.pem /etc/ssl/certs/3ec20f2e.0"
I0601 04:08:57.041396 13010 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0601 04:08:57.049271 13010 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0601 04:08:57.053251 13010 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 1 10:20 /usr/share/ca-certificates/minikubeCA.pem
I0601 04:08:57.053326 13010 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0601 04:08:57.059500 13010 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0601 04:08:57.067529 13010 kubeadm.go:395] StartCluster: {Name:old-k8s-version-20220601040844-2342 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653677545-13807@sha256:312115a5663b1250effab8ed8ada9435fca80af41962223c98bf66f86b32c52a Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220601040844-2342 Namespace:default APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.58.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disabl
eOptimizations:false DisableMetrics:false}
I0601 04:08:57.067622 13010 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0601 04:08:57.096561 13010 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0601 04:08:57.104458 13010 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0601 04:08:57.111546 13010 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0601 04:08:57.111588 13010 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0601 04:08:57.118987 13010 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0601 04:08:57.119016 13010 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0601 04:08:57.879336 13010 out.go:204] - Generating certificates and keys ...
I0601 04:09:00.468187 13010 out.go:204] - Booting up control plane ...
W0601 04:10:55.374232 13010 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220601040844-2342 localhost] and IPs [192.168.58.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220601040844-2342 localhost] and IPs [192.168.58.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.16. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220601040844-2342 localhost] and IPs [192.168.58.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220601040844-2342 localhost] and IPs [192.168.58.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.16. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0601 04:10:55.374263 13010 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0601 04:10:55.796813 13010 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0601 04:10:55.806998 13010 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0601 04:10:55.807039 13010 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0601 04:10:55.815066 13010 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0601 04:10:55.815088 13010 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0601 04:10:56.539753 13010 out.go:204] - Generating certificates and keys ...
I0601 04:10:57.218363 13010 out.go:204] - Booting up control plane ...
I0601 04:12:52.134499 13010 kubeadm.go:397] StartCluster complete in 3m55.06438789s
I0601 04:12:52.134591 13010 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0601 04:12:52.166452 13010 logs.go:274] 0 containers: []
W0601 04:12:52.166465 13010 logs.go:276] No container was found matching "kube-apiserver"
I0601 04:12:52.166520 13010 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0601 04:12:52.197045 13010 logs.go:274] 0 containers: []
W0601 04:12:52.197056 13010 logs.go:276] No container was found matching "etcd"
I0601 04:12:52.197111 13010 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0601 04:12:52.228273 13010 logs.go:274] 0 containers: []
W0601 04:12:52.228286 13010 logs.go:276] No container was found matching "coredns"
I0601 04:12:52.228343 13010 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0601 04:12:52.257875 13010 logs.go:274] 0 containers: []
W0601 04:12:52.257887 13010 logs.go:276] No container was found matching "kube-scheduler"
I0601 04:12:52.257940 13010 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0601 04:12:52.286891 13010 logs.go:274] 0 containers: []
W0601 04:12:52.286905 13010 logs.go:276] No container was found matching "kube-proxy"
I0601 04:12:52.286964 13010 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0601 04:12:52.316970 13010 logs.go:274] 0 containers: []
W0601 04:12:52.316982 13010 logs.go:276] No container was found matching "kubernetes-dashboard"
I0601 04:12:52.317038 13010 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0601 04:12:52.346364 13010 logs.go:274] 0 containers: []
W0601 04:12:52.346376 13010 logs.go:276] No container was found matching "storage-provisioner"
I0601 04:12:52.346439 13010 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0601 04:12:52.375194 13010 logs.go:274] 0 containers: []
W0601 04:12:52.375205 13010 logs.go:276] No container was found matching "kube-controller-manager"
I0601 04:12:52.375223 13010 logs.go:123] Gathering logs for dmesg ...
I0601 04:12:52.375230 13010 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0601 04:12:52.387207 13010 logs.go:123] Gathering logs for describe nodes ...
I0601 04:12:52.387221 13010 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0601 04:12:52.440504 13010 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0601 04:12:52.440514 13010 logs.go:123] Gathering logs for Docker ...
I0601 04:12:52.440522 13010 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0601 04:12:52.454274 13010 logs.go:123] Gathering logs for container status ...
I0601 04:12:52.454286 13010 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0601 04:12:54.507467 13010 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.053145235s)
I0601 04:12:54.507603 13010 logs.go:123] Gathering logs for kubelet ...
I0601 04:12:54.507610 13010 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0601 04:12:54.546264 13010 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.16. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0601 04:12:54.546282 13010 out.go:239] *
*
W0601 04:12:54.546405 13010 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.16. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.16. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0601 04:12:54.546420 13010 out.go:239] *
*
W0601 04:12:54.546941 13010 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0601 04:12:54.626744 13010 out.go:177]
W0601 04:12:54.648956 13010 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.16. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.16. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0601 04:12:54.649150 13010 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0601 04:12:54.649245 13010 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0601 04:12:54.691647 13010 out.go:177]
** /stderr **
start_stop_delete_test.go:190: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-20220601040844-2342 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-20220601040844-2342
helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220601040844-2342:
-- stdout --
[
{
"Id": "91a44163d23550afa95e57092af54742c4a2e86b4336ccb0573c35ecc80094ef",
"Created": "2022-06-01T11:08:51.714948054Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 194737,
"ExitCode": 0,
"Error": "",
"StartedAt": "2022-06-01T11:08:52.03954689Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:5fc9565d342f677dd8987c0c7656d8d58147ab45c932c9076935b38a770e4cf7",
"ResolvConfPath": "/var/lib/docker/containers/91a44163d23550afa95e57092af54742c4a2e86b4336ccb0573c35ecc80094ef/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/91a44163d23550afa95e57092af54742c4a2e86b4336ccb0573c35ecc80094ef/hostname",
"HostsPath": "/var/lib/docker/containers/91a44163d23550afa95e57092af54742c4a2e86b4336ccb0573c35ecc80094ef/hosts",
"LogPath": "/var/lib/docker/containers/91a44163d23550afa95e57092af54742c4a2e86b4336ccb0573c35ecc80094ef/91a44163d23550afa95e57092af54742c4a2e86b4336ccb0573c35ecc80094ef-json.log",
"Name": "/old-k8s-version-20220601040844-2342",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-20220601040844-2342:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-20220601040844-2342",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/877002bf6efa6b43d3c16b0de02746f563ba9b189b8f34b7ec178fe6662a56a3-init/diff:/var/lib/docker/overlay2/a7bc9f1c6adb86c40dab88b0ff83084c2d8619839b3853fff9dae7ffe5649a91/diff:/var/lib/docker/overlay2/25435d341e7689153b5b1f3ab103d94dd925cee61a075d073a330405cdbd05af/diff:/var/lib/docker/overlay2/83568d387a1bd890da6e46938c943dc66012f4346dbabf5e96b09f85cfca44fe/diff:/var/lib/docker/overlay2/ca5cbd9c70a3d005491d350603a20d1c4c1f7061fc868e3e577b05308447df4c/diff:/var/lib/docker/overlay2/76b2059db7625d625832c0189df9b6173d33cf1898926f49b38b1279224e24ea/diff:/var/lib/docker/overlay2/0d832c4100492119f58403b5ac1757188e3bc934085c935a5454a0df21ee9ed8/diff:/var/lib/docker/overlay2/118799014bbf1198aa01a7a6aad0e62909c310499174c8e35d3ce8b47e6947db/diff:/var/lib/docker/overlay2/99986f402c4100a4976492abfd2b5a1e1385e5e0dea37fdd45097450bde3781c/diff:/var/lib/docker/overlay2/20dd2a8ea4ac5531ec621c9fc545feeee8634cd0453cc5480190c4473eeb8364/diff:/var/lib/docker/overlay2/4faacb
71201c10e9b3b0f88939836a34339abec8d7e37e07f5f3f4980f718b07/diff:/var/lib/docker/overlay2/bbacfddf7562d84f8b6772603002962ccc9a3be6b0579b3cbaf21b2c4d0da87b/diff:/var/lib/docker/overlay2/bb08465dc501b97f34e3924b27c8f79e882e2d8010eb66d5e808aef73afb5e47/diff:/var/lib/docker/overlay2/291600d3e1fa5fffdd396a001f887ddc63764780f65d30604188c7e913227490/diff:/var/lib/docker/overlay2/9760937ef08fe99065259f0c82065e20578b8b55825f3552cdcfe070a18b8ff2/diff:/var/lib/docker/overlay2/0d35e140b62573c1ba9a8245efa98c13bb7607ea01c4bce314347ea4ec8c780b/diff:/var/lib/docker/overlay2/3d5d03150458f950999f0e21aeeb8011be35fb849667954f6feaa4d2c6e4ae3b/diff:/var/lib/docker/overlay2/b8ad8f28a690f09a9f1966fa68270f46660fb2dff94c5b769c66828097203937/diff:/var/lib/docker/overlay2/d0ec3965c3286b3f8b62f715fc9bf0e66e9c903b76ca581d711d1a05dd24735e/diff:/var/lib/docker/overlay2/b352c170d6e87865732325f5b4c40c13a61b3feb92fda186495a93dae5aea451/diff:/var/lib/docker/overlay2/2ceb9a2177e737f38e42633a480dad1c55750b5d08c526c02d0910cf8c349cd9/diff:/var/lib/d
ocker/overlay2/42ccd3f14ab5e0afadfc4f8113b4c8747ae1aa6907e4cd57223a8eadad0bf7d4/diff:/var/lib/docker/overlay2/9d90656fbaf4ee62fbe1f548325bf292cb9c110ac9c306985533e9380c4984c8/diff:/var/lib/docker/overlay2/901797bbe051cfc2a518f0c57cbb23e44868500ea2bc08f98913aa840852939a/diff:/var/lib/docker/overlay2/408097fc2bc381937b0edfe9a74553e1f3dad5c55473818132398fa579f57637/diff:/var/lib/docker/overlay2/2e084237b1229f10f25c4e6fd085e2131bb02a8207fcaabfa930891c1969ff7e/diff:/var/lib/docker/overlay2/5e70a13cd950865cb0d02be73f5d62446f582e66e063b262d1d4577d04f431ab/diff:/var/lib/docker/overlay2/ad732ab86e0dc4abb95ba0b4a440978c8451848759d846ee02822da6d4f61eff/diff:/var/lib/docker/overlay2/bc48ed47ebaae8437c590d59d873d5629964585224cd48bd072282f6ebbd5a50/diff:/var/lib/docker/overlay2/6084baa67099034455de91a177901a8e6a16f9e8e394d9890a5da208ab41970e/diff:/var/lib/docker/overlay2/3d68472547212e455565793a499bbcd6d2f64b6affe8d4d743d650d38d7eda21/diff:/var/lib/docker/overlay2/653977a916a0b1af671ac663aca0be8a2716890007581ce1bbf20a66da0
65f94/diff:/var/lib/docker/overlay2/c73c15aa2c5fcdbb60e2a229a927785f253f88d31ee8ca4d620f9a9402b50ece/diff:/var/lib/docker/overlay2/4c9fc052f57ef0f85f3ad2e11914041b8a47ae401f27d86c5072a9790eea6877/diff:/var/lib/docker/overlay2/0540cdd7ab532bc7ea5ef34335870c09fd9ab847d589801690652526897df14e/diff:/var/lib/docker/overlay2/ecc9607dda04d45155868801f43b6cba23ea7bebdf3e4c2c51fbf409970bc3da/diff:/var/lib/docker/overlay2/6d73bc8e2d82cc3775292a4cac515ba668e8334939d147a844b3c262f2b374ce/diff:/var/lib/docker/overlay2/4c3b8e026d6a9ffe74f6dc59ceacec018e21429aa562698b799c56782762e06a/diff:/var/lib/docker/overlay2/87b63c6aed3096bebffe5284388ecda75a6ce62a36b60378a46c2bdbd426491b/diff:/var/lib/docker/overlay2/71ac1e93b44005f612c6de074670ee527af4944d7d5cec9aa8a523e0a584033a/diff:/var/lib/docker/overlay2/c2273919e078857807a444021b329cf7984077d7a9ff80c38d359fc4ad648571/diff:/var/lib/docker/overlay2/9bdcc31759c1ee0f19c47f01537ef10cd13906b320f8de211c8d80da88e835ca/diff",
"MergedDir": "/var/lib/docker/overlay2/877002bf6efa6b43d3c16b0de02746f563ba9b189b8f34b7ec178fe6662a56a3/merged",
"UpperDir": "/var/lib/docker/overlay2/877002bf6efa6b43d3c16b0de02746f563ba9b189b8f34b7ec178fe6662a56a3/diff",
"WorkDir": "/var/lib/docker/overlay2/877002bf6efa6b43d3c16b0de02746f563ba9b189b8f34b7ec178fe6662a56a3/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-20220601040844-2342",
"Source": "/var/lib/docker/volumes/old-k8s-version-20220601040844-2342/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-20220601040844-2342",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653677545-13807@sha256:312115a5663b1250effab8ed8ada9435fca80af41962223c98bf66f86b32c52a",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-20220601040844-2342",
"name.minikube.sigs.k8s.io": "old-k8s-version-20220601040844-2342",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "ff35b527a7d795eaae377452f6f84a2ab59d3e8a63ed1d11c174002578be0c98",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "51586"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "51587"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "51583"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "51584"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "51585"
}
]
},
"SandboxKey": "/var/run/docker/netns/ff35b527a7d7",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-20220601040844-2342": {
"IPAMConfig": {
"IPv4Address": "192.168.58.2"
},
"Links": null,
"Aliases": [
"91a44163d235",
"old-k8s-version-20220601040844-2342"
],
"NetworkID": "19418e1daf902e10e91ecb0632ae46e6cbb8b43c0deeca829a591ae95b7f1e4b",
"EndpointID": "1ede62e7d615ff8e30a6e79a7faeb0756e32780ae82ba1401755b22bde0262c1",
"Gateway": "192.168.58.1",
"IPAddress": "192.168.58.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:3a:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220601040844-2342 -n old-k8s-version-20220601040844-2342
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220601040844-2342 -n old-k8s-version-20220601040844-2342: exit status 6 (443.559579ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0601 04:12:55.293149 13450 status.go:413] kubeconfig endpoint: extract IP: "old-k8s-version-20220601040844-2342" does not appear in /Users/jenkins/minikube-integration/darwin-amd64-docker--14079-1198-798c4e8fed290cfa318a9fb994a7c6f555db39c1/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-20220601040844-2342" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (250.44s)