=== RUN TestNetworkPlugins/group/calico/Start
net_test.go:98: (dbg) Run: out/minikube-darwin-amd64 start -p calico-20210810163155-11199 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=docker
E0810 17:00:26.148198 11199 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/default-k8s-different-port-20210810164659-11199/client.crt: no such file or directory
=== CONT TestNetworkPlugins/group/calico/Start
net_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p calico-20210810163155-11199 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=docker : exit status 1 (1m32.917652002s)
-- stdout --
* [calico-20210810163155-11199] minikube v1.22.0 on Darwin 11.2.1
- MINIKUBE_LOCATION=12230
- KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube
* Using the docker driver based on user configuration
* Starting control plane node calico-20210810163155-11199 in cluster calico-20210810163155-11199
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2048MB) ...
* Preparing Kubernetes v1.21.3 on Docker 20.10.7 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Configuring RBAC rules ...
* Configuring Calico (Container Networking Interface) ...
- Generating certificates and keys ...
- Booting up control plane ...
- Configuring RBAC rules ...
* Configuring Calico (Container Networking Interface) ...
-- /stdout --
** stderr **
I0810 17:00:21.216066 29371 out.go:298] Setting OutFile to fd 1 ...
I0810 17:00:21.216209 29371 out.go:345] TERM=,COLORTERM=, which probably does not support color
I0810 17:00:21.216214 29371 out.go:311] Setting ErrFile to fd 2...
I0810 17:00:21.216217 29371 out.go:345] TERM=,COLORTERM=, which probably does not support color
I0810 17:00:21.216306 29371 root.go:313] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/bin
I0810 17:00:21.216653 29371 out.go:305] Setting JSON to false
I0810 17:00:21.238022 29371 start.go:111] hostinfo: {"hostname":"20446.local","uptime":12596,"bootTime":1628627425,"procs":335,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.1","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"c86236b2-4976-3542-80ca-74a6b8b4ba03"}
W0810 17:00:21.238105 29371 start.go:119] gopshost.Virtualization returned error: not implemented yet
I0810 17:00:21.264818 29371 out.go:177] * [calico-20210810163155-11199] minikube v1.22.0 on Darwin 11.2.1
I0810 17:00:21.264919 29371 notify.go:169] Checking for updates...
I0810 17:00:21.311996 29371 out.go:177] - MINIKUBE_LOCATION=12230
I0810 17:00:21.337762 29371 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/kubeconfig
I0810 17:00:21.363892 29371 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0810 17:00:21.389841 29371 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube
I0810 17:00:21.390355 29371 driver.go:335] Setting default libvirt URI to qemu:///system
I0810 17:00:21.489222 29371 docker.go:132] docker version: linux-20.10.6
I0810 17:00:21.489336 29371 cli_runner.go:115] Run: docker system info --format "{{json .}}"
I0810 17:00:21.686002 29371 info.go:263] docker info: {ID:RWIN:6Z37:RGZW:YLYT:MQOK:WVL2:5PLP:B47J:AARK:4JSA:SXRJ:PLH2 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:19 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:51 SystemTime:2021-08-11 00:00:21.612574412 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer
Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec
comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}
I0810 17:00:21.732813 29371 out.go:177] * Using the docker driver based on user configuration
I0810 17:00:21.732836 29371 start.go:278] selected driver: docker
I0810 17:00:21.732844 29371 start.go:751] validating driver "docker" against <nil>
I0810 17:00:21.732857 29371 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}
I0810 17:00:21.735603 29371 cli_runner.go:115] Run: docker system info --format "{{json .}}"
I0810 17:00:21.928089 29371 info.go:263] docker info: {ID:RWIN:6Z37:RGZW:YLYT:MQOK:WVL2:5PLP:B47J:AARK:4JSA:SXRJ:PLH2 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:19 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:51 SystemTime:2021-08-11 00:00:21.857206576 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer
Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec
comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}
I0810 17:00:21.928226 29371 start_flags.go:263] no existing cluster config was found, will generate one from the flags
I0810 17:00:21.928352 29371 start_flags.go:697] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0810 17:00:21.928370 29371 cni.go:93] Creating CNI manager for "calico"
I0810 17:00:21.928380 29371 start_flags.go:272] Found "Calico" CNI - setting NetworkPlugin=cni
I0810 17:00:21.928391 29371 start_flags.go:277] config:
{Name:calico-20210810163155-11199 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:calico-20210810163155-11199 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: Ne
tworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
I0810 17:00:21.955417 29371 out.go:177] * Starting control plane node calico-20210810163155-11199 in cluster calico-20210810163155-11199
I0810 17:00:21.955457 29371 cache.go:117] Beginning downloading kic base image for docker with docker
I0810 17:00:22.003796 29371 out.go:177] * Pulling base image ...
I0810 17:00:22.003927 29371 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker
I0810 17:00:22.003942 29371 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 in local docker daemon
I0810 17:00:22.004011 29371 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4
I0810 17:00:22.004040 29371 cache.go:56] Caching tarball of preloaded images
I0810 17:00:22.004239 29371 preload.go:173] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0810 17:00:22.004258 29371 cache.go:59] Finished verifying existence of preloaded tar for v1.21.3 on docker
I0810 17:00:22.005892 29371 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/config.json ...
I0810 17:00:22.006024 29371 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/config.json: {Name:mk0e3131939ea29b15e5391d82b293d20b6d0390 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0810 17:00:22.130719 29371 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 in local docker daemon, skipping pull
I0810 17:00:22.130744 29371 cache.go:139] gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 exists in daemon, skipping load
I0810 17:00:22.130756 29371 cache.go:205] Successfully downloaded all kic artifacts
I0810 17:00:22.130819 29371 start.go:313] acquiring machines lock for calico-20210810163155-11199: {Name:mka240217d48c51f11acc99c11730751f6b0c86f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0810 17:00:22.131260 29371 start.go:317] acquired machines lock for "calico-20210810163155-11199" in 428.035µs
I0810 17:00:22.131312 29371 start.go:89] Provisioning new machine with config: &{Name:calico-20210810163155-11199 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:calico-20210810163155-11199 Namespace:default APIServerName:minikubeCA APIServerName
s:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0} &{Name: IP: Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}
I0810 17:00:22.131374 29371 start.go:126] createHost starting for "" (driver="docker")
I0810 17:00:22.184893 29371 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...
I0810 17:00:22.185234 29371 start.go:160] libmachine.API.Create for "calico-20210810163155-11199" (driver="docker")
I0810 17:00:22.185279 29371 client.go:168] LocalClient.Create starting
I0810 17:00:22.185418 29371 main.go:130] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca.pem
I0810 17:00:22.185502 29371 main.go:130] libmachine: Decoding PEM data...
I0810 17:00:22.185530 29371 main.go:130] libmachine: Parsing certificate...
I0810 17:00:22.185660 29371 main.go:130] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/cert.pem
I0810 17:00:22.185707 29371 main.go:130] libmachine: Decoding PEM data...
I0810 17:00:22.185732 29371 main.go:130] libmachine: Parsing certificate...
I0810 17:00:22.186337 29371 cli_runner.go:115] Run: docker network inspect calico-20210810163155-11199 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0810 17:00:22.302827 29371 cli_runner.go:162] docker network inspect calico-20210810163155-11199 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0810 17:00:22.302941 29371 network_create.go:255] running [docker network inspect calico-20210810163155-11199] to gather additional debugging logs...
I0810 17:00:22.302960 29371 cli_runner.go:115] Run: docker network inspect calico-20210810163155-11199
W0810 17:00:22.418539 29371 cli_runner.go:162] docker network inspect calico-20210810163155-11199 returned with exit code 1
I0810 17:00:22.418563 29371 network_create.go:258] error running [docker network inspect calico-20210810163155-11199]: docker network inspect calico-20210810163155-11199: exit status 1
stdout:
[]
stderr:
Error: No such network: calico-20210810163155-11199
I0810 17:00:22.418592 29371 network_create.go:260] output of [docker network inspect calico-20210810163155-11199]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: calico-20210810163155-11199
** /stderr **
I0810 17:00:22.418684 29371 cli_runner.go:115] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0810 17:00:22.538661 29371 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc0001b27c8] misses:0}
I0810 17:00:22.538702 29371 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0810 17:00:22.538724 29371 network_create.go:106] attempt to create docker network calico-20210810163155-11199 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0810 17:00:22.538802 29371 cli_runner.go:115] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true calico-20210810163155-11199
I0810 17:00:24.060411 29371 cli_runner.go:168] Completed: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true calico-20210810163155-11199: (1.521578841s)
I0810 17:00:24.060461 29371 network_create.go:90] docker network calico-20210810163155-11199 192.168.49.0/24 created
I0810 17:00:24.060478 29371 kic.go:106] calculated static IP "192.168.49.2" for the "calico-20210810163155-11199" container
I0810 17:00:24.060620 29371 cli_runner.go:115] Run: docker ps -a --format {{.Names}}
I0810 17:00:24.179250 29371 cli_runner.go:115] Run: docker volume create calico-20210810163155-11199 --label name.minikube.sigs.k8s.io=calico-20210810163155-11199 --label created_by.minikube.sigs.k8s.io=true
I0810 17:00:24.298594 29371 oci.go:102] Successfully created a docker volume calico-20210810163155-11199
I0810 17:00:24.298723 29371 cli_runner.go:115] Run: docker run --rm --name calico-20210810163155-11199-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=calico-20210810163155-11199 --entrypoint /usr/bin/test -v calico-20210810163155-11199:/var gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -d /var/lib
I0810 17:00:24.876640 29371 oci.go:106] Successfully prepared a docker volume calico-20210810163155-11199
I0810 17:00:24.876714 29371 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker
I0810 17:00:24.876732 29371 kic.go:179] Starting extracting preloaded images to volume ...
I0810 17:00:24.876769 29371 cli_runner.go:115] Run: docker info --format "'{{json .SecurityOptions}}'"
I0810 17:00:24.876823 29371 cli_runner.go:115] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v calico-20210810163155-11199:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -I lz4 -xf /preloaded.tar -C /extractDir
I0810 17:00:25.084919 29371 cli_runner.go:115] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname calico-20210810163155-11199 --name calico-20210810163155-11199 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=calico-20210810163155-11199 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=calico-20210810163155-11199 --network calico-20210810163155-11199 --ip 192.168.49.2 --volume calico-20210810163155-11199:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79
I0810 17:00:30.148607 29371 cli_runner.go:168] Completed: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname calico-20210810163155-11199 --name calico-20210810163155-11199 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=calico-20210810163155-11199 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=calico-20210810163155-11199 --network calico-20210810163155-11199 --ip 192.168.49.2 --volume calico-20210810163155-11199:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79: (5.063701576s)
I0810 17:00:30.150299 29371 cli_runner.go:115] Run: docker container inspect calico-20210810163155-11199 --format={{.State.Running}}
I0810 17:00:30.290570 29371 cli_runner.go:115] Run: docker container inspect calico-20210810163155-11199 --format={{.State.Status}}
I0810 17:00:30.432556 29371 cli_runner.go:115] Run: docker exec calico-20210810163155-11199 stat /var/lib/dpkg/alternatives/iptables
I0810 17:00:30.770070 29371 oci.go:278] the created container "calico-20210810163155-11199" has a running status.
I0810 17:00:30.770116 29371 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/calico-20210810163155-11199/id_rsa...
I0810 17:00:30.934710 29371 cli_runner.go:168] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v calico-20210810163155-11199:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -I lz4 -xf /preloaded.tar -C /extractDir: (6.057940943s)
I0810 17:00:30.934726 29371 kic.go:188] duration metric: took 6.058108 seconds to extract preloaded images to volume
I0810 17:00:31.012905 29371 kic_runner.go:188] docker (temp): /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/calico-20210810163155-11199/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0810 17:00:31.204896 29371 cli_runner.go:115] Run: docker container inspect calico-20210810163155-11199 --format={{.State.Status}}
I0810 17:00:31.366602 29371 kic_runner.go:94] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0810 17:00:31.366621 29371 kic_runner.go:115] Args: [docker exec --privileged calico-20210810163155-11199 chown docker:docker /home/docker/.ssh/authorized_keys]
I0810 17:00:31.541931 29371 cli_runner.go:115] Run: docker container inspect calico-20210810163155-11199 --format={{.State.Status}}
I0810 17:00:31.664942 29371 machine.go:88] provisioning docker machine ...
I0810 17:00:31.664983 29371 ubuntu.go:169] provisioning hostname "calico-20210810163155-11199"
I0810 17:00:31.665081 29371 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810163155-11199
I0810 17:00:31.784518 29371 main.go:130] libmachine: Using SSH client type: native
I0810 17:00:31.784706 29371 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil> [] 0s} 127.0.0.1 65530 <nil> <nil>}
I0810 17:00:31.784727 29371 main.go:130] libmachine: About to run SSH command:
sudo hostname calico-20210810163155-11199 && echo "calico-20210810163155-11199" | sudo tee /etc/hostname
I0810 17:00:31.915819 29371 main.go:130] libmachine: SSH cmd err, output: <nil>: calico-20210810163155-11199
I0810 17:00:31.915929 29371 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810163155-11199
I0810 17:00:32.036831 29371 main.go:130] libmachine: Using SSH client type: native
I0810 17:00:32.037010 29371 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil> [] 0s} 127.0.0.1 65530 <nil> <nil>}
I0810 17:00:32.037027 29371 main.go:130] libmachine: About to run SSH command:
if ! grep -xq '.*\scalico-20210810163155-11199' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 calico-20210810163155-11199/g' /etc/hosts;
else
echo '127.0.1.1 calico-20210810163155-11199' | sudo tee -a /etc/hosts;
fi
fi
I0810 17:00:32.153382 29371 main.go:130] libmachine: SSH cmd err, output: <nil>:
I0810 17:00:32.153404 29371 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/key.pem ServerCertRemotePath:/etc/doc
ker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube}
I0810 17:00:32.153429 29371 ubuntu.go:177] setting up certificates
I0810 17:00:32.153435 29371 provision.go:83] configureAuth start
I0810 17:00:32.153518 29371 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" calico-20210810163155-11199
I0810 17:00:32.272985 29371 provision.go:137] copyHostCerts
I0810 17:00:32.273094 29371 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/key.pem, removing ...
I0810 17:00:32.273109 29371 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/key.pem
I0810 17:00:32.273881 29371 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/key.pem (1675 bytes)
I0810 17:00:32.274078 29371 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/ca.pem, removing ...
I0810 17:00:32.274088 29371 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/ca.pem
I0810 17:00:32.274146 29371 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/ca.pem (1078 bytes)
I0810 17:00:32.274302 29371 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/cert.pem, removing ...
I0810 17:00:32.274319 29371 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/cert.pem
I0810 17:00:32.274375 29371 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/cert.pem (1123 bytes)
I0810 17:00:32.274500 29371 provision.go:111] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca-key.pem org=jenkins.calico-20210810163155-11199 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube calico-20210810163155-11199]
I0810 17:00:32.389856 29371 provision.go:171] copyRemoteCerts
I0810 17:00:32.390167 29371 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0810 17:00:32.390235 29371 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810163155-11199
I0810 17:00:32.511152 29371 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:65530 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/calico-20210810163155-11199/id_rsa Username:docker}
I0810 17:00:32.597997 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0810 17:00:32.618231 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/server.pem --> /etc/docker/server.pem (1257 bytes)
I0810 17:00:32.637464 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0810 17:00:32.657242 29371 provision.go:86] duration metric: configureAuth took 503.800406ms
I0810 17:00:32.657262 29371 ubuntu.go:193] setting minikube options for container-runtime
I0810 17:00:32.657472 29371 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810163155-11199
I0810 17:00:32.778776 29371 main.go:130] libmachine: Using SSH client type: native
I0810 17:00:32.778939 29371 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil> [] 0s} 127.0.0.1 65530 <nil> <nil>}
I0810 17:00:32.778955 29371 main.go:130] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0810 17:00:32.897625 29371 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay
I0810 17:00:32.897640 29371 ubuntu.go:71] root file system type: overlay
I0810 17:00:32.897870 29371 provision.go:308] Updating docker unit: /lib/systemd/system/docker.service ...
I0810 17:00:32.897978 29371 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810163155-11199
I0810 17:00:33.020833 29371 main.go:130] libmachine: Using SSH client type: native
I0810 17:00:33.020995 29371 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil> [] 0s} 127.0.0.1 65530 <nil> <nil>}
I0810 17:00:33.021051 29371 main.go:130] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0810 17:00:33.146013 29371 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0810 17:00:33.146125 29371 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810163155-11199
I0810 17:00:33.268572 29371 main.go:130] libmachine: Using SSH client type: native
I0810 17:00:33.268727 29371 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil> [] 0s} 127.0.0.1 65530 <nil> <nil>}
I0810 17:00:33.268740 29371 main.go:130] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0810 17:00:58.793440 29371 main.go:130] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2021-06-02 11:54:50.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2021-08-11 00:00:33.154921904 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
+BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0810 17:00:58.793473 29371 machine.go:91] provisioned docker machine in 27.129011159s
I0810 17:00:58.793480 29371 client.go:171] LocalClient.Create took 36.608872803s
I0810 17:00:58.793498 29371 start.go:168] duration metric: libmachine.API.Create for "calico-20210810163155-11199" took 36.608945007s
I0810 17:00:58.793509 29371 start.go:267] post-start starting for "calico-20210810163155-11199" (driver="docker")
I0810 17:00:58.793514 29371 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0810 17:00:58.793610 29371 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0810 17:00:58.793713 29371 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810163155-11199
I0810 17:00:58.917242 29371 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:65530 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/calico-20210810163155-11199/id_rsa Username:docker}
I0810 17:00:59.005009 29371 ssh_runner.go:149] Run: cat /etc/os-release
I0810 17:00:59.008751 29371 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0810 17:00:59.008767 29371 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0810 17:00:59.008780 29371 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0810 17:00:59.008787 29371 info.go:137] Remote host: Ubuntu 20.04.2 LTS
I0810 17:00:59.008799 29371 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/addons for local assets ...
I0810 17:00:59.009380 29371 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/files for local assets ...
I0810 17:00:59.009854 29371 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/files/etc/ssl/certs/111992.pem -> 111992.pem in /etc/ssl/certs
I0810 17:00:59.010034 29371 ssh_runner.go:149] Run: sudo mkdir -p /etc/ssl/certs
I0810 17:00:59.017477 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/files/etc/ssl/certs/111992.pem --> /etc/ssl/certs/111992.pem (1708 bytes)
I0810 17:00:59.045219 29371 start.go:270] post-start completed in 251.705945ms
I0810 17:00:59.045958 29371 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" calico-20210810163155-11199
I0810 17:00:59.163093 29371 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/config.json ...
I0810 17:00:59.164008 29371 ssh_runner.go:149] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0810 17:00:59.164108 29371 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810163155-11199
I0810 17:00:59.282860 29371 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:65530 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/calico-20210810163155-11199/id_rsa Username:docker}
I0810 17:00:59.365587 29371 start.go:129] duration metric: createHost completed in 37.234893507s
I0810 17:00:59.365604 29371 start.go:80] releasing machines lock for "calico-20210810163155-11199", held for 37.235028073s
I0810 17:00:59.365715 29371 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" calico-20210810163155-11199
I0810 17:00:59.481737 29371 ssh_runner.go:149] Run: systemctl --version
I0810 17:00:59.481828 29371 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810163155-11199
I0810 17:00:59.482841 29371 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/
I0810 17:00:59.483013 29371 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810163155-11199
I0810 17:00:59.605186 29371 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:65530 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/calico-20210810163155-11199/id_rsa Username:docker}
I0810 17:00:59.605196 29371 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:65530 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/calico-20210810163155-11199/id_rsa Username:docker}
I0810 17:00:59.803035 29371 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd
I0810 17:00:59.812643 29371 ssh_runner.go:149] Run: sudo systemctl cat docker.service
I0810 17:00:59.822470 29371 cruntime.go:249] skipping containerd shutdown because we are bound to it
I0810 17:00:59.822536 29371 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio
I0810 17:00:59.832357 29371 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0810 17:00:59.845588 29371 ssh_runner.go:149] Run: sudo systemctl unmask docker.service
I0810 17:00:59.905727 29371 ssh_runner.go:149] Run: sudo systemctl enable docker.socket
I0810 17:00:59.964731 29371 ssh_runner.go:149] Run: sudo systemctl cat docker.service
I0810 17:00:59.975026 29371 ssh_runner.go:149] Run: sudo systemctl daemon-reload
I0810 17:01:00.033572 29371 ssh_runner.go:149] Run: sudo systemctl start docker
I0810 17:01:00.043899 29371 ssh_runner.go:149] Run: docker version --format {{.Server.Version}}
I0810 17:01:00.089297 29371 ssh_runner.go:149] Run: docker version --format {{.Server.Version}}
I0810 17:01:00.180928 29371 out.go:204] * Preparing Kubernetes v1.21.3 on Docker 20.10.7 ...
I0810 17:01:00.181120 29371 cli_runner.go:115] Run: docker exec -t calico-20210810163155-11199 dig +short host.docker.internal
I0810 17:01:00.371801 29371 network.go:69] got host ip for mount in container by digging dns: 192.168.65.2
I0810 17:01:00.372614 29371 ssh_runner.go:149] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0810 17:01:00.377724 29371 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0810 17:01:00.387585 29371 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" calico-20210810163155-11199
I0810 17:01:00.505555 29371 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker
I0810 17:01:00.505645 29371 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}
I0810 17:01:00.541694 29371 docker.go:535] Got preloaded images: -- stdout --
k8s.gcr.io/kube-apiserver:v1.21.3
k8s.gcr.io/kube-scheduler:v1.21.3
k8s.gcr.io/kube-proxy:v1.21.3
k8s.gcr.io/kube-controller-manager:v1.21.3
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/pause:3.4.1
kubernetesui/dashboard:v2.1.0
k8s.gcr.io/coredns/coredns:v1.8.0
k8s.gcr.io/etcd:3.4.13-0
kubernetesui/metrics-scraper:v1.0.4
-- /stdout --
I0810 17:01:00.541706 29371 docker.go:466] Images already preloaded, skipping extraction
I0810 17:01:00.541793 29371 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}
I0810 17:01:00.576496 29371 docker.go:535] Got preloaded images: -- stdout --
k8s.gcr.io/kube-apiserver:v1.21.3
k8s.gcr.io/kube-scheduler:v1.21.3
k8s.gcr.io/kube-controller-manager:v1.21.3
k8s.gcr.io/kube-proxy:v1.21.3
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/pause:3.4.1
kubernetesui/dashboard:v2.1.0
k8s.gcr.io/coredns/coredns:v1.8.0
k8s.gcr.io/etcd:3.4.13-0
kubernetesui/metrics-scraper:v1.0.4
-- /stdout --
I0810 17:01:00.576517 29371 cache_images.go:74] Images are preloaded, skipping loading
I0810 17:01:00.576645 29371 ssh_runner.go:149] Run: docker info --format {{.CgroupDriver}}
I0810 17:01:00.682791 29371 cni.go:93] Creating CNI manager for "calico"
I0810 17:01:00.682813 29371 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0810 17:01:00.682825 29371 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.21.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:calico-20210810163155-11199 NodeName:calico-20210810163155-11199 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/
minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I0810 17:01:00.682923 29371 kubeadm.go:157] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "calico-20210810163155-11199"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.21.3
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0810 17:01:00.683015 29371 kubeadm.go:909] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.21.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=calico-20210810163155-11199 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.21.3 ClusterName:calico-20210810163155-11199 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:}
I0810 17:01:00.683087 29371 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.3
I0810 17:01:00.691601 29371 binaries.go:44] Found k8s binaries, skipping transfer
I0810 17:01:00.691665 29371 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0810 17:01:00.698932 29371 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (374 bytes)
I0810 17:01:00.711209 29371 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0810 17:01:00.723368 29371 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2070 bytes)
I0810 17:01:00.735812 29371 ssh_runner.go:149] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0810 17:01:00.739837 29371 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0810 17:01:00.749523 29371 certs.go:52] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199 for IP: 192.168.49.2
I0810 17:01:00.749615 29371 certs.go:179] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/ca.key
I0810 17:01:00.749653 29371 certs.go:179] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/proxy-client-ca.key
I0810 17:01:00.749707 29371 certs.go:294] generating minikube-user signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/client.key
I0810 17:01:00.749714 29371 crypto.go:69] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/client.crt with IP's: []
I0810 17:01:00.828718 29371 crypto.go:157] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/client.crt ...
I0810 17:01:00.828735 29371 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/client.crt: {Name:mk66ea1c48c639cfa8c11dcc006b924e48a5530e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0810 17:01:00.830200 29371 crypto.go:165] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/client.key ...
I0810 17:01:00.830218 29371 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/client.key: {Name:mkac4f43e582260c51ec63f6c3ab95d67b6d9d65 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0810 17:01:00.831275 29371 certs.go:294] generating minikube signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/apiserver.key.dd3b5fb2
I0810 17:01:00.831290 29371 crypto.go:69] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0810 17:01:00.981083 29371 crypto.go:157] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/apiserver.crt.dd3b5fb2 ...
I0810 17:01:00.981098 29371 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/apiserver.crt.dd3b5fb2: {Name:mkfe6dda9541bc0786bbfd2ee59143e8e458d462 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0810 17:01:00.981379 29371 crypto.go:165] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/apiserver.key.dd3b5fb2 ...
I0810 17:01:00.981387 29371 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/apiserver.key.dd3b5fb2: {Name:mk89d0e847fa8d00ff54226ddb4712cf57de1c90 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0810 17:01:00.982884 29371 certs.go:305] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/apiserver.crt.dd3b5fb2 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/apiserver.crt
I0810 17:01:00.983077 29371 certs.go:309] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/apiserver.key.dd3b5fb2 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/apiserver.key
I0810 17:01:00.983253 29371 certs.go:294] generating aggregator signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/proxy-client.key
I0810 17:01:00.983261 29371 crypto.go:69] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/proxy-client.crt with IP's: []
I0810 17:01:01.067312 29371 crypto.go:157] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/proxy-client.crt ...
I0810 17:01:01.067323 29371 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/proxy-client.crt: {Name:mk9f9d4d6a6f8f57b81ddf994380bbe9801fae49 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0810 17:01:01.068821 29371 crypto.go:165] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/proxy-client.key ...
I0810 17:01:01.068833 29371 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/proxy-client.key: {Name:mkfe69dcc6df17f7c702409456fd2b87c497e4a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0810 17:01:01.069849 29371 certs.go:373] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/11199.pem (1338 bytes)
W0810 17:01:01.069952 29371 certs.go:369] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/11199_empty.pem, impossibly tiny 0 bytes
I0810 17:01:01.069971 29371 certs.go:373] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca-key.pem (1679 bytes)
I0810 17:01:01.070025 29371 certs.go:373] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca.pem (1078 bytes)
I0810 17:01:01.070073 29371 certs.go:373] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/cert.pem (1123 bytes)
I0810 17:01:01.070123 29371 certs.go:373] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/key.pem (1675 bytes)
I0810 17:01:01.070269 29371 certs.go:373] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/files/etc/ssl/certs/111992.pem (1708 bytes)
I0810 17:01:01.071376 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0810 17:01:01.089637 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0810 17:01:01.106360 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0810 17:01:01.122794 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810163155-11199/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0810 17:01:01.139482 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0810 17:01:01.157280 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0810 17:01:01.173925 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0810 17:01:01.191066 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0810 17:01:01.226777 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/files/etc/ssl/certs/111992.pem --> /usr/share/ca-certificates/111992.pem (1708 bytes)
I0810 17:01:01.244207 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0810 17:01:01.261225 29371 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-10445-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/11199.pem --> /usr/share/ca-certificates/11199.pem (1338 bytes)
I0810 17:01:01.277922 29371 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0810 17:01:01.291689 29371 ssh_runner.go:149] Run: openssl version
I0810 17:01:01.300487 29371 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/111992.pem && ln -fs /usr/share/ca-certificates/111992.pem /etc/ssl/certs/111992.pem"
I0810 17:01:01.309547 29371 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/111992.pem
I0810 17:01:01.313678 29371 certs.go:416] hashing: -rw-r--r-- 1 root root 1708 Aug 10 22:34 /usr/share/ca-certificates/111992.pem
I0810 17:01:01.313725 29371 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/111992.pem
I0810 17:01:01.319058 29371 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/111992.pem /etc/ssl/certs/3ec20f2e.0"
I0810 17:01:01.326951 29371 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0810 17:01:01.334612 29371 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0810 17:01:01.339040 29371 certs.go:416] hashing: -rw-r--r-- 1 root root 1111 Aug 10 22:32 /usr/share/ca-certificates/minikubeCA.pem
I0810 17:01:01.339089 29371 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0810 17:01:01.344616 29371 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0810 17:01:01.352827 29371 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11199.pem && ln -fs /usr/share/ca-certificates/11199.pem /etc/ssl/certs/11199.pem"
I0810 17:01:01.360530 29371 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/11199.pem
I0810 17:01:01.364627 29371 certs.go:416] hashing: -rw-r--r-- 1 root root 1338 Aug 10 22:34 /usr/share/ca-certificates/11199.pem
I0810 17:01:01.364677 29371 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11199.pem
I0810 17:01:01.370202 29371 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11199.pem /etc/ssl/certs/51391683.0"
I0810 17:01:01.378091 29371 kubeadm.go:390] StartCluster: {Name:calico-20210810163155-11199 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:calico-20210810163155-11199 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] D
NSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
I0810 17:01:01.378202 29371 ssh_runner.go:149] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0810 17:01:01.413883 29371 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0810 17:01:01.421974 29371 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0810 17:01:01.430151 29371 kubeadm.go:220] ignoring SystemVerification for kubeadm because of docker driver
I0810 17:01:01.430220 29371 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0810 17:01:01.439437 29371 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0810 17:01:01.439461 29371 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0810 17:01:02.280585 29371 out.go:204] - Generating certificates and keys ...
I0810 17:01:05.707839 29371 out.go:204] - Booting up control plane ...
I0810 17:01:23.259126 29371 out.go:204] - Configuring RBAC rules ...
I0810 17:01:23.671403 29371 cni.go:93] Creating CNI manager for "calico"
I0810 17:01:23.698224 29371 out.go:177] * Configuring Calico (Container Networking Interface) ...
I0810 17:01:23.698291 29371 cni.go:187] applying CNI manifest using /var/lib/minikube/binaries/v1.21.3/kubectl ...
I0810 17:01:23.698302 29371 ssh_runner.go:316] scp memory --> /var/tmp/minikube/cni.yaml (22469 bytes)
I0810 17:01:23.720370 29371 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
W0810 17:01:24.076564 29371 out.go:242] ! initialization failed, will try again: apply cni: cni apply: cmd: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml output: -- stdout --
configmap/calico-config created
-- /stdout --
** stderr **
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
** /stderr **: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: Process exited with status 1
stdout:
configmap/calico-config created
stderr:
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
! initialization failed, will try again: apply cni: cni apply: cmd: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml output: -- stdout --
configmap/calico-config created
-- /stdout --
** stderr **
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
** /stderr **: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: Process exited with status 1
stdout:
configmap/calico-config created
stderr:
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
I0810 17:01:24.076596 29371 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0810 17:01:36.374271 29371 ssh_runner.go:189] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm reset --cri-socket /var/run/dockershim.sock --force": (12.297889625s)
I0810 17:01:36.374343 29371 ssh_runner.go:149] Run: sudo systemctl stop -f kubelet
I0810 17:01:36.384591 29371 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0810 17:01:36.420029 29371 kubeadm.go:220] ignoring SystemVerification for kubeadm because of docker driver
I0810 17:01:36.420104 29371 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0810 17:01:36.428170 29371 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0810 17:01:36.428190 29371 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0810 17:01:37.181433 29371 out.go:204] - Generating certificates and keys ...
I0810 17:01:37.951987 29371 out.go:204] - Booting up control plane ...
I0810 17:01:52.531678 29371 out.go:204] - Configuring RBAC rules ...
I0810 17:01:52.917862 29371 cni.go:93] Creating CNI manager for "calico"
I0810 17:01:52.945374 29371 out.go:177] * Configuring Calico (Container Networking Interface) ...
I0810 17:01:52.945433 29371 cni.go:187] applying CNI manifest using /var/lib/minikube/binaries/v1.21.3/kubectl ...
I0810 17:01:52.945442 29371 ssh_runner.go:316] scp memory --> /var/tmp/minikube/cni.yaml (22469 bytes)
I0810 17:01:52.960244 29371 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0810 17:01:53.153895 29371 kubeadm.go:392] StartCluster complete in 51.776769515s
I0810 17:01:53.155085 29371 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0810 17:01:53.192483 29371 logs.go:270] 1 containers: [1825fa89d4fe]
I0810 17:01:53.192589 29371 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0810 17:01:53.231278 29371 logs.go:270] 1 containers: [3d5b2bb44117]
I0810 17:01:53.231376 29371 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0810 17:01:53.291254 29371 logs.go:270] 0 containers: []
W0810 17:01:53.291269 29371 logs.go:272] No container was found matching "coredns"
I0810 17:01:53.291373 29371 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0810 17:01:53.336902 29371 logs.go:270] 1 containers: [e387934506c8]
I0810 17:01:53.337001 29371 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0810 17:01:53.418557 29371 logs.go:270] 0 containers: []
W0810 17:01:53.418574 29371 logs.go:272] No container was found matching "kube-proxy"
I0810 17:01:53.418662 29371 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0810 17:01:53.499812 29371 logs.go:270] 0 containers: []
W0810 17:01:53.499828 29371 logs.go:272] No container was found matching "kubernetes-dashboard"
I0810 17:01:53.499965 29371 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0810 17:01:53.544242 29371 logs.go:270] 0 containers: []
W0810 17:01:53.544263 29371 logs.go:272] No container was found matching "storage-provisioner"
I0810 17:01:53.544350 29371 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0810 17:01:53.602693 29371 logs.go:270] 1 containers: [bf547149604b]
I0810 17:01:53.602714 29371 logs.go:123] Gathering logs for etcd [3d5b2bb44117] ...
I0810 17:01:53.602721 29371 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 3d5b2bb44117"
I0810 17:01:53.646859 29371 logs.go:123] Gathering logs for dmesg ...
I0810 17:01:53.646874 29371 ssh_runner.go:149] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0810 17:01:53.668391 29371 logs.go:123] Gathering logs for describe nodes ...
I0810 17:01:53.668405 29371 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0810 17:01:53.763154 29371 logs.go:123] Gathering logs for kube-apiserver [1825fa89d4fe] ...
I0810 17:01:53.763171 29371 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 1825fa89d4fe"
I0810 17:01:53.813626 29371 logs.go:123] Gathering logs for kube-scheduler [e387934506c8] ...
I0810 17:01:53.813646 29371 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 e387934506c8"
I0810 17:01:53.856736 29371 logs.go:123] Gathering logs for kube-controller-manager [bf547149604b] ...
I0810 17:01:53.856751 29371 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 bf547149604b"
I0810 17:01:53.896080 29371 logs.go:123] Gathering logs for Docker ...
I0810 17:01:53.896095 29371 ssh_runner.go:149] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0810 17:01:53.911197 29371 logs.go:123] Gathering logs for container status ...
I0810 17:01:53.911216 29371 ssh_runner.go:149] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0810 17:01:53.943290 29371 logs.go:123] Gathering logs for kubelet ...
I0810 17:01:53.943304 29371 ssh_runner.go:149] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0810 17:01:54.000827 29371 out.go:371] Error starting cluster: apply cni: cni apply: cmd: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml output: -- stdout --
configmap/calico-config created
-- /stdout --
** stderr **
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
** /stderr **: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: Process exited with status 1
stdout:
configmap/calico-config created
stderr:
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
W0810 17:01:54.000845 29371 out.go:242] *
*
W0810 17:01:54.000926 29371 out.go:242] X Error starting cluster: apply cni: cni apply: cmd: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml output: -- stdout --
configmap/calico-config created
-- /stdout --
** stderr **
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
** /stderr **: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: Process exited with status 1
stdout:
configmap/calico-config created
stderr:
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
X Error starting cluster: apply cni: cni apply: cmd: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml output: -- stdout --
configmap/calico-config created
-- /stdout --
** stderr **
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
** /stderr **: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: Process exited with status 1
stdout:
configmap/calico-config created
stderr:
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
W0810 17:01:54.000934 29371 out.go:242] *
*
I0810 17:01:54.002150 29371 main.go:116] stdlog: detect_unix.go:31 open /proc/sys/kernel/osrelease: no such file or directory
** /stderr **
net_test.go:100: failed start: exit status 1
--- FAIL: TestNetworkPlugins/group/calico/Start (92.93s)