=== RUN TestNetworkPlugins/group/calico/Start
net_test.go:98: (dbg) Run: out/minikube-linux-amd64 start -p calico-20210810225249-345780 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=docker --container-runtime=crio
=== CONT TestNetworkPlugins/group/calico/Start
net_test.go:98: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p calico-20210810225249-345780 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=docker --container-runtime=crio: exit status 80 (1m1.356324491s)
-- stdout --
* [calico-20210810225249-345780] minikube v1.22.0 on Debian 9.13 (kvm/amd64)
- KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/kubeconfig
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube
- MINIKUBE_LOCATION=12230
* Using the docker driver based on user configuration
- More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities
* Starting control plane node calico-20210810225249-345780 in cluster calico-20210810225249-345780
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2048MB) ...
* Preparing Kubernetes v1.21.3 on CRI-O 1.20.3 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Configuring RBAC rules ...
* Configuring Calico (Container Networking Interface) ...
- Generating certificates and keys ...
- Booting up control plane ...
- Configuring RBAC rules ...
* Configuring Calico (Container Networking Interface) ...
-- /stdout --
** stderr **
I0810 23:29:57.656595 596855 out.go:298] Setting OutFile to fd 1 ...
I0810 23:29:57.656685 596855 out.go:345] TERM=,COLORTERM=, which probably does not support color
I0810 23:29:57.656690 596855 out.go:311] Setting ErrFile to fd 2...
I0810 23:29:57.656695 596855 out.go:345] TERM=,COLORTERM=, which probably does not support color
I0810 23:29:57.656832 596855 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/bin
I0810 23:29:57.657345 596855 out.go:305] Setting JSON to false
I0810 23:29:57.697490 596855 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-12","uptime":11559,"bootTime":1628626639,"procs":268,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}
I0810 23:29:57.697625 596855 start.go:121] virtualization: kvm guest
I0810 23:29:57.700831 596855 out.go:177] * [calico-20210810225249-345780] minikube v1.22.0 on Debian 9.13 (kvm/amd64)
I0810 23:29:57.701057 596855 notify.go:169] Checking for updates...
I0810 23:29:57.702628 596855 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/kubeconfig
I0810 23:29:57.704210 596855 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0810 23:29:57.705722 596855 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube
I0810 23:29:57.707196 596855 out.go:177] - MINIKUBE_LOCATION=12230
I0810 23:29:57.708272 596855 driver.go:335] Setting default libvirt URI to qemu:///system
I0810 23:29:57.767265 596855 docker.go:132] docker version: linux-19.03.15
I0810 23:29:57.767454 596855 cli_runner.go:115] Run: docker system info --format "{{json .}}"
I0810 23:29:57.863187 596855 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:5 ContainersRunning:5 ContainersPaused:0 ContainersStopped:0 Images:170 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:67 OomKillDisable:true NGoroutines:78 SystemTime:2021-08-10 23:29:57.815901854 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-12 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warni
ngs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
I0810 23:29:57.863302 596855 docker.go:244] overlay module found
I0810 23:29:57.865380 596855 out.go:177] * Using the docker driver based on user configuration
I0810 23:29:57.865412 596855 start.go:278] selected driver: docker
I0810 23:29:57.865421 596855 start.go:751] validating driver "docker" against <nil>
I0810 23:29:57.865446 596855 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}
W0810 23:29:57.865526 596855 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.
W0810 23:29:57.865549 596855 out.go:242] ! Your cgroup does not allow setting memory.
! Your cgroup does not allow setting memory.
I0810 23:29:57.867254 596855 out.go:177] - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities
I0810 23:29:57.868156 596855 cli_runner.go:115] Run: docker system info --format "{{json .}}"
I0810 23:29:57.960555 596855 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:5 ContainersRunning:5 ContainersPaused:0 ContainersStopped:0 Images:170 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:67 OomKillDisable:true NGoroutines:78 SystemTime:2021-08-10 23:29:57.9131105 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddres
s:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-12 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warning
s:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
I0810 23:29:57.960692 596855 start_flags.go:263] no existing cluster config was found, will generate one from the flags
I0810 23:29:57.960879 596855 start_flags.go:697] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0810 23:29:57.960911 596855 cni.go:93] Creating CNI manager for "calico"
I0810 23:29:57.960974 596855 start_flags.go:272] Found "Calico" CNI - setting NetworkPlugin=cni
I0810 23:29:57.960987 596855 start_flags.go:277] config:
{Name:calico-20210810225249-345780 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:calico-20210810225249-345780 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: Ne
tworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
I0810 23:29:57.963271 596855 out.go:177] * Starting control plane node calico-20210810225249-345780 in cluster calico-20210810225249-345780
I0810 23:29:57.963321 596855 cache.go:117] Beginning downloading kic base image for docker with crio
I0810 23:29:57.964891 596855 out.go:177] * Pulling base image ...
I0810 23:29:57.965056 596855 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime crio
I0810 23:29:57.965086 596855 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 in local docker daemon
I0810 23:29:57.965107 596855 preload.go:147] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-cri-o-overlay-amd64.tar.lz4
I0810 23:29:57.965127 596855 cache.go:56] Caching tarball of preloaded images
I0810 23:29:57.965310 596855 preload.go:173] Found /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0810 23:29:57.965323 596855 cache.go:59] Finished verifying existence of preloaded tar for v1.21.3 on crio
I0810 23:29:57.965492 596855 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/config.json ...
I0810 23:29:57.965516 596855 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/config.json: {Name:mk858d5ba3705d7a62a0577e223491be679fcdef Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0810 23:29:58.067343 596855 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 in local docker daemon, skipping pull
I0810 23:29:58.067377 596855 cache.go:139] gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 exists in daemon, skipping load
I0810 23:29:58.067395 596855 cache.go:205] Successfully downloaded all kic artifacts
I0810 23:29:58.067446 596855 start.go:313] acquiring machines lock for calico-20210810225249-345780: {Name:mkcde65f0e2c2f761190a193deafb25579c12528 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0810 23:29:58.067597 596855 start.go:317] acquired machines lock for "calico-20210810225249-345780" in 112.108µs
I0810 23:29:58.067628 596855 start.go:89] Provisioning new machine with config: &{Name:calico-20210810225249-345780 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:calico-20210810225249-345780 Namespace:default APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0} &{Name: IP: Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}
I0810 23:29:58.067721 596855 start.go:126] createHost starting for "" (driver="docker")
I0810 23:29:58.070330 596855 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...
I0810 23:29:58.070633 596855 start.go:160] libmachine.API.Create for "calico-20210810225249-345780" (driver="docker")
I0810 23:29:58.070682 596855 client.go:168] LocalClient.Create starting
I0810 23:29:58.070756 596855 main.go:130] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca.pem
I0810 23:29:58.070794 596855 main.go:130] libmachine: Decoding PEM data...
I0810 23:29:58.070825 596855 main.go:130] libmachine: Parsing certificate...
I0810 23:29:58.070981 596855 main.go:130] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/cert.pem
I0810 23:29:58.071008 596855 main.go:130] libmachine: Decoding PEM data...
I0810 23:29:58.071027 596855 main.go:130] libmachine: Parsing certificate...
I0810 23:29:58.071387 596855 cli_runner.go:115] Run: docker network inspect calico-20210810225249-345780 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0810 23:29:58.117042 596855 cli_runner.go:162] docker network inspect calico-20210810225249-345780 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0810 23:29:58.117176 596855 network_create.go:255] running [docker network inspect calico-20210810225249-345780] to gather additional debugging logs...
I0810 23:29:58.117205 596855 cli_runner.go:115] Run: docker network inspect calico-20210810225249-345780
W0810 23:29:58.168299 596855 cli_runner.go:162] docker network inspect calico-20210810225249-345780 returned with exit code 1
I0810 23:29:58.168337 596855 network_create.go:258] error running [docker network inspect calico-20210810225249-345780]: docker network inspect calico-20210810225249-345780: exit status 1
stdout:
[]
stderr:
Error: No such network: calico-20210810225249-345780
I0810 23:29:58.168503 596855 network_create.go:260] output of [docker network inspect calico-20210810225249-345780]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: calico-20210810225249-345780
** /stderr **
I0810 23:29:58.168598 596855 cli_runner.go:115] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0810 23:29:58.215270 596855 network.go:240] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName:br-b87adee7cb5e IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:3e:b3:e6:10}}
I0810 23:29:58.216170 596855 network.go:240] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName:br-08818fa49fb2 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:72:b1:84:3c}}
I0810 23:29:58.217289 596855 network.go:240] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName:br-bbd8860751ea IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:5b:21:24:9d}}
I0810 23:29:58.219258 596855 network.go:240] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName:br-aac5483000b1 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:07:0e:84:92}}
I0810 23:29:58.220389 596855 network.go:288] reserving subnet 192.168.85.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.85.0:0xc00068c030] misses:0}
I0810 23:29:58.220428 596855 network.go:235] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0810 23:29:58.220444 596855 network_create.go:106] attempt to create docker network calico-20210810225249-345780 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I0810 23:29:58.220497 596855 cli_runner.go:115] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true calico-20210810225249-345780
I0810 23:29:58.299329 596855 network_create.go:90] docker network calico-20210810225249-345780 192.168.85.0/24 created
I0810 23:29:58.299377 596855 kic.go:106] calculated static IP "192.168.85.2" for the "calico-20210810225249-345780" container
I0810 23:29:58.299440 596855 cli_runner.go:115] Run: docker ps -a --format {{.Names}}
I0810 23:29:58.345235 596855 cli_runner.go:115] Run: docker volume create calico-20210810225249-345780 --label name.minikube.sigs.k8s.io=calico-20210810225249-345780 --label created_by.minikube.sigs.k8s.io=true
I0810 23:29:58.389794 596855 oci.go:102] Successfully created a docker volume calico-20210810225249-345780
I0810 23:29:58.389919 596855 cli_runner.go:115] Run: docker run --rm --name calico-20210810225249-345780-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=calico-20210810225249-345780 --entrypoint /usr/bin/test -v calico-20210810225249-345780:/var gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -d /var/lib
I0810 23:29:59.215906 596855 oci.go:106] Successfully prepared a docker volume calico-20210810225249-345780
W0810 23:29:59.215977 596855 oci.go:135] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W0810 23:29:59.215985 596855 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.
I0810 23:29:59.216048 596855 cli_runner.go:115] Run: docker info --format "'{{json .SecurityOptions}}'"
I0810 23:29:59.216070 596855 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime crio
I0810 23:29:59.216115 596855 kic.go:179] Starting extracting preloaded images to volume ...
I0810 23:29:59.216220 596855 cli_runner.go:115] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v calico-20210810225249-345780:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -I lz4 -xf /preloaded.tar -C /extractDir
I0810 23:29:59.333925 596855 cli_runner.go:115] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname calico-20210810225249-345780 --name calico-20210810225249-345780 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=calico-20210810225249-345780 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=calico-20210810225249-345780 --network calico-20210810225249-345780 --ip 192.168.85.2 --volume calico-20210810225249-345780:/var --security-opt apparmor=unconfined --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79
I0810 23:29:59.883870 596855 cli_runner.go:115] Run: docker container inspect calico-20210810225249-345780 --format={{.State.Running}}
I0810 23:29:59.939110 596855 cli_runner.go:115] Run: docker container inspect calico-20210810225249-345780 --format={{.State.Status}}
I0810 23:29:59.995258 596855 cli_runner.go:115] Run: docker exec calico-20210810225249-345780 stat /var/lib/dpkg/alternatives/iptables
I0810 23:30:00.137836 596855 oci.go:278] the created container "calico-20210810225249-345780" has a running status.
I0810 23:30:00.137878 596855 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/calico-20210810225249-345780/id_rsa...
I0810 23:30:00.279271 596855 kic_runner.go:188] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/calico-20210810225249-345780/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0810 23:30:00.735454 596855 cli_runner.go:115] Run: docker container inspect calico-20210810225249-345780 --format={{.State.Status}}
I0810 23:30:00.787781 596855 kic_runner.go:94] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0810 23:30:00.787808 596855 kic_runner.go:115] Args: [docker exec --privileged calico-20210810225249-345780 chown docker:docker /home/docker/.ssh/authorized_keys]
I0810 23:30:03.393300 596855 cli_runner.go:168] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v calico-20210810225249-345780:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -I lz4 -xf /preloaded.tar -C /extractDir: (4.177025195s)
I0810 23:30:03.393338 596855 kic.go:188] duration metric: took 4.177220 seconds to extract preloaded images to volume
I0810 23:30:03.393426 596855 cli_runner.go:115] Run: docker container inspect calico-20210810225249-345780 --format={{.State.Status}}
I0810 23:30:03.438013 596855 machine.go:88] provisioning docker machine ...
I0810 23:30:03.438068 596855 ubuntu.go:169] provisioning hostname "calico-20210810225249-345780"
I0810 23:30:03.438144 596855 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810225249-345780
I0810 23:30:03.490646 596855 main.go:130] libmachine: Using SSH client type: native
I0810 23:30:03.490857 596855 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil> [] 0s} 127.0.0.1 33209 <nil> <nil>}
I0810 23:30:03.490879 596855 main.go:130] libmachine: About to run SSH command:
sudo hostname calico-20210810225249-345780 && echo "calico-20210810225249-345780" | sudo tee /etc/hostname
I0810 23:30:03.638884 596855 main.go:130] libmachine: SSH cmd err, output: <nil>: calico-20210810225249-345780
I0810 23:30:03.639010 596855 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810225249-345780
I0810 23:30:03.694789 596855 main.go:130] libmachine: Using SSH client type: native
I0810 23:30:03.694952 596855 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil> [] 0s} 127.0.0.1 33209 <nil> <nil>}
I0810 23:30:03.694974 596855 main.go:130] libmachine: About to run SSH command:
if ! grep -xq '.*\scalico-20210810225249-345780' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 calico-20210810225249-345780/g' /etc/hosts;
else
echo '127.0.1.1 calico-20210810225249-345780' | sudo tee -a /etc/hosts;
fi
fi
I0810 23:30:03.809285 596855 main.go:130] libmachine: SSH cmd err, output: <nil>:
I0810 23:30:03.809335 596855 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/key.pem ServerCertR
emotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube}
I0810 23:30:03.809369 596855 ubuntu.go:177] setting up certificates
I0810 23:30:03.809382 596855 provision.go:83] configureAuth start
I0810 23:30:03.809450 596855 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" calico-20210810225249-345780
I0810 23:30:03.856503 596855 provision.go:137] copyHostCerts
I0810 23:30:03.856585 596855 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/ca.pem, removing ...
I0810 23:30:03.856593 596855 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/ca.pem
I0810 23:30:03.856653 596855 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/ca.pem (1082 bytes)
I0810 23:30:03.856736 596855 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/cert.pem, removing ...
I0810 23:30:03.856747 596855 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/cert.pem
I0810 23:30:03.856767 596855 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/cert.pem (1123 bytes)
I0810 23:30:03.856811 596855 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/key.pem, removing ...
I0810 23:30:03.856818 596855 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/key.pem
I0810 23:30:03.856836 596855 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/key.pem (1679 bytes)
I0810 23:30:03.856899 596855 provision.go:111] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca-key.pem org=jenkins.calico-20210810225249-345780 san=[192.168.85.2 127.0.0.1 localhost 127.0.0.1 minikube calico-20210810225249-345780]
I0810 23:30:03.924665 596855 provision.go:171] copyRemoteCerts
I0810 23:30:03.924748 596855 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0810 23:30:03.924809 596855 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810225249-345780
I0810 23:30:03.979798 596855 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33209 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/calico-20210810225249-345780/id_rsa Username:docker}
I0810 23:30:04.065122 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0810 23:30:04.083367 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/server.pem --> /etc/docker/server.pem (1257 bytes)
I0810 23:30:04.104771 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0810 23:30:04.123881 596855 provision.go:86] duration metric: configureAuth took 314.480639ms
I0810 23:30:04.123922 596855 ubuntu.go:193] setting minikube options for container-runtime
I0810 23:30:04.124204 596855 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810225249-345780
I0810 23:30:04.171125 596855 main.go:130] libmachine: Using SSH client type: native
I0810 23:30:04.171355 596855 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil> [] 0s} 127.0.0.1 33209 <nil> <nil>}
I0810 23:30:04.171386 596855 main.go:130] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0810 23:30:04.527060 596855 main.go:130] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0810 23:30:04.527096 596855 machine.go:91] provisioned docker machine in 1.089049472s
I0810 23:30:04.527108 596855 client.go:171] LocalClient.Create took 6.456415897s
I0810 23:30:04.527128 596855 start.go:168] duration metric: libmachine.API.Create for "calico-20210810225249-345780" took 6.456493993s
I0810 23:30:04.527139 596855 start.go:267] post-start starting for "calico-20210810225249-345780" (driver="docker")
I0810 23:30:04.527145 596855 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0810 23:30:04.527203 596855 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0810 23:30:04.527246 596855 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810225249-345780
I0810 23:30:04.572220 596855 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33209 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/calico-20210810225249-345780/id_rsa Username:docker}
I0810 23:30:04.661093 596855 ssh_runner.go:149] Run: cat /etc/os-release
I0810 23:30:04.664245 596855 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0810 23:30:04.664279 596855 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0810 23:30:04.664291 596855 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0810 23:30:04.664299 596855 info.go:137] Remote host: Ubuntu 20.04.2 LTS
I0810 23:30:04.664319 596855 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/addons for local assets ...
I0810 23:30:04.664387 596855 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/files for local assets ...
I0810 23:30:04.664508 596855 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/files/etc/ssl/certs/3457802.pem -> 3457802.pem in /etc/ssl/certs
I0810 23:30:04.664684 596855 ssh_runner.go:149] Run: sudo mkdir -p /etc/ssl/certs
I0810 23:30:04.673134 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/files/etc/ssl/certs/3457802.pem --> /etc/ssl/certs/3457802.pem (1708 bytes)
I0810 23:30:04.691213 596855 start.go:270] post-start completed in 164.058404ms
I0810 23:30:04.691579 596855 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" calico-20210810225249-345780
I0810 23:30:04.735977 596855 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/config.json ...
I0810 23:30:04.736238 596855 ssh_runner.go:149] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0810 23:30:04.736289 596855 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810225249-345780
I0810 23:30:04.779140 596855 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33209 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/calico-20210810225249-345780/id_rsa Username:docker}
I0810 23:30:04.861852 596855 start.go:129] duration metric: createHost completed in 6.794113657s
I0810 23:30:04.861882 596855 start.go:80] releasing machines lock for "calico-20210810225249-345780", held for 6.794270944s
I0810 23:30:04.862010 596855 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" calico-20210810225249-345780
I0810 23:30:04.906251 596855 ssh_runner.go:149] Run: systemctl --version
I0810 23:30:04.906308 596855 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810225249-345780
I0810 23:30:04.906314 596855 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/
I0810 23:30:04.906400 596855 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-20210810225249-345780
I0810 23:30:04.953490 596855 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33209 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/calico-20210810225249-345780/id_rsa Username:docker}
I0810 23:30:04.957358 596855 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33209 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/machines/calico-20210810225249-345780/id_rsa Username:docker}
I0810 23:30:05.083937 596855 ssh_runner.go:149] Run: sudo systemctl stop -f containerd
I0810 23:30:05.104385 596855 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd
I0810 23:30:05.115207 596855 docker.go:153] disabling docker service ...
I0810 23:30:05.115277 596855 ssh_runner.go:149] Run: sudo systemctl stop -f docker.socket
I0810 23:30:05.129828 596855 ssh_runner.go:149] Run: sudo systemctl stop -f docker.service
I0810 23:30:05.139064 596855 ssh_runner.go:149] Run: sudo systemctl disable docker.socket
I0810 23:30:05.217071 596855 ssh_runner.go:149] Run: sudo systemctl mask docker.service
I0810 23:30:05.289898 596855 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service docker
I0810 23:30:05.299996 596855 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
image-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0810 23:30:05.313824 596855 ssh_runner.go:149] Run: /bin/bash -c "sudo sed -e 's|^pause_image = .*$|pause_image = "k8s.gcr.io/pause:3.4.1"|' -i /etc/crio/crio.conf"
I0810 23:30:05.322882 596855 ssh_runner.go:149] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0810 23:30:05.329825 596855 crio.go:128] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0810 23:30:05.329891 596855 ssh_runner.go:149] Run: sudo modprobe br_netfilter
I0810 23:30:05.337724 596855 ssh_runner.go:149] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0810 23:30:05.347756 596855 ssh_runner.go:149] Run: sudo systemctl daemon-reload
I0810 23:30:05.408485 596855 ssh_runner.go:149] Run: sudo systemctl start crio
I0810 23:30:05.418384 596855 start.go:392] Will wait 60s for socket path /var/run/crio/crio.sock
I0810 23:30:05.418447 596855 ssh_runner.go:149] Run: stat /var/run/crio/crio.sock
I0810 23:30:05.421666 596855 start.go:417] Will wait 60s for crictl version
I0810 23:30:05.421721 596855 ssh_runner.go:149] Run: sudo crictl version
I0810 23:30:05.450887 596855 start.go:426] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.20.3
RuntimeApiVersion: v1alpha1
I0810 23:30:05.450977 596855 ssh_runner.go:149] Run: crio --version
I0810 23:30:05.518111 596855 ssh_runner.go:149] Run: crio --version
I0810 23:30:05.599923 596855 out.go:177] * Preparing Kubernetes v1.21.3 on CRI-O 1.20.3 ...
I0810 23:30:05.600025 596855 cli_runner.go:115] Run: docker network inspect calico-20210810225249-345780 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0810 23:30:05.646735 596855 ssh_runner.go:149] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0810 23:30:05.650650 596855 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0810 23:30:05.661298 596855 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime crio
I0810 23:30:05.661383 596855 ssh_runner.go:149] Run: sudo crictl images --output json
I0810 23:30:05.709577 596855 crio.go:424] all images are preloaded for cri-o runtime.
I0810 23:30:05.709603 596855 crio.go:333] Images already preloaded, skipping extraction
I0810 23:30:05.709656 596855 ssh_runner.go:149] Run: sudo crictl images --output json
I0810 23:30:05.735045 596855 crio.go:424] all images are preloaded for cri-o runtime.
I0810 23:30:05.735076 596855 cache_images.go:74] Images are preloaded, skipping loading
I0810 23:30:05.735141 596855 ssh_runner.go:149] Run: crio config
I0810 23:30:05.809872 596855 cni.go:93] Creating CNI manager for "calico"
I0810 23:30:05.809901 596855 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0810 23:30:05.809914 596855 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.21.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:calico-20210810225249-345780 NodeName:calico-20210810225249-345780 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.85.2 CgroupDriver:systemd ClientCAFile:/var/lib/
minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I0810 23:30:05.810097 596855 kubeadm.go:157] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "calico-20210810225249-345780"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.21.3
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0810 23:30:05.810214 596855 kubeadm.go:909] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.21.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=/var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=calico-20210810225249-345780 --image-service-endpoint=/var/run/crio/crio.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.85.2 --runtime-request-timeout=15m
[Install]
config:
{KubernetesVersion:v1.21.3 ClusterName:calico-20210810225249-345780 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:}
I0810 23:30:05.810285 596855 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.3
I0810 23:30:05.818246 596855 binaries.go:44] Found k8s binaries, skipping transfer
I0810 23:30:05.818326 596855 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0810 23:30:05.825854 596855 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (559 bytes)
I0810 23:30:05.839641 596855 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0810 23:30:05.853667 596855 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2069 bytes)
I0810 23:30:05.868017 596855 ssh_runner.go:149] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0810 23:30:05.871502 596855 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0810 23:30:05.882324 596855 certs.go:52] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780 for IP: 192.168.85.2
I0810 23:30:05.882402 596855 certs.go:179] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/ca.key
I0810 23:30:05.882427 596855 certs.go:179] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/proxy-client-ca.key
I0810 23:30:05.882505 596855 certs.go:294] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/client.key
I0810 23:30:05.882525 596855 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/client.crt with IP's: []
I0810 23:30:06.265838 596855 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/client.crt ...
I0810 23:30:06.265875 596855 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/client.crt: {Name:mk9438fa46a82a8cf5e48e6fc7c1320684012ffe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0810 23:30:06.266104 596855 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/client.key ...
I0810 23:30:06.266124 596855 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/client.key: {Name:mk41cac02dc15ac9cf77db29f54e363eb31b649a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0810 23:30:06.266240 596855 certs.go:294] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/apiserver.key.43b9df8c
I0810 23:30:06.266258 596855 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/apiserver.crt.43b9df8c with IP's: [192.168.85.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0810 23:30:06.479935 596855 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/apiserver.crt.43b9df8c ...
I0810 23:30:06.479977 596855 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/apiserver.crt.43b9df8c: {Name:mk113918ec6a830ad61dfe136b616ae2cdaf4257 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0810 23:30:06.480183 596855 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/apiserver.key.43b9df8c ...
I0810 23:30:06.480198 596855 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/apiserver.key.43b9df8c: {Name:mk0e6d6b2e20394c18ee39100f2ab89ffa08ec90 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0810 23:30:06.480275 596855 certs.go:305] copying /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/apiserver.crt.43b9df8c -> /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/apiserver.crt
I0810 23:30:06.480382 596855 certs.go:309] copying /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/apiserver.key.43b9df8c -> /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/apiserver.key
I0810 23:30:06.480437 596855 certs.go:294] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/proxy-client.key
I0810 23:30:06.480446 596855 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/proxy-client.crt with IP's: []
I0810 23:30:06.614004 596855 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/proxy-client.crt ...
I0810 23:30:06.614038 596855 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/proxy-client.crt: {Name:mkaf2eb8a2855d6d4fad3e609e0c9ebe2015c395 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0810 23:30:06.614238 596855 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/proxy-client.key ...
I0810 23:30:06.614252 596855 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/proxy-client.key: {Name:mk6bc6dbe2bf66652fc34185c597edaa08cfd394 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0810 23:30:06.614423 596855 certs.go:373] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/345780.pem (1338 bytes)
W0810 23:30:06.614464 596855 certs.go:369] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/345780_empty.pem, impossibly tiny 0 bytes
I0810 23:30:06.614476 596855 certs.go:373] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca-key.pem (1675 bytes)
I0810 23:30:06.614501 596855 certs.go:373] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/ca.pem (1082 bytes)
I0810 23:30:06.614526 596855 certs.go:373] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/cert.pem (1123 bytes)
I0810 23:30:06.614549 596855 certs.go:373] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/key.pem (1679 bytes)
I0810 23:30:06.614591 596855 certs.go:373] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/files/etc/ssl/certs/3457802.pem (1708 bytes)
I0810 23:30:06.615598 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0810 23:30:06.659348 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0810 23:30:06.678711 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0810 23:30:06.697169 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/profiles/calico-20210810225249-345780/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0810 23:30:06.715112 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0810 23:30:06.733245 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0810 23:30:06.751467 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0810 23:30:06.770364 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0810 23:30:06.789008 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0810 23:30:06.807261 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/certs/345780.pem --> /usr/share/ca-certificates/345780.pem (1338 bytes)
I0810 23:30:06.824807 596855 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/files/etc/ssl/certs/3457802.pem --> /usr/share/ca-certificates/3457802.pem (1708 bytes)
I0810 23:30:06.842544 596855 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0810 23:30:06.855008 596855 ssh_runner.go:149] Run: openssl version
I0810 23:30:06.859975 596855 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0810 23:30:06.868795 596855 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0810 23:30:06.872115 596855 certs.go:416] hashing: -rw-r--r-- 1 root root 1111 Aug 10 22:20 /usr/share/ca-certificates/minikubeCA.pem
I0810 23:30:06.872179 596855 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0810 23:30:06.877127 596855 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0810 23:30:06.884814 596855 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/345780.pem && ln -fs /usr/share/ca-certificates/345780.pem /etc/ssl/certs/345780.pem"
I0810 23:30:06.892264 596855 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/345780.pem
I0810 23:30:06.895291 596855 certs.go:416] hashing: -rw-r--r-- 1 root root 1338 Aug 10 22:29 /usr/share/ca-certificates/345780.pem
I0810 23:30:06.895340 596855 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/345780.pem
I0810 23:30:06.900086 596855 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/345780.pem /etc/ssl/certs/51391683.0"
I0810 23:30:06.907075 596855 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3457802.pem && ln -fs /usr/share/ca-certificates/3457802.pem /etc/ssl/certs/3457802.pem"
I0810 23:30:06.914085 596855 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/3457802.pem
I0810 23:30:06.917007 596855 certs.go:416] hashing: -rw-r--r-- 1 root root 1708 Aug 10 22:29 /usr/share/ca-certificates/3457802.pem
I0810 23:30:06.917056 596855 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3457802.pem
I0810 23:30:06.921702 596855 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3457802.pem /etc/ssl/certs/3ec20f2e.0"
I0810 23:30:06.928556 596855 kubeadm.go:390] StartCluster: {Name:calico-20210810225249-345780 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:calico-20210810225249-345780 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]
DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
I0810 23:30:06.928648 596855 cri.go:41] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0810 23:30:06.928698 596855 ssh_runner.go:149] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0810 23:30:06.953892 596855 cri.go:76] found id: ""
I0810 23:30:06.953985 596855 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0810 23:30:06.962044 596855 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0810 23:30:06.969403 596855 kubeadm.go:220] ignoring SystemVerification for kubeadm because of docker driver
I0810 23:30:06.969463 596855 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0810 23:30:06.976282 596855 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0810 23:30:06.976334 596855 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0810 23:30:07.288341 596855 out.go:204] - Generating certificates and keys ...
I0810 23:30:09.697286 596855 out.go:204] - Booting up control plane ...
I0810 23:30:24.255235 596855 out.go:204] - Configuring RBAC rules ...
I0810 23:30:24.670241 596855 cni.go:93] Creating CNI manager for "calico"
I0810 23:30:24.672239 596855 out.go:177] * Configuring Calico (Container Networking Interface) ...
I0810 23:30:24.672345 596855 cni.go:187] applying CNI manifest using /var/lib/minikube/binaries/v1.21.3/kubectl ...
I0810 23:30:24.672360 596855 ssh_runner.go:316] scp memory --> /var/tmp/minikube/cni.yaml (22469 bytes)
I0810 23:30:24.687730 596855 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
W0810 23:30:25.066754 596855 out.go:242] ! initialization failed, will try again: apply cni: cni apply: cmd: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml output: -- stdout --
configmap/calico-config created
-- /stdout --
** stderr **
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
** /stderr **: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: Process exited with status 1
stdout:
configmap/calico-config created
stderr:
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
! initialization failed, will try again: apply cni: cni apply: cmd: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml output: -- stdout --
configmap/calico-config created
-- /stdout --
** stderr **
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
** /stderr **: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: Process exited with status 1
stdout:
configmap/calico-config created
stderr:
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
I0810 23:30:25.066799 596855 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0810 23:30:42.752117 596855 ssh_runner.go:189] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (17.685292178s)
I0810 23:30:42.752196 596855 ssh_runner.go:149] Run: sudo systemctl stop -f kubelet
I0810 23:30:42.764023 596855 cri.go:41] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0810 23:30:42.764097 596855 ssh_runner.go:149] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0810 23:30:42.789858 596855 cri.go:76] found id: ""
I0810 23:30:42.789922 596855 kubeadm.go:220] ignoring SystemVerification for kubeadm because of docker driver
I0810 23:30:42.789962 596855 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0810 23:30:42.798591 596855 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0810 23:30:42.798636 596855 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0810 23:30:43.130536 596855 out.go:204] - Generating certificates and keys ...
I0810 23:30:43.940112 596855 out.go:204] - Booting up control plane ...
I0810 23:30:57.488213 596855 out.go:204] - Configuring RBAC rules ...
I0810 23:30:57.905631 596855 cni.go:93] Creating CNI manager for "calico"
I0810 23:30:57.908003 596855 out.go:177] * Configuring Calico (Container Networking Interface) ...
I0810 23:30:57.908111 596855 cni.go:187] applying CNI manifest using /var/lib/minikube/binaries/v1.21.3/kubectl ...
I0810 23:30:57.908126 596855 ssh_runner.go:316] scp memory --> /var/tmp/minikube/cni.yaml (22469 bytes)
I0810 23:30:57.922839 596855 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0810 23:30:58.264588 596855 kubeadm.go:392] StartCluster complete in 51.336035227s
I0810 23:30:58.264649 596855 cri.go:41] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0810 23:30:58.264716 596855 ssh_runner.go:149] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0810 23:30:58.295733 596855 cri.go:76] found id: "8871b3c9a964ebe81c01d29939002aab5a800a1e1cec631b3b8c37db53dea50a"
I0810 23:30:58.295764 596855 cri.go:76] found id: ""
I0810 23:30:58.295774 596855 logs.go:270] 1 containers: [8871b3c9a964ebe81c01d29939002aab5a800a1e1cec631b3b8c37db53dea50a]
I0810 23:30:58.295829 596855 ssh_runner.go:149] Run: which crictl
I0810 23:30:58.299523 596855 cri.go:41] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0810 23:30:58.299596 596855 ssh_runner.go:149] Run: sudo crictl ps -a --quiet --name=etcd
I0810 23:30:58.322417 596855 cri.go:76] found id: "e64fca1fa304dd992855b69fa2e6673e079ef55cbc3746d38d7b0dde5a9452c3"
I0810 23:30:58.322442 596855 cri.go:76] found id: ""
I0810 23:30:58.322450 596855 logs.go:270] 1 containers: [e64fca1fa304dd992855b69fa2e6673e079ef55cbc3746d38d7b0dde5a9452c3]
I0810 23:30:58.322496 596855 ssh_runner.go:149] Run: which crictl
I0810 23:30:58.325477 596855 cri.go:41] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0810 23:30:58.325529 596855 ssh_runner.go:149] Run: sudo crictl ps -a --quiet --name=coredns
I0810 23:30:58.348151 596855 cri.go:76] found id: ""
I0810 23:30:58.348179 596855 logs.go:270] 0 containers: []
W0810 23:30:58.348188 596855 logs.go:272] No container was found matching "coredns"
I0810 23:30:58.348196 596855 cri.go:41] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0810 23:30:58.348254 596855 ssh_runner.go:149] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0810 23:30:58.372243 596855 cri.go:76] found id: "5aa5fc99bcf864b748e616822ddac1050c9bcbeb099c43c1591ef7390d4d99e5"
I0810 23:30:58.372276 596855 cri.go:76] found id: ""
I0810 23:30:58.372285 596855 logs.go:270] 1 containers: [5aa5fc99bcf864b748e616822ddac1050c9bcbeb099c43c1591ef7390d4d99e5]
I0810 23:30:58.372352 596855 ssh_runner.go:149] Run: which crictl
I0810 23:30:58.375567 596855 cri.go:41] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0810 23:30:58.375631 596855 ssh_runner.go:149] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0810 23:30:58.401064 596855 cri.go:76] found id: ""
I0810 23:30:58.401090 596855 logs.go:270] 0 containers: []
W0810 23:30:58.401097 596855 logs.go:272] No container was found matching "kube-proxy"
I0810 23:30:58.401104 596855 cri.go:41] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0810 23:30:58.401166 596855 ssh_runner.go:149] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0810 23:30:58.429504 596855 cri.go:76] found id: ""
I0810 23:30:58.429534 596855 logs.go:270] 0 containers: []
W0810 23:30:58.429544 596855 logs.go:272] No container was found matching "kubernetes-dashboard"
I0810 23:30:58.429552 596855 cri.go:41] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0810 23:30:58.429615 596855 ssh_runner.go:149] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0810 23:30:58.460225 596855 cri.go:76] found id: ""
I0810 23:30:58.460255 596855 logs.go:270] 0 containers: []
W0810 23:30:58.460266 596855 logs.go:272] No container was found matching "storage-provisioner"
I0810 23:30:58.460275 596855 cri.go:41] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0810 23:30:58.460350 596855 ssh_runner.go:149] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0810 23:30:58.494491 596855 cri.go:76] found id: "9902515e13673f7e9b910fd884319f20876c90b96c1b137e6023f1c8f8e8bfc4"
I0810 23:30:58.494518 596855 cri.go:76] found id: ""
I0810 23:30:58.494527 596855 logs.go:270] 1 containers: [9902515e13673f7e9b910fd884319f20876c90b96c1b137e6023f1c8f8e8bfc4]
I0810 23:30:58.494594 596855 ssh_runner.go:149] Run: which crictl
I0810 23:30:58.497989 596855 logs.go:123] Gathering logs for describe nodes ...
I0810 23:30:58.498022 596855 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0810 23:30:58.597502 596855 logs.go:123] Gathering logs for kube-scheduler [5aa5fc99bcf864b748e616822ddac1050c9bcbeb099c43c1591ef7390d4d99e5] ...
I0810 23:30:58.597545 596855 ssh_runner.go:149] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5aa5fc99bcf864b748e616822ddac1050c9bcbeb099c43c1591ef7390d4d99e5"
I0810 23:30:58.630326 596855 logs.go:123] Gathering logs for etcd [e64fca1fa304dd992855b69fa2e6673e079ef55cbc3746d38d7b0dde5a9452c3] ...
I0810 23:30:58.630391 596855 ssh_runner.go:149] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e64fca1fa304dd992855b69fa2e6673e079ef55cbc3746d38d7b0dde5a9452c3"
I0810 23:30:58.663756 596855 logs.go:123] Gathering logs for kube-controller-manager [9902515e13673f7e9b910fd884319f20876c90b96c1b137e6023f1c8f8e8bfc4] ...
I0810 23:30:58.663795 596855 ssh_runner.go:149] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9902515e13673f7e9b910fd884319f20876c90b96c1b137e6023f1c8f8e8bfc4"
I0810 23:30:58.703580 596855 logs.go:123] Gathering logs for CRI-O ...
I0810 23:30:58.703617 596855 ssh_runner.go:149] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0810 23:30:58.747884 596855 logs.go:123] Gathering logs for container status ...
I0810 23:30:58.747927 596855 ssh_runner.go:149] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0810 23:30:58.779148 596855 logs.go:123] Gathering logs for kubelet ...
I0810 23:30:58.779189 596855 ssh_runner.go:149] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0810 23:30:58.858791 596855 logs.go:123] Gathering logs for dmesg ...
I0810 23:30:58.858837 596855 ssh_runner.go:149] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0810 23:30:58.887208 596855 logs.go:123] Gathering logs for kube-apiserver [8871b3c9a964ebe81c01d29939002aab5a800a1e1cec631b3b8c37db53dea50a] ...
I0810 23:30:58.887259 596855 ssh_runner.go:149] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8871b3c9a964ebe81c01d29939002aab5a800a1e1cec631b3b8c37db53dea50a"
W0810 23:30:58.949691 596855 out.go:371] Error starting cluster: apply cni: cni apply: cmd: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml output: -- stdout --
configmap/calico-config created
-- /stdout --
** stderr **
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
** /stderr **: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: Process exited with status 1
stdout:
configmap/calico-config created
stderr:
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
W0810 23:30:58.949739 596855 out.go:242] *
*
W0810 23:30:58.949938 596855 out.go:242] X Error starting cluster: apply cni: cni apply: cmd: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml output: -- stdout --
configmap/calico-config created
-- /stdout --
** stderr **
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
** /stderr **: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: Process exited with status 1
stdout:
configmap/calico-config created
stderr:
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
X Error starting cluster: apply cni: cni apply: cmd: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml output: -- stdout --
configmap/calico-config created
-- /stdout --
** stderr **
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
** /stderr **: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: Process exited with status 1
stdout:
configmap/calico-config created
stderr:
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
W0810 23:30:58.949959 596855 out.go:242] *
*
[warning]: invalid value provided to Color, using default
[warning]: invalid value provided to Color, using default
[warning]: invalid value provided to Color, using default
[warning]: invalid value provided to Color, using default
[warning]: invalid value provided to Color, using default
[warning]: invalid value provided to Color, using default
[warning]: invalid value provided to Color, using default
[warning]: invalid value provided to Color, using default
W0810 23:30:58.952064 596855 out.go:242] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please attach the following file to the GitHub issue: │
│ * - /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/logs/lastStart.txt │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please attach the following file to the GitHub issue: │
│ * - /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/logs/lastStart.txt │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I0810 23:30:58.954315 596855 out.go:177]
W0810 23:30:58.954431 596855 out.go:242] X Exiting due to GUEST_START: apply cni: cni apply: cmd: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml output: -- stdout --
configmap/calico-config created
-- /stdout --
** stderr **
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
** /stderr **: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: Process exited with status 1
stdout:
configmap/calico-config created
stderr:
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
X Exiting due to GUEST_START: apply cni: cni apply: cmd: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml output: -- stdout --
configmap/calico-config created
-- /stdout --
** stderr **
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
** /stderr **: sudo /var/lib/minikube/binaries/v1.21.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: Process exited with status 1
stdout:
configmap/calico-config created
stderr:
error: error validating "/var/tmp/minikube/cni.yaml": error validating data: [ValidationError(CustomResourceDefinition.spec): unknown field "version" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec, ValidationError(CustomResourceDefinition.spec): missing required field "versions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1.CustomResourceDefinitionSpec]; if you choose to ignore these errors, turn validation off with --validate=false
W0810 23:30:58.954447 596855 out.go:242] *
*
[warning]: invalid value provided to Color, using default
[warning]: invalid value provided to Color, using default
[warning]: invalid value provided to Color, using default
[warning]: invalid value provided to Color, using default
[warning]: invalid value provided to Color, using default
[warning]: invalid value provided to Color, using default
[warning]: invalid value provided to Color, using default
[warning]: invalid value provided to Color, using default
W0810 23:30:58.956199 596855 out.go:242] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please attach the following file to the GitHub issue: │
│ * - /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/logs/lastStart.txt │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please attach the following file to the GitHub issue: │
│ * - /home/jenkins/minikube-integration/linux-amd64-docker-crio-12230-342823-4e32f41c836e9c021a12ab8ec720ab6aea4bc3f0/.minikube/logs/lastStart.txt │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I0810 23:30:58.957657 596855 out.go:177]
** /stderr **
net_test.go:100: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/calico/Start (61.38s)