=== RUN TestNetworkPlugins/group/custom-weave/Start
net_test.go:99: (dbg) Run: out/minikube-darwin-amd64 start -p custom-weave-20220329110226-2053 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=testdata/weavenet.yaml --driver=docker
E0329 11:25:46.487157 2053 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/addons-20220329101201-2053/client.crt: no such file or directory
E0329 11:25:57.292234 2053 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/skaffold-20220329105920-2053/client.crt: no such file or directory
=== CONT TestNetworkPlugins/group/custom-weave/Start
net_test.go:99: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p custom-weave-20220329110226-2053 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=testdata/weavenet.yaml --driver=docker : exit status 105 (9m10.297180127s)
-- stdout --
* [custom-weave-20220329110226-2053] minikube v1.25.2 on Darwin 11.2.3
- MINIKUBE_LOCATION=13730
- KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube
* Using the docker driver based on user configuration
* Starting control plane node custom-weave-20220329110226-2053 in cluster custom-weave-20220329110226-2053
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2048MB) ...
* Preparing Kubernetes v1.23.5 on Docker 20.10.13 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Configuring RBAC rules ...
* Configuring testdata/weavenet.yaml (Container Networking Interface) ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Enabled addons: storage-provisioner, default-storageclass
-- /stdout --
** stderr **
I0329 11:25:40.446131 20307 out.go:297] Setting OutFile to fd 1 ...
I0329 11:25:40.446291 20307 out.go:344] TERM=,COLORTERM=, which probably does not support color
I0329 11:25:40.446296 20307 out.go:310] Setting ErrFile to fd 2...
I0329 11:25:40.446300 20307 out.go:344] TERM=,COLORTERM=, which probably does not support color
I0329 11:25:40.446380 20307 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/bin
I0329 11:25:40.446728 20307 out.go:304] Setting JSON to false
I0329 11:25:40.462944 20307 start.go:114] hostinfo: {"hostname":"37310.local","uptime":5115,"bootTime":1648573225,"procs":322,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}
W0329 11:25:40.463036 20307 start.go:122] gopshost.Virtualization returned error: not implemented yet
I0329 11:25:40.509936 20307 out.go:176] * [custom-weave-20220329110226-2053] minikube v1.25.2 on Darwin 11.2.3
I0329 11:25:40.510058 20307 notify.go:193] Checking for updates...
I0329 11:25:40.535787 20307 out.go:176] - MINIKUBE_LOCATION=13730
I0329 11:25:40.561921 20307 out.go:176] - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/kubeconfig
I0329 11:25:40.587922 20307 out.go:176] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0329 11:25:40.613740 20307 out.go:176] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0329 11:25:40.639905 20307 out.go:176] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube
I0329 11:25:40.640299 20307 config.go:176] Loaded profile config "cilium-20220329110226-2053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.5
I0329 11:25:40.640359 20307 driver.go:346] Setting default libvirt URI to qemu:///system
I0329 11:25:40.743519 20307 docker.go:137] docker version: linux-20.10.6
I0329 11:25:40.743693 20307 cli_runner.go:133] Run: docker system info --format "{{json .}}"
I0329 11:25:40.941589 20307 info.go:263] docker info: {ID:4GJZ:5WQJ:PTOH:OBGV:UGLB:2QMR:SRUC:WPW4:I7LT:V2VN:S3VH:GWN3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:9 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:51 SystemTime:2022-03-29 18:25:40.881068102 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerA
ddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=secc
omp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}
I0329 11:25:40.969491 20307 out.go:176] * Using the docker driver based on user configuration
I0329 11:25:40.969509 20307 start.go:283] selected driver: docker
I0329 11:25:40.969513 20307 start.go:800] validating driver "docker" against <nil>
I0329 11:25:40.969529 20307 start.go:811] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0329 11:25:40.971792 20307 cli_runner.go:133] Run: docker system info --format "{{json .}}"
I0329 11:25:41.164261 20307 info.go:263] docker info: {ID:4GJZ:5WQJ:PTOH:OBGV:UGLB:2QMR:SRUC:WPW4:I7LT:V2VN:S3VH:GWN3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:9 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:51 SystemTime:2022-03-29 18:25:41.106217386 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerA
ddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=secc
omp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}
I0329 11:25:41.164408 20307 start_flags.go:292] no existing cluster config was found, will generate one from the flags
I0329 11:25:41.164563 20307 start_flags.go:837] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0329 11:25:41.164579 20307 cni.go:93] Creating CNI manager for "testdata/weavenet.yaml"
I0329 11:25:41.164603 20307 start_flags.go:301] Found "testdata/weavenet.yaml" CNI - setting NetworkPlugin=cni
I0329 11:25:41.164611 20307 start_flags.go:306] config:
{Name:custom-weave-20220329110226-2053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.5 ClusterName:custom-weave-20220329110226-2053 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con
tainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/weavenet.yaml NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}
I0329 11:25:41.190304 20307 out.go:176] * Starting control plane node custom-weave-20220329110226-2053 in cluster custom-weave-20220329110226-2053
I0329 11:25:41.190342 20307 cache.go:120] Beginning downloading kic base image for docker with docker
I0329 11:25:41.237087 20307 out.go:176] * Pulling base image ...
I0329 11:25:41.237229 20307 preload.go:132] Checking if preload exists for k8s version v1.23.5 and runtime docker
I0329 11:25:41.237289 20307 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 in local docker daemon
I0329 11:25:41.237304 20307 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v17-v1.23.5-docker-overlay2-amd64.tar.lz4
I0329 11:25:41.237356 20307 cache.go:57] Caching tarball of preloaded images
I0329 11:25:41.237526 20307 preload.go:174] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v17-v1.23.5-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0329 11:25:41.237542 20307 cache.go:60] Finished verifying existence of preloaded tar for v1.23.5 on docker
I0329 11:25:41.238325 20307 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/config.json ...
I0329 11:25:41.238430 20307 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/config.json: {Name:mk26bff9e02125897b05811db0a5e2955b97f856 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 11:25:41.366384 20307 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 in local docker daemon, skipping pull
I0329 11:25:41.366404 20307 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 exists in daemon, skipping load
I0329 11:25:41.366416 20307 cache.go:208] Successfully downloaded all kic artifacts
I0329 11:25:41.366465 20307 start.go:348] acquiring machines lock for custom-weave-20220329110226-2053: {Name:mk3f30a53648490283a3451dec176ddc52ee260d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0329 11:25:41.366605 20307 start.go:352] acquired machines lock for "custom-weave-20220329110226-2053" in 128.042µs
I0329 11:25:41.366657 20307 start.go:90] Provisioning new machine with config: &{Name:custom-weave-20220329110226-2053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.5 ClusterName:custom-weave-20220329110226-2053 Namespace:default APIS
erverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/weavenet.yaml NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.23.5 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOp
timizations:false DisableMetrics:false} &{Name: IP: Port:8443 KubernetesVersion:v1.23.5 ContainerRuntime:docker ControlPlane:true Worker:true}
I0329 11:25:41.366759 20307 start.go:127] createHost starting for "" (driver="docker")
I0329 11:25:41.413866 20307 out.go:203] * Creating docker container (CPUs=2, Memory=2048MB) ...
I0329 11:25:41.414073 20307 start.go:161] libmachine.API.Create for "custom-weave-20220329110226-2053" (driver="docker")
I0329 11:25:41.414105 20307 client.go:168] LocalClient.Create starting
I0329 11:25:41.414225 20307 main.go:130] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/ca.pem
I0329 11:25:41.414273 20307 main.go:130] libmachine: Decoding PEM data...
I0329 11:25:41.414289 20307 main.go:130] libmachine: Parsing certificate...
I0329 11:25:41.414343 20307 main.go:130] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/cert.pem
I0329 11:25:41.414375 20307 main.go:130] libmachine: Decoding PEM data...
I0329 11:25:41.414386 20307 main.go:130] libmachine: Parsing certificate...
I0329 11:25:41.414848 20307 cli_runner.go:133] Run: docker network inspect custom-weave-20220329110226-2053 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0329 11:25:41.536410 20307 cli_runner.go:180] docker network inspect custom-weave-20220329110226-2053 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0329 11:25:41.536520 20307 network_create.go:262] running [docker network inspect custom-weave-20220329110226-2053] to gather additional debugging logs...
I0329 11:25:41.536546 20307 cli_runner.go:133] Run: docker network inspect custom-weave-20220329110226-2053
W0329 11:25:41.665123 20307 cli_runner.go:180] docker network inspect custom-weave-20220329110226-2053 returned with exit code 1
I0329 11:25:41.665147 20307 network_create.go:265] error running [docker network inspect custom-weave-20220329110226-2053]: docker network inspect custom-weave-20220329110226-2053: exit status 1
stdout:
[]
stderr:
Error: No such network: custom-weave-20220329110226-2053
I0329 11:25:41.665164 20307 network_create.go:267] output of [docker network inspect custom-weave-20220329110226-2053]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: custom-weave-20220329110226-2053
** /stderr **
I0329 11:25:41.665260 20307 cli_runner.go:133] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0329 11:25:41.789721 20307 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc0005e6b40] misses:0}
I0329 11:25:41.789762 20307 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0329 11:25:41.789781 20307 network_create.go:114] attempt to create docker network custom-weave-20220329110226-2053 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0329 11:25:41.789866 20307 cli_runner.go:133] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true custom-weave-20220329110226-2053
I0329 11:25:44.609773 20307 cli_runner.go:186] Completed: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true custom-weave-20220329110226-2053: (2.819862746s)
I0329 11:25:44.609795 20307 network_create.go:98] docker network custom-weave-20220329110226-2053 192.168.49.0/24 created
I0329 11:25:44.609817 20307 kic.go:106] calculated static IP "192.168.49.2" for the "custom-weave-20220329110226-2053" container
I0329 11:25:44.609932 20307 cli_runner.go:133] Run: docker ps -a --format {{.Names}}
I0329 11:25:44.731385 20307 cli_runner.go:133] Run: docker volume create custom-weave-20220329110226-2053 --label name.minikube.sigs.k8s.io=custom-weave-20220329110226-2053 --label created_by.minikube.sigs.k8s.io=true
I0329 11:25:44.849805 20307 oci.go:102] Successfully created a docker volume custom-weave-20220329110226-2053
I0329 11:25:44.849922 20307 cli_runner.go:133] Run: docker run --rm --name custom-weave-20220329110226-2053-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=custom-weave-20220329110226-2053 --entrypoint /usr/bin/test -v custom-weave-20220329110226-2053:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -d /var/lib
I0329 11:25:45.358870 20307 oci.go:106] Successfully prepared a docker volume custom-weave-20220329110226-2053
I0329 11:25:45.358912 20307 preload.go:132] Checking if preload exists for k8s version v1.23.5 and runtime docker
I0329 11:25:45.358926 20307 kic.go:179] Starting extracting preloaded images to volume ...
I0329 11:25:45.359042 20307 cli_runner.go:133] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v17-v1.23.5-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v custom-weave-20220329110226-2053:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -I lz4 -xf /preloaded.tar -C /extractDir
I0329 11:25:51.202492 20307 cli_runner.go:186] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v17-v1.23.5-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v custom-weave-20220329110226-2053:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -I lz4 -xf /preloaded.tar -C /extractDir: (5.843378296s)
I0329 11:25:51.202514 20307 kic.go:188] duration metric: took 5.843596 seconds to extract preloaded images to volume
I0329 11:25:51.202640 20307 cli_runner.go:133] Run: docker info --format "'{{json .SecurityOptions}}'"
I0329 11:25:51.393532 20307 cli_runner.go:133] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname custom-weave-20220329110226-2053 --name custom-weave-20220329110226-2053 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=custom-weave-20220329110226-2053 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=custom-weave-20220329110226-2053 --network custom-weave-20220329110226-2053 --ip 192.168.49.2 --volume custom-weave-20220329110226-2053:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5
I0329 11:25:54.010719 20307 cli_runner.go:186] Completed: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname custom-weave-20220329110226-2053 --name custom-weave-20220329110226-2053 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=custom-weave-20220329110226-2053 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=custom-weave-20220329110226-2053 --network custom-weave-20220329110226-2053 --ip 192.168.49.2 --volume custom-weave-20220329110226-2053:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5: (2.617106543s)
I0329 11:25:54.010847 20307 cli_runner.go:133] Run: docker container inspect custom-weave-20220329110226-2053 --format={{.State.Running}}
I0329 11:25:54.150307 20307 cli_runner.go:133] Run: docker container inspect custom-weave-20220329110226-2053 --format={{.State.Status}}
I0329 11:25:54.280639 20307 cli_runner.go:133] Run: docker exec custom-weave-20220329110226-2053 stat /var/lib/dpkg/alternatives/iptables
I0329 11:25:54.461615 20307 oci.go:278] the created container "custom-weave-20220329110226-2053" has a running status.
I0329 11:25:54.461643 20307 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/machines/custom-weave-20220329110226-2053/id_rsa...
I0329 11:25:54.616709 20307 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/machines/custom-weave-20220329110226-2053/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0329 11:25:54.812613 20307 cli_runner.go:133] Run: docker container inspect custom-weave-20220329110226-2053 --format={{.State.Status}}
I0329 11:25:54.939130 20307 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0329 11:25:54.939153 20307 kic_runner.go:114] Args: [docker exec --privileged custom-weave-20220329110226-2053 chown docker:docker /home/docker/.ssh/authorized_keys]
I0329 11:25:55.128607 20307 cli_runner.go:133] Run: docker container inspect custom-weave-20220329110226-2053 --format={{.State.Status}}
I0329 11:25:55.259814 20307 machine.go:88] provisioning docker machine ...
I0329 11:25:55.259885 20307 ubuntu.go:169] provisioning hostname "custom-weave-20220329110226-2053"
I0329 11:25:55.260079 20307 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" custom-weave-20220329110226-2053
I0329 11:25:55.395521 20307 main.go:130] libmachine: Using SSH client type: native
I0329 11:25:55.395744 20307 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13a3660] 0x13a6740 <nil> [] 0s} 127.0.0.1 51077 <nil> <nil>}
I0329 11:25:55.395760 20307 main.go:130] libmachine: About to run SSH command:
sudo hostname custom-weave-20220329110226-2053 && echo "custom-weave-20220329110226-2053" | sudo tee /etc/hostname
I0329 11:25:55.397914 20307 main.go:130] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0329 11:25:58.538218 20307 main.go:130] libmachine: SSH cmd err, output: <nil>: custom-weave-20220329110226-2053
I0329 11:25:58.538327 20307 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" custom-weave-20220329110226-2053
I0329 11:25:58.660092 20307 main.go:130] libmachine: Using SSH client type: native
I0329 11:25:58.660252 20307 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13a3660] 0x13a6740 <nil> [] 0s} 127.0.0.1 51077 <nil> <nil>}
I0329 11:25:58.660267 20307 main.go:130] libmachine: About to run SSH command:
if ! grep -xq '.*\scustom-weave-20220329110226-2053' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 custom-weave-20220329110226-2053/g' /etc/hosts;
else
echo '127.0.1.1 custom-weave-20220329110226-2053' | sudo tee -a /etc/hosts;
fi
fi
I0329 11:25:58.782146 20307 main.go:130] libmachine: SSH cmd err, output: <nil>:
I0329 11:25:58.782170 20307 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.p
em ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube}
I0329 11:25:58.782187 20307 ubuntu.go:177] setting up certificates
I0329 11:25:58.782199 20307 provision.go:83] configureAuth start
I0329 11:25:58.782330 20307 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" custom-weave-20220329110226-2053
I0329 11:25:58.904162 20307 provision.go:138] copyHostCerts
I0329 11:25:58.904257 20307 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/ca.pem, removing ...
I0329 11:25:58.904265 20307 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/ca.pem
I0329 11:25:58.904359 20307 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/ca.pem (1078 bytes)
I0329 11:25:58.904560 20307 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/cert.pem, removing ...
I0329 11:25:58.904569 20307 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/cert.pem
I0329 11:25:58.904634 20307 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/cert.pem (1123 bytes)
I0329 11:25:58.904805 20307 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/key.pem, removing ...
I0329 11:25:58.904812 20307 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/key.pem
I0329 11:25:58.904879 20307 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/key.pem (1679 bytes)
I0329 11:25:58.905003 20307 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/ca-key.pem org=jenkins.custom-weave-20220329110226-2053 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube custom-weave-20220329110226-2053]
I0329 11:25:59.102796 20307 provision.go:172] copyRemoteCerts
I0329 11:25:59.102855 20307 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0329 11:25:59.102912 20307 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" custom-weave-20220329110226-2053
I0329 11:25:59.226773 20307 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51077 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/machines/custom-weave-20220329110226-2053/id_rsa Username:docker}
I0329 11:25:59.316423 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0329 11:25:59.335259 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/machines/server.pem --> /etc/docker/server.pem (1269 bytes)
I0329 11:25:59.352710 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0329 11:25:59.373147 20307 provision.go:86] duration metric: configureAuth took 590.929733ms
I0329 11:25:59.373160 20307 ubuntu.go:193] setting minikube options for container-runtime
I0329 11:25:59.373319 20307 config.go:176] Loaded profile config "custom-weave-20220329110226-2053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.5
I0329 11:25:59.373417 20307 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" custom-weave-20220329110226-2053
I0329 11:25:59.493873 20307 main.go:130] libmachine: Using SSH client type: native
I0329 11:25:59.494025 20307 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13a3660] 0x13a6740 <nil> [] 0s} 127.0.0.1 51077 <nil> <nil>}
I0329 11:25:59.494040 20307 main.go:130] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0329 11:25:59.627962 20307 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay
I0329 11:25:59.627976 20307 ubuntu.go:71] root file system type: overlay
I0329 11:25:59.628162 20307 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0329 11:25:59.628268 20307 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" custom-weave-20220329110226-2053
I0329 11:25:59.750758 20307 main.go:130] libmachine: Using SSH client type: native
I0329 11:25:59.750922 20307 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13a3660] 0x13a6740 <nil> [] 0s} 127.0.0.1 51077 <nil> <nil>}
I0329 11:25:59.750969 20307 main.go:130] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0329 11:25:59.888145 20307 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0329 11:25:59.888277 20307 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" custom-weave-20220329110226-2053
I0329 11:26:00.016542 20307 main.go:130] libmachine: Using SSH client type: native
I0329 11:26:00.016687 20307 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13a3660] 0x13a6740 <nil> [] 0s} 127.0.0.1 51077 <nil> <nil>}
I0329 11:26:00.016707 20307 main.go:130] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0329 11:26:15.390996 20307 main.go:130] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-03-10 14:05:44.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2022-03-29 18:25:59.895310793 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0329 11:26:15.391025 20307 machine.go:91] provisioned docker machine in 20.131211932s
I0329 11:26:15.391033 20307 client.go:171] LocalClient.Create took 33.976967213s
I0329 11:26:15.391057 20307 start.go:169] duration metric: libmachine.API.Create for "custom-weave-20220329110226-2053" took 33.977025979s
I0329 11:26:15.391078 20307 start.go:302] post-start starting for "custom-weave-20220329110226-2053" (driver="docker")
I0329 11:26:15.391087 20307 start.go:312] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0329 11:26:15.391178 20307 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0329 11:26:15.391292 20307 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" custom-weave-20220329110226-2053
I0329 11:26:15.522864 20307 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51077 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/machines/custom-weave-20220329110226-2053/id_rsa Username:docker}
I0329 11:26:15.611504 20307 ssh_runner.go:195] Run: cat /etc/os-release
I0329 11:26:15.615391 20307 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0329 11:26:15.615409 20307 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0329 11:26:15.615415 20307 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0329 11:26:15.615422 20307 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0329 11:26:15.615433 20307 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/addons for local assets ...
I0329 11:26:15.615538 20307 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/files for local assets ...
I0329 11:26:15.615691 20307 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/files/etc/ssl/certs/20532.pem -> 20532.pem in /etc/ssl/certs
I0329 11:26:15.615862 20307 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0329 11:26:15.623468 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/files/etc/ssl/certs/20532.pem --> /etc/ssl/certs/20532.pem (1708 bytes)
I0329 11:26:15.640809 20307 start.go:305] post-start completed in 249.720485ms
I0329 11:26:15.641366 20307 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" custom-weave-20220329110226-2053
I0329 11:26:15.757476 20307 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/config.json ...
I0329 11:26:15.757884 20307 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0329 11:26:15.757952 20307 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" custom-weave-20220329110226-2053
I0329 11:26:15.878596 20307 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51077 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/machines/custom-weave-20220329110226-2053/id_rsa Username:docker}
I0329 11:26:15.962696 20307 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0329 11:26:15.967291 20307 start.go:130] duration metric: createHost completed in 34.600567818s
I0329 11:26:15.967313 20307 start.go:81] releasing machines lock for "custom-weave-20220329110226-2053", held for 34.600737328s
I0329 11:26:15.967455 20307 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" custom-weave-20220329110226-2053
I0329 11:26:16.088361 20307 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0329 11:26:16.088368 20307 ssh_runner.go:195] Run: systemctl --version
I0329 11:26:16.088444 20307 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" custom-weave-20220329110226-2053
I0329 11:26:16.088480 20307 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" custom-weave-20220329110226-2053
I0329 11:26:16.215040 20307 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51077 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/machines/custom-weave-20220329110226-2053/id_rsa Username:docker}
I0329 11:26:16.215048 20307 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51077 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/machines/custom-weave-20220329110226-2053/id_rsa Username:docker}
I0329 11:26:16.394887 20307 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0329 11:26:16.404163 20307 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0329 11:26:16.413268 20307 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0329 11:26:16.413341 20307 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0329 11:26:16.422827 20307 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0329 11:26:16.435910 20307 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0329 11:26:16.492498 20307 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0329 11:26:16.548344 20307 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0329 11:26:16.558724 20307 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0329 11:26:16.614968 20307 ssh_runner.go:195] Run: sudo systemctl start docker
I0329 11:26:16.624855 20307 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0329 11:26:16.681212 20307 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0329 11:26:16.745885 20307 out.go:203] * Preparing Kubernetes v1.23.5 on Docker 20.10.13 ...
I0329 11:26:16.746064 20307 cli_runner.go:133] Run: docker exec -t custom-weave-20220329110226-2053 dig +short host.docker.internal
I0329 11:26:16.915983 20307 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0329 11:26:16.916080 20307 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0329 11:26:16.920830 20307 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0329 11:26:16.930502 20307 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" custom-weave-20220329110226-2053
I0329 11:26:17.047732 20307 preload.go:132] Checking if preload exists for k8s version v1.23.5 and runtime docker
I0329 11:26:17.047813 20307 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0329 11:26:17.080104 20307 docker.go:606] Got preloaded images: -- stdout --
k8s.gcr.io/kube-apiserver:v1.23.5
k8s.gcr.io/kube-proxy:v1.23.5
k8s.gcr.io/kube-scheduler:v1.23.5
k8s.gcr.io/kube-controller-manager:v1.23.5
k8s.gcr.io/etcd:3.5.1-0
k8s.gcr.io/coredns/coredns:v1.8.6
k8s.gcr.io/pause:3.6
kubernetesui/dashboard:v2.3.1
kubernetesui/metrics-scraper:v1.0.7
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0329 11:26:17.080121 20307 docker.go:537] Images already preloaded, skipping extraction
I0329 11:26:17.080242 20307 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0329 11:26:17.110962 20307 docker.go:606] Got preloaded images: -- stdout --
k8s.gcr.io/kube-apiserver:v1.23.5
k8s.gcr.io/kube-proxy:v1.23.5
k8s.gcr.io/kube-scheduler:v1.23.5
k8s.gcr.io/kube-controller-manager:v1.23.5
k8s.gcr.io/etcd:3.5.1-0
k8s.gcr.io/coredns/coredns:v1.8.6
k8s.gcr.io/pause:3.6
kubernetesui/dashboard:v2.3.1
kubernetesui/metrics-scraper:v1.0.7
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0329 11:26:17.110979 20307 cache_images.go:84] Images are preloaded, skipping loading
I0329 11:26:17.111090 20307 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0329 11:26:17.205717 20307 cni.go:93] Creating CNI manager for "testdata/weavenet.yaml"
I0329 11:26:17.205765 20307 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0329 11:26:17.205794 20307 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.23.5 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:custom-weave-20220329110226-2053 NodeName:custom-weave-20220329110226-2053 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile
:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I0329 11:26:17.205906 20307 kubeadm.go:162] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "custom-weave-20220329110226-2053"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.23.5
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0329 11:26:17.205991 20307 kubeadm.go:936] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.23.5/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=custom-weave-20220329110226-2053 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.23.5 ClusterName:custom-weave-20220329110226-2053 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/weavenet.yaml NodeIP: NodePort:8443 NodeName:}
I0329 11:26:17.206048 20307 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.23.5
I0329 11:26:17.214915 20307 binaries.go:44] Found k8s binaries, skipping transfer
I0329 11:26:17.214971 20307 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0329 11:26:17.222841 20307 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (379 bytes)
I0329 11:26:17.234672 20307 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0329 11:26:17.247442 20307 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2054 bytes)
I0329 11:26:17.260036 20307 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0329 11:26:17.263475 20307 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0329 11:26:17.272873 20307 certs.go:54] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053 for IP: 192.168.49.2
I0329 11:26:17.273001 20307 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/ca.key
I0329 11:26:17.273060 20307 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/proxy-client-ca.key
I0329 11:26:17.273111 20307 certs.go:302] generating minikube-user signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/client.key
I0329 11:26:17.273128 20307 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/client.crt with IP's: []
I0329 11:26:17.510528 20307 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/client.crt ...
I0329 11:26:17.510544 20307 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/client.crt: {Name:mkf498cdb5a46a77ec16f3fc7948d8ffaae34f1d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 11:26:17.510870 20307 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/client.key ...
I0329 11:26:17.510878 20307 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/client.key: {Name:mk5dc7c9e7f280433833a89b412e9b558596f9a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 11:26:17.511072 20307 certs.go:302] generating minikube signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/apiserver.key.dd3b5fb2
I0329 11:26:17.511091 20307 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0329 11:26:17.577230 20307 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/apiserver.crt.dd3b5fb2 ...
I0329 11:26:17.577239 20307 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/apiserver.crt.dd3b5fb2: {Name:mke69c27c5c6d3bad1397a7456b464697a35a96f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 11:26:17.577450 20307 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/apiserver.key.dd3b5fb2 ...
I0329 11:26:17.577459 20307 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/apiserver.key.dd3b5fb2: {Name:mk0104ddbeb959dc6789a663926b860ed7c5ab51 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 11:26:17.577620 20307 certs.go:320] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/apiserver.crt.dd3b5fb2 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/apiserver.crt
I0329 11:26:17.577792 20307 certs.go:324] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/apiserver.key.dd3b5fb2 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/apiserver.key
I0329 11:26:17.577952 20307 certs.go:302] generating aggregator signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/proxy-client.key
I0329 11:26:17.577968 20307 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/proxy-client.crt with IP's: []
I0329 11:26:17.674168 20307 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/proxy-client.crt ...
I0329 11:26:17.674181 20307 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/proxy-client.crt: {Name:mk6f6184ee662c601adb71898a68b09200aaab0c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 11:26:17.674436 20307 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/proxy-client.key ...
I0329 11:26:17.674444 20307 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/proxy-client.key: {Name:mkecb60a24b1829140b6d63884fc0b410aa2cac1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 11:26:17.674810 20307 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/2053.pem (1338 bytes)
W0329 11:26:17.674859 20307 certs.go:384] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/2053_empty.pem, impossibly tiny 0 bytes
I0329 11:26:17.674870 20307 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/ca-key.pem (1675 bytes)
I0329 11:26:17.674906 20307 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/ca.pem (1078 bytes)
I0329 11:26:17.674943 20307 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/cert.pem (1123 bytes)
I0329 11:26:17.674974 20307 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/key.pem (1679 bytes)
I0329 11:26:17.675043 20307 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/files/etc/ssl/certs/20532.pem (1708 bytes)
I0329 11:26:17.675557 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0329 11:26:17.694329 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0329 11:26:17.711191 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0329 11:26:17.728342 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/custom-weave-20220329110226-2053/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0329 11:26:17.744964 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0329 11:26:17.761507 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0329 11:26:17.778638 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0329 11:26:17.794933 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0329 11:26:17.812985 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0329 11:26:17.830333 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/certs/2053.pem --> /usr/share/ca-certificates/2053.pem (1338 bytes)
I0329 11:26:17.846764 20307 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/files/etc/ssl/certs/20532.pem --> /usr/share/ca-certificates/20532.pem (1708 bytes)
I0329 11:26:17.864161 20307 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0329 11:26:17.876777 20307 ssh_runner.go:195] Run: openssl version
I0329 11:26:17.884973 20307 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/20532.pem && ln -fs /usr/share/ca-certificates/20532.pem /etc/ssl/certs/20532.pem"
I0329 11:26:17.894030 20307 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/20532.pem
I0329 11:26:17.897755 20307 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Mar 29 17:17 /usr/share/ca-certificates/20532.pem
I0329 11:26:17.897802 20307 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/20532.pem
I0329 11:26:17.903260 20307 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/20532.pem /etc/ssl/certs/3ec20f2e.0"
I0329 11:26:17.911199 20307 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0329 11:26:17.920792 20307 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0329 11:26:17.924989 20307 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Mar 29 17:12 /usr/share/ca-certificates/minikubeCA.pem
I0329 11:26:17.925039 20307 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0329 11:26:17.930627 20307 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0329 11:26:17.938260 20307 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2053.pem && ln -fs /usr/share/ca-certificates/2053.pem /etc/ssl/certs/2053.pem"
I0329 11:26:17.946481 20307 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2053.pem
I0329 11:26:17.950464 20307 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Mar 29 17:17 /usr/share/ca-certificates/2053.pem
I0329 11:26:17.950514 20307 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2053.pem
I0329 11:26:17.956088 20307 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2053.pem /etc/ssl/certs/51391683.0"
I0329 11:26:17.963847 20307 kubeadm.go:391] StartCluster: {Name:custom-weave-20220329110226-2053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.5 ClusterName:custom-weave-20220329110226-2053 Namespace:default APIServerName:minikubeCA A
PIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/weavenet.yaml NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.23.5 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimization
s:false DisableMetrics:false}
I0329 11:26:17.963959 20307 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0329 11:26:17.993505 20307 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0329 11:26:18.000832 20307 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0329 11:26:18.008180 20307 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0329 11:26:18.008239 20307 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0329 11:26:18.015283 20307 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0329 11:26:18.015621 20307 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.5:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0329 11:26:31.573417 20307 out.go:203] - Generating certificates and keys ...
I0329 11:26:31.662527 20307 out.go:203] - Booting up control plane ...
I0329 11:26:31.692519 20307 out.go:203] - Configuring RBAC rules ...
I0329 11:26:31.694574 20307 cni.go:93] Creating CNI manager for "testdata/weavenet.yaml"
I0329 11:26:31.792467 20307 out.go:176] * Configuring testdata/weavenet.yaml (Container Networking Interface) ...
I0329 11:26:31.792558 20307 cni.go:187] applying CNI manifest using /var/lib/minikube/binaries/v1.23.5/kubectl ...
I0329 11:26:31.792610 20307 ssh_runner.go:195] Run: stat -c "%s %y" /var/tmp/minikube/cni.yaml
I0329 11:26:31.799372 20307 ssh_runner.go:352] existence check for /var/tmp/minikube/cni.yaml: stat -c "%s %y" /var/tmp/minikube/cni.yaml: Process exited with status 1
stdout:
stderr:
stat: cannot stat '/var/tmp/minikube/cni.yaml': No such file or directory
I0329 11:26:31.799399 20307 ssh_runner.go:362] scp testdata/weavenet.yaml --> /var/tmp/minikube/cni.yaml (10948 bytes)
I0329 11:26:31.817159 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0329 11:26:32.419884 20307 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0329 11:26:32.419969 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl label nodes minikube.k8s.io/version=v1.25.2 minikube.k8s.io/commit=923781973407d6dc536f326caa216e4920fd75c3 minikube.k8s.io/name=custom-weave-20220329110226-2053 minikube.k8s.io/updated_at=2022_03_29T11_26_32_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:32.419972 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:32.482916 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:32.490067 20307 ops.go:34] apiserver oom_adj: -16
I0329 11:26:33.046502 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:33.544030 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:34.043121 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:34.542740 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:35.042505 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:35.547565 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:36.042354 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:36.542887 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:37.042464 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:37.542611 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:38.042412 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:38.542368 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:39.042385 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:39.547680 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:40.042350 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:40.542386 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:41.048130 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:41.547773 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:42.044888 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:42.542563 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:43.043549 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:43.542454 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:44.042770 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:44.546321 20307 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 11:26:44.600755 20307 kubeadm.go:1020] duration metric: took 12.180873684s to wait for elevateKubeSystemPrivileges.
I0329 11:26:44.600784 20307 kubeadm.go:393] StartCluster complete in 26.636978156s
I0329 11:26:44.600800 20307 settings.go:142] acquiring lock: {Name:mk5b01a4191281d3f224b52386a90714bd22cc72 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 11:26:44.600894 20307 settings.go:150] Updating kubeconfig: /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/kubeconfig
I0329 11:26:44.601354 20307 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/kubeconfig: {Name:mk7bef67bea8eb326a483bde80a52ac63c137849 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 11:26:45.120090 20307 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "custom-weave-20220329110226-2053" rescaled to 1
I0329 11:26:45.120133 20307 start.go:208] Will wait 5m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.23.5 ContainerRuntime:docker ControlPlane:true Worker:true}
I0329 11:26:45.120142 20307 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.5/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0329 11:26:45.120165 20307 addons.go:415] enableAddons start: toEnable=map[], additional=[]
I0329 11:26:45.147653 20307 out.go:176] * Verifying Kubernetes components...
I0329 11:26:45.120319 20307 config.go:176] Loaded profile config "custom-weave-20220329110226-2053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.5
I0329 11:26:45.147727 20307 addons.go:65] Setting storage-provisioner=true in profile "custom-weave-20220329110226-2053"
I0329 11:26:45.147774 20307 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0329 11:26:45.147789 20307 addons.go:153] Setting addon storage-provisioner=true in "custom-weave-20220329110226-2053"
I0329 11:26:45.147727 20307 addons.go:65] Setting default-storageclass=true in profile "custom-weave-20220329110226-2053"
W0329 11:26:45.147799 20307 addons.go:165] addon storage-provisioner should already be in state true
I0329 11:26:45.147829 20307 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "custom-weave-20220329110226-2053"
I0329 11:26:45.147834 20307 host.go:66] Checking if "custom-weave-20220329110226-2053" exists ...
I0329 11:26:45.148132 20307 cli_runner.go:133] Run: docker container inspect custom-weave-20220329110226-2053 --format={{.State.Status}}
I0329 11:26:45.148232 20307 cli_runner.go:133] Run: docker container inspect custom-weave-20220329110226-2053 --format={{.State.Status}}
I0329 11:26:45.178173 20307 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" custom-weave-20220329110226-2053
I0329 11:26:45.178216 20307 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.5/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.2 host.minikube.internal\n fallthrough\n }' | sudo /var/lib/minikube/binaries/v1.23.5/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0329 11:26:45.309269 20307 addons.go:153] Setting addon default-storageclass=true in "custom-weave-20220329110226-2053"
W0329 11:26:45.331086 20307 addons.go:165] addon default-storageclass should already be in state true
I0329 11:26:45.331059 20307 out.go:176] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0329 11:26:45.331106 20307 host.go:66] Checking if "custom-weave-20220329110226-2053" exists ...
I0329 11:26:45.331259 20307 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0329 11:26:45.331269 20307 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0329 11:26:45.331359 20307 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" custom-weave-20220329110226-2053
I0329 11:26:45.331755 20307 cli_runner.go:133] Run: docker container inspect custom-weave-20220329110226-2053 --format={{.State.Status}}
I0329 11:26:45.339811 20307 start.go:777] {"host.minikube.internal": 192.168.65.2} host record injected into CoreDNS
I0329 11:26:45.345824 20307 node_ready.go:35] waiting up to 5m0s for node "custom-weave-20220329110226-2053" to be "Ready" ...
I0329 11:26:45.349540 20307 node_ready.go:49] node "custom-weave-20220329110226-2053" has status "Ready":"True"
I0329 11:26:45.349550 20307 node_ready.go:38] duration metric: took 3.706406ms waiting for node "custom-weave-20220329110226-2053" to be "Ready" ...
I0329 11:26:45.349556 20307 pod_ready.go:35] extra waiting up to 5m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0329 11:26:45.357634 20307 pod_ready.go:78] waiting up to 5m0s for pod "coredns-64897985d-8dqds" in "kube-system" namespace to be "Ready" ...
I0329 11:26:45.468296 20307 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51077 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/machines/custom-weave-20220329110226-2053/id_rsa Username:docker}
I0329 11:26:45.468358 20307 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml
I0329 11:26:45.511871 20307 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0329 11:26:45.511995 20307 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" custom-weave-20220329110226-2053
I0329 11:26:45.642285 20307 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.5/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0329 11:26:45.651316 20307 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51077 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/machines/custom-weave-20220329110226-2053/id_rsa Username:docker}
I0329 11:26:45.845271 20307 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.5/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0329 11:26:46.223580 20307 out.go:176] * Enabled addons: storage-provisioner, default-storageclass
I0329 11:26:46.223607 20307 addons.go:417] enableAddons completed in 1.103454729s
I0329 11:26:47.370160 20307 pod_ready.go:102] pod "coredns-64897985d-8dqds" in "kube-system" namespace has status "Ready":"False"
I0329 11:26:49.369969 20307 pod_ready.go:97] error getting pod "coredns-64897985d-8dqds" in "kube-system" namespace (skipping!): pods "coredns-64897985d-8dqds" not found
I0329 11:26:49.369986 20307 pod_ready.go:81] duration metric: took 4.012342412s waiting for pod "coredns-64897985d-8dqds" in "kube-system" namespace to be "Ready" ...
E0329 11:26:49.370002 20307 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-64897985d-8dqds" in "kube-system" namespace (skipping!): pods "coredns-64897985d-8dqds" not found
I0329 11:26:49.370008 20307 pod_ready.go:78] waiting up to 5m0s for pod "coredns-64897985d-mpfg8" in "kube-system" namespace to be "Ready" ...
I0329 11:26:51.393618 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:26:53.894046 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:26:56.393321 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:26:58.894470 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:00.895233 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:03.394190 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:05.893372 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:08.394270 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:10.893353 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:12.894778 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:15.394712 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:17.892965 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:19.893305 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:22.393716 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:24.395409 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:26.893117 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:28.894920 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:31.393301 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:33.893876 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:35.894879 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:38.396184 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:40.893816 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:42.894090 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:45.395064 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:47.891503 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:49.893718 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:51.894824 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:54.392129 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:56.392168 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:27:58.393121 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:00.394147 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:02.893438 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:04.894706 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:06.895470 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:09.392915 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:11.893069 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:13.893237 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:15.894475 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:18.392100 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:20.394403 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:22.891593 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:24.896137 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:27.395134 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:29.895272 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:32.394800 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:34.893749 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:37.392632 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:39.393276 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:41.393370 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:43.393600 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:45.891251 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:47.894814 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:50.394529 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:52.892013 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:54.894200 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:57.393923 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:28:59.893908 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:02.392206 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:04.393720 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:06.393828 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:08.394050 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:10.893365 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:13.392785 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:15.396028 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:17.893043 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:20.394589 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:22.397896 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:24.893321 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:27.392176 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:29.392939 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:31.395797 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:33.893720 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:36.393774 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:38.393975 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:40.395070 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:42.893694 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:44.894251 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:47.391820 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:49.392740 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:51.894081 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:54.392061 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:56.395249 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:29:58.892029 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:00.893408 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:03.391990 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:05.392947 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:07.892275 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:10.393279 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:12.393669 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:14.892889 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:17.393494 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:19.893907 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:22.391285 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:24.392658 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:26.895158 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:28.895896 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:31.394199 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:33.893598 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:35.894026 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:38.393454 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:40.892292 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:42.892491 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:45.393040 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:47.891564 20307 pod_ready.go:102] pod "coredns-64897985d-mpfg8" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:49.398332 20307 pod_ready.go:81] duration metric: took 4m0.028844457s waiting for pod "coredns-64897985d-mpfg8" in "kube-system" namespace to be "Ready" ...
E0329 11:30:49.398345 20307 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting for the condition
I0329 11:30:49.398350 20307 pod_ready.go:78] waiting up to 5m0s for pod "etcd-custom-weave-20220329110226-2053" in "kube-system" namespace to be "Ready" ...
I0329 11:30:49.403888 20307 pod_ready.go:92] pod "etcd-custom-weave-20220329110226-2053" in "kube-system" namespace has status "Ready":"True"
I0329 11:30:49.403897 20307 pod_ready.go:81] duration metric: took 5.546929ms waiting for pod "etcd-custom-weave-20220329110226-2053" in "kube-system" namespace to be "Ready" ...
I0329 11:30:49.403906 20307 pod_ready.go:78] waiting up to 5m0s for pod "kube-apiserver-custom-weave-20220329110226-2053" in "kube-system" namespace to be "Ready" ...
I0329 11:30:49.408940 20307 pod_ready.go:92] pod "kube-apiserver-custom-weave-20220329110226-2053" in "kube-system" namespace has status "Ready":"True"
I0329 11:30:49.408950 20307 pod_ready.go:81] duration metric: took 5.04231ms waiting for pod "kube-apiserver-custom-weave-20220329110226-2053" in "kube-system" namespace to be "Ready" ...
I0329 11:30:49.408957 20307 pod_ready.go:78] waiting up to 5m0s for pod "kube-controller-manager-custom-weave-20220329110226-2053" in "kube-system" namespace to be "Ready" ...
I0329 11:30:49.413719 20307 pod_ready.go:92] pod "kube-controller-manager-custom-weave-20220329110226-2053" in "kube-system" namespace has status "Ready":"True"
I0329 11:30:49.413728 20307 pod_ready.go:81] duration metric: took 4.764573ms waiting for pod "kube-controller-manager-custom-weave-20220329110226-2053" in "kube-system" namespace to be "Ready" ...
I0329 11:30:49.413735 20307 pod_ready.go:78] waiting up to 5m0s for pod "kube-proxy-wm4zb" in "kube-system" namespace to be "Ready" ...
I0329 11:30:49.797381 20307 pod_ready.go:92] pod "kube-proxy-wm4zb" in "kube-system" namespace has status "Ready":"True"
I0329 11:30:49.797393 20307 pod_ready.go:81] duration metric: took 383.964026ms waiting for pod "kube-proxy-wm4zb" in "kube-system" namespace to be "Ready" ...
I0329 11:30:49.797401 20307 pod_ready.go:78] waiting up to 5m0s for pod "kube-scheduler-custom-weave-20220329110226-2053" in "kube-system" namespace to be "Ready" ...
I0329 11:30:50.190053 20307 pod_ready.go:92] pod "kube-scheduler-custom-weave-20220329110226-2053" in "kube-system" namespace has status "Ready":"True"
I0329 11:30:50.190065 20307 pod_ready.go:81] duration metric: took 392.973906ms waiting for pod "kube-scheduler-custom-weave-20220329110226-2053" in "kube-system" namespace to be "Ready" ...
I0329 11:30:50.190072 20307 pod_ready.go:78] waiting up to 5m0s for pod "weave-net-kfmqj" in "kube-system" namespace to be "Ready" ...
I0329 11:30:52.610830 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:55.106905 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:30:57.603654 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:00.103648 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:02.106618 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:04.600422 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:06.600120 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:08.600736 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:11.098679 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:13.098540 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:15.098597 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:17.099933 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:19.601227 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:22.097931 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:24.098348 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:26.100936 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:28.595413 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:30.596452 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:33.100825 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:35.595452 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:37.600002 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:39.603709 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:42.098290 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:44.099070 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:46.596946 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:49.097733 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:51.600628 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:54.096483 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:56.096680 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:31:58.595799 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:00.597297 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:03.097579 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:05.598586 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:08.095817 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:10.097082 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:12.097270 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:14.100894 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:16.599281 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:19.095969 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:21.098875 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:23.596642 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:25.599677 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:28.099867 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:30.597399 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:33.097361 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:35.595447 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:38.097170 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:40.595363 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:42.597252 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:45.096782 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:47.597535 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:49.598842 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:52.097463 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:54.598462 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:57.094766 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:32:59.095741 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:01.097601 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:03.602983 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:06.097662 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:08.105835 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:10.595694 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:13.096713 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:15.596189 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:18.095023 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:20.102057 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:22.596995 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:25.097052 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:27.100688 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:29.595437 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:32.096117 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:34.594673 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:37.092087 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:39.092507 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:41.100170 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:43.590802 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:45.594417 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:48.100087 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:50.594269 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:52.598337 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:55.100084 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:57.101307 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:33:59.595032 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:01.596744 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:04.093478 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:06.592067 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:08.592314 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:10.593258 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:13.097505 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:15.593822 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:18.097207 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:20.593393 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:23.091883 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:25.094371 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:27.094554 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:29.592201 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:31.592885 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:33.594900 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:36.092613 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:38.092858 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:40.592843 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:43.092974 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:45.093406 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:47.592258 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:49.596253 20307 pod_ready.go:102] pod "weave-net-kfmqj" in "kube-system" namespace has status "Ready":"False"
I0329 11:34:50.597979 20307 pod_ready.go:81] duration metric: took 4m0.420601729s waiting for pod "weave-net-kfmqj" in "kube-system" namespace to be "Ready" ...
E0329 11:34:50.597990 20307 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting for the condition
I0329 11:34:50.597993 20307 pod_ready.go:38] duration metric: took 8m5.262306193s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0329 11:34:50.598014 20307 api_server.go:51] waiting for apiserver process to appear ...
I0329 11:34:50.623548 20307 out.go:176]
W0329 11:34:50.623637 20307 out.go:241] X Exiting due to K8S_APISERVER_MISSING: wait 5m0s for node: wait for apiserver proc: apiserver process never appeared
X Exiting due to K8S_APISERVER_MISSING: wait 5m0s for node: wait for apiserver proc: apiserver process never appeared
W0329 11:34:50.623697 20307 out.go:241] * Suggestion: Check that the provided apiserver flags are valid, and that SELinux is disabled
* Suggestion: Check that the provided apiserver flags are valid, and that SELinux is disabled
W0329 11:34:50.623704 20307 out.go:241] * Related issues:
* Related issues:
W0329 11:34:50.623732 20307 out.go:241] - https://github.com/kubernetes/minikube/issues/4536
- https://github.com/kubernetes/minikube/issues/4536
W0329 11:34:50.623774 20307 out.go:241] - https://github.com/kubernetes/minikube/issues/6014
- https://github.com/kubernetes/minikube/issues/6014
I0329 11:34:50.649548 20307 out.go:176]
** /stderr **
net_test.go:101: failed start: exit status 105
--- FAIL: TestNetworkPlugins/group/custom-weave/Start (550.32s)
E0329 11:54:48.026089 2053 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/false-20220329110226-2053/client.crt: no such file or directory
E0329 11:55:04.493887 2053 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/ingress-addon-legacy-20220329102231-2053/client.crt: no such file or directory
E0329 11:55:06.141793 2053 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/calico-20220329110226-2053/client.crt: no such file or directory
E0329 11:55:20.903211 2053 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/auto-20220329110225-2053/client.crt: no such file or directory
E0329 11:55:40.675734 2053 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/skaffold-20220329105920-2053/client.crt: no such file or directory
E0329 11:55:57.543878 2053 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/skaffold-20220329105920-2053/client.crt: no such file or directory
E0329 11:56:00.180912 2053 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/cilium-20220329110226-2053/client.crt: no such file or directory
E0329 11:56:07.872873 2053 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--13730-908-eb19396baacb27bcde6912a0ea5aa6419fc16109/.minikube/profiles/functional-20220329101744-2053/client.crt: no such file or directory