=== RUN TestNetworkPlugins/group/cilium/Start
net_test.go:101: (dbg) Run: out/minikube-windows-amd64.exe start -p cilium-114511 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker
E0114 12:01:48.461948 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\addons-100931\client.crt: The system cannot find the path specified.
E0114 12:01:56.944107 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-114913\client.crt: The system cannot find the path specified.
E0114 12:01:56.959171 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-114913\client.crt: The system cannot find the path specified.
E0114 12:01:56.974757 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-114913\client.crt: The system cannot find the path specified.
E0114 12:01:57.006238 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-114913\client.crt: The system cannot find the path specified.
E0114 12:01:57.053625 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-114913\client.crt: The system cannot find the path specified.
E0114 12:01:57.148312 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-114913\client.crt: The system cannot find the path specified.
E0114 12:01:57.321230 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-114913\client.crt: The system cannot find the path specified.
E0114 12:01:57.649351 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-114913\client.crt: The system cannot find the path specified.
E0114 12:01:58.298256 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-114913\client.crt: The system cannot find the path specified.
E0114 12:01:59.587653 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-114913\client.crt: The system cannot find the path specified.
E0114 12:02:02.161389 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-114913\client.crt: The system cannot find the path specified.
E0114 12:02:05.244858 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\addons-100931\client.crt: The system cannot find the path specified.
E0114 12:02:07.285512 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-114913\client.crt: The system cannot find the path specified.
E0114 12:02:17.533295 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-114913\client.crt: The system cannot find the path specified.
E0114 12:02:38.019191 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-114913\client.crt: The system cannot find the path specified.
E0114 12:02:57.688250 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\no-preload-115022\client.crt: The system cannot find the path specified.
E0114 12:02:57.703041 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\no-preload-115022\client.crt: The system cannot find the path specified.
E0114 12:02:57.718753 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\no-preload-115022\client.crt: The system cannot find the path specified.
E0114 12:02:57.750676 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\no-preload-115022\client.crt: The system cannot find the path specified.
E0114 12:02:57.797832 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\no-preload-115022\client.crt: The system cannot find the path specified.
E0114 12:02:57.892660 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\no-preload-115022\client.crt: The system cannot find the path specified.
E0114 12:02:58.053528 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\no-preload-115022\client.crt: The system cannot find the path specified.
E0114 12:02:58.382599 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\no-preload-115022\client.crt: The system cannot find the path specified.
E0114 12:02:59.023142 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\no-preload-115022\client.crt: The system cannot find the path specified.
E0114 12:03:00.308623 9968 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\no-preload-115022\client.crt: The system cannot find the path specified.
=== CONT TestNetworkPlugins/group/cilium/Start
net_test.go:101: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p cilium-114511 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker: exit status 80 (9m33.2807873s)
-- stdout --
* [cilium-114511] minikube v1.28.0 on Microsoft Windows 10 Enterprise N 10.0.19045.2486 Build 19045.2486
- KUBECONFIG=C:\Users\jenkins.minikube2\minikube-integration\kubeconfig
- MINIKUBE_HOME=C:\Users\jenkins.minikube2\minikube-integration\.minikube
- MINIKUBE_LOCATION=15642
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node cilium-114511 in cluster cilium-114511
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2048MB) ...
* Preparing Kubernetes v1.25.3 on Docker 20.10.21 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Configuring RBAC rules ...
* Configuring Cilium (Container Networking Interface) ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Enabled addons: default-storageclass, storage-provisioner
-- /stdout --
** stderr **
I0114 12:01:28.529153 7488 out.go:296] Setting OutFile to fd 1568 ...
I0114 12:01:28.599877 7488 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0114 12:01:28.599877 7488 out.go:309] Setting ErrFile to fd 1760...
I0114 12:01:28.599877 7488 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0114 12:01:28.619437 7488 out.go:303] Setting JSON to false
I0114 12:01:28.622064 7488 start.go:125] hostinfo: {"hostname":"minikube2","uptime":9299,"bootTime":1673688389,"procs":158,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.2486 Build 19045.2486","kernelVersion":"10.0.19045.2486 Build 19045.2486","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"29dced62-21fb-45d8-a34e-472b66ced002"}
W0114 12:01:28.622296 7488 start.go:133] gopshost.Virtualization returned error: not implemented yet
I0114 12:01:28.629458 7488 out.go:177] * [cilium-114511] minikube v1.28.0 on Microsoft Windows 10 Enterprise N 10.0.19045.2486 Build 19045.2486
I0114 12:01:28.634820 7488 notify.go:220] Checking for updates...
I0114 12:01:28.638529 7488 out.go:177] - KUBECONFIG=C:\Users\jenkins.minikube2\minikube-integration\kubeconfig
I0114 12:01:28.643540 7488 out.go:177] - MINIKUBE_HOME=C:\Users\jenkins.minikube2\minikube-integration\.minikube
I0114 12:01:28.649418 7488 out.go:177] - MINIKUBE_LOCATION=15642
I0114 12:01:28.654660 7488 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0114 12:01:28.658210 7488 config.go:180] Loaded profile config "auto-114507": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.25.3
I0114 12:01:28.659393 7488 config.go:180] Loaded profile config "embed-certs-115542": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.25.3
I0114 12:01:28.659746 7488 config.go:180] Loaded profile config "kindnet-114509": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.25.3
I0114 12:01:28.660139 7488 driver.go:365] Setting default libvirt URI to qemu:///system
I0114 12:01:28.982451 7488 docker.go:138] docker version: linux-20.10.21
I0114 12:01:28.990058 7488 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0114 12:01:29.649520 7488 info.go:266] docker info: {ID:3UBZ:WVUB:HLKZ:K7PJ:5MPF:INSH:AFXZ:DVGD:NGYR:ZXOC:2S5U:CWJN Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:67 OomKillDisable:true NGoroutines:66 SystemTime:2023-01-14 12:01:29.1519838 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.21 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:1c90a442489720eec95342e1789ee8a5e1b9536f Expected:1c90a442489720eec95342e1789ee8a5e1b9536f} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp
,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.9.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.12.2] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.3] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.13] map[Name:sbom Path:C:\Program Files\Docker\cli-plug
ins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.21.0]] Warnings:<nil>}}
I0114 12:01:29.927935 7488 out.go:177] * Using the docker driver based on user configuration
I0114 12:01:30.122116 7488 start.go:294] selected driver: docker
I0114 12:01:30.122297 7488 start.go:838] validating driver "docker" against <nil>
I0114 12:01:30.122391 7488 start.go:849] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0114 12:01:30.190343 7488 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0114 12:01:30.808520 7488 info.go:266] docker info: {ID:3UBZ:WVUB:HLKZ:K7PJ:5MPF:INSH:AFXZ:DVGD:NGYR:ZXOC:2S5U:CWJN Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:67 OomKillDisable:true NGoroutines:66 SystemTime:2023-01-14 12:01:30.3380223 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.21 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:1c90a442489720eec95342e1789ee8a5e1b9536f Expected:1c90a442489720eec95342e1789ee8a5e1b9536f} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp
,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.9.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.12.2] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.3] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.13] map[Name:sbom Path:C:\Program Files\Docker\cli-plug
ins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.21.0]] Warnings:<nil>}}
I0114 12:01:30.809144 7488 start_flags.go:305] no existing cluster config was found, will generate one from the flags
I0114 12:01:30.810331 7488 start_flags.go:917] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0114 12:01:30.844757 7488 out.go:177] * Using Docker Desktop driver with root privileges
I0114 12:01:30.931433 7488 cni.go:95] Creating CNI manager for "cilium"
I0114 12:01:30.931433 7488 start_flags.go:314] Found "Cilium" CNI - setting NetworkPlugin=cni
I0114 12:01:30.931433 7488 start_flags.go:319] config:
{Name:cilium-114511 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1668787669-15272@sha256:06094fc04b5dc02fbf1e2de7723c2a6db5d24c21fd2ddda91f6daaf29038cd9c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.25.3 ClusterName:cilium-114511 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker C
RISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube2:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}
I0114 12:01:31.034595 7488 out.go:177] * Starting control plane node cilium-114511 in cluster cilium-114511
I0114 12:01:31.124116 7488 cache.go:120] Beginning downloading kic base image for docker with docker
I0114 12:01:31.160605 7488 out.go:177] * Pulling base image ...
I0114 12:01:31.165909 7488 image.go:77] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1668787669-15272@sha256:06094fc04b5dc02fbf1e2de7723c2a6db5d24c21fd2ddda91f6daaf29038cd9c in local docker daemon
I0114 12:01:31.165909 7488 preload.go:132] Checking if preload exists for k8s version v1.25.3 and runtime docker
I0114 12:01:31.165909 7488 preload.go:148] Found local preload: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.25.3-docker-overlay2-amd64.tar.lz4
I0114 12:01:31.165909 7488 cache.go:57] Caching tarball of preloaded images
I0114 12:01:31.166668 7488 preload.go:174] Found C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.25.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0114 12:01:31.166918 7488 cache.go:60] Finished verifying existence of preloaded tar for v1.25.3 on docker
I0114 12:01:31.167086 7488 profile.go:148] Saving config to C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\config.json ...
I0114 12:01:31.167086 7488 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\config.json: {Name:mk87587c714bc3b2aa1fe3b584f029fb1502fd43 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0114 12:01:31.390625 7488 image.go:81] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1668787669-15272@sha256:06094fc04b5dc02fbf1e2de7723c2a6db5d24c21fd2ddda91f6daaf29038cd9c in local docker daemon, skipping pull
I0114 12:01:31.390625 7488 cache.go:143] gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1668787669-15272@sha256:06094fc04b5dc02fbf1e2de7723c2a6db5d24c21fd2ddda91f6daaf29038cd9c exists in daemon, skipping load
I0114 12:01:31.390625 7488 cache.go:193] Successfully downloaded all kic artifacts
I0114 12:01:31.390625 7488 start.go:364] acquiring machines lock for cilium-114511: {Name:mkbcfb3555d1094104122a087dbd8320c941634b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0114 12:01:31.390625 7488 start.go:368] acquired machines lock for "cilium-114511" in 0s
I0114 12:01:31.390625 7488 start.go:93] Provisioning new machine with config: &{Name:cilium-114511 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1668787669-15272@sha256:06094fc04b5dc02fbf1e2de7723c2a6db5d24c21fd2ddda91f6daaf29038cd9c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.25.3 ClusterName:cilium-114511 Namespace:default APIServerName:minikubeCA A
PIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.25.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube2:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt
imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.25.3 ContainerRuntime:docker ControlPlane:true Worker:true}
I0114 12:01:31.390625 7488 start.go:125] createHost starting for "" (driver="docker")
I0114 12:01:31.396595 7488 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...
I0114 12:01:31.396595 7488 start.go:159] libmachine.API.Create for "cilium-114511" (driver="docker")
I0114 12:01:31.396595 7488 client.go:168] LocalClient.Create starting
I0114 12:01:31.396595 7488 main.go:134] libmachine: Reading certificate data from C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca.pem
I0114 12:01:31.397583 7488 main.go:134] libmachine: Decoding PEM data...
I0114 12:01:31.397583 7488 main.go:134] libmachine: Parsing certificate...
I0114 12:01:31.397583 7488 main.go:134] libmachine: Reading certificate data from C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\cert.pem
I0114 12:01:31.397583 7488 main.go:134] libmachine: Decoding PEM data...
I0114 12:01:31.397583 7488 main.go:134] libmachine: Parsing certificate...
I0114 12:01:31.405586 7488 cli_runner.go:164] Run: docker network inspect cilium-114511 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0114 12:01:31.595949 7488 cli_runner.go:211] docker network inspect cilium-114511 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0114 12:01:31.605607 7488 network_create.go:280] running [docker network inspect cilium-114511] to gather additional debugging logs...
I0114 12:01:31.605607 7488 cli_runner.go:164] Run: docker network inspect cilium-114511
W0114 12:01:31.805133 7488 cli_runner.go:211] docker network inspect cilium-114511 returned with exit code 1
I0114 12:01:31.805133 7488 network_create.go:283] error running [docker network inspect cilium-114511]: docker network inspect cilium-114511: exit status 1
stdout:
[]
stderr:
Error: No such network: cilium-114511
I0114 12:01:31.805133 7488 network_create.go:285] output of [docker network inspect cilium-114511]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: cilium-114511
** /stderr **
I0114 12:01:31.811721 7488 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0114 12:01:32.032155 7488 network.go:277] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc000ab2a80] misses:0}
I0114 12:01:32.032155 7488 network.go:210] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0114 12:01:32.032155 7488 network_create.go:123] attempt to create docker network cilium-114511 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0114 12:01:32.041155 7488 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=cilium-114511 cilium-114511
W0114 12:01:32.229874 7488 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=cilium-114511 cilium-114511 returned with exit code 1
W0114 12:01:32.229968 7488 network_create.go:115] failed to create docker network cilium-114511 192.168.49.0/24, will retry: subnet is taken
I0114 12:01:32.249936 7488 network.go:268] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000ab2a80] amended:false}} dirty:map[] misses:0}
I0114 12:01:32.249936 7488 network.go:213] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0114 12:01:32.269980 7488 network.go:277] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000ab2a80] amended:true}} dirty:map[192.168.49.0:0xc000ab2a80 192.168.58.0:0xc0005d0110] misses:0}
I0114 12:01:32.269980 7488 network.go:210] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0114 12:01:32.269980 7488 network_create.go:123] attempt to create docker network cilium-114511 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I0114 12:01:32.277984 7488 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=cilium-114511 cilium-114511
W0114 12:01:32.507458 7488 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=cilium-114511 cilium-114511 returned with exit code 1
W0114 12:01:32.507707 7488 network_create.go:115] failed to create docker network cilium-114511 192.168.58.0/24, will retry: subnet is taken
I0114 12:01:32.529174 7488 network.go:268] skipping subnet 192.168.58.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000ab2a80] amended:true}} dirty:map[192.168.49.0:0xc000ab2a80 192.168.58.0:0xc0005d0110] misses:1}
I0114 12:01:32.529174 7488 network.go:213] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0114 12:01:32.548980 7488 network.go:277] reserving subnet 192.168.67.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000ab2a80] amended:true}} dirty:map[192.168.49.0:0xc000ab2a80 192.168.58.0:0xc0005d0110 192.168.67.0:0xc000ab2b18] misses:1}
I0114 12:01:32.548980 7488 network.go:210] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0114 12:01:32.548980 7488 network_create.go:123] attempt to create docker network cilium-114511 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I0114 12:01:32.556840 7488 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=cilium-114511 cilium-114511
W0114 12:01:32.785256 7488 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=cilium-114511 cilium-114511 returned with exit code 1
W0114 12:01:32.785323 7488 network_create.go:115] failed to create docker network cilium-114511 192.168.67.0/24, will retry: subnet is taken
I0114 12:01:32.805195 7488 network.go:268] skipping subnet 192.168.67.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000ab2a80] amended:true}} dirty:map[192.168.49.0:0xc000ab2a80 192.168.58.0:0xc0005d0110 192.168.67.0:0xc000ab2b18] misses:2}
I0114 12:01:32.805195 7488 network.go:213] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0114 12:01:32.826868 7488 network.go:277] reserving subnet 192.168.76.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000ab2a80] amended:true}} dirty:map[192.168.49.0:0xc000ab2a80 192.168.58.0:0xc0005d0110 192.168.67.0:0xc000ab2b18 192.168.76.0:0xc0005d01e8] misses:2}
I0114 12:01:32.827496 7488 network.go:210] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0114 12:01:32.827496 7488 network_create.go:123] attempt to create docker network cilium-114511 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0114 12:01:32.835994 7488 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=cilium-114511 cilium-114511
W0114 12:01:33.049611 7488 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=cilium-114511 cilium-114511 returned with exit code 1
W0114 12:01:33.049611 7488 network_create.go:115] failed to create docker network cilium-114511 192.168.76.0/24, will retry: subnet is taken
I0114 12:01:33.070296 7488 network.go:268] skipping subnet 192.168.76.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000ab2a80] amended:true}} dirty:map[192.168.49.0:0xc000ab2a80 192.168.58.0:0xc0005d0110 192.168.67.0:0xc000ab2b18 192.168.76.0:0xc0005d01e8] misses:3}
I0114 12:01:33.070296 7488 network.go:213] skipping subnet 192.168.76.0/24 that is reserved: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0114 12:01:33.092293 7488 network.go:277] reserving subnet 192.168.85.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000ab2a80] amended:true}} dirty:map[192.168.49.0:0xc000ab2a80 192.168.58.0:0xc0005d0110 192.168.67.0:0xc000ab2b18 192.168.76.0:0xc0005d01e8 192.168.85.0:0xc0001acbe8] misses:3}
I0114 12:01:33.093073 7488 network.go:210] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0114 12:01:33.093073 7488 network_create.go:123] attempt to create docker network cilium-114511 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I0114 12:01:33.101698 7488 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=cilium-114511 cilium-114511
W0114 12:01:33.314072 7488 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=cilium-114511 cilium-114511 returned with exit code 1
W0114 12:01:33.314072 7488 network_create.go:115] failed to create docker network cilium-114511 192.168.85.0/24, will retry: subnet is taken
W0114 12:01:33.316210 7488 out.go:239] ! Unable to create dedicated network, this might result in cluster IP change after restart: failed to create docker network cilium-114511: subnet is taken
! Unable to create dedicated network, this might result in cluster IP change after restart: failed to create docker network cilium-114511: subnet is taken
I0114 12:01:33.329064 7488 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0114 12:01:33.564819 7488 cli_runner.go:164] Run: docker volume create cilium-114511 --label name.minikube.sigs.k8s.io=cilium-114511 --label created_by.minikube.sigs.k8s.io=true
I0114 12:01:33.773262 7488 oci.go:103] Successfully created a docker volume cilium-114511
I0114 12:01:33.780626 7488 cli_runner.go:164] Run: docker run --rm --name cilium-114511-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-114511 --entrypoint /usr/bin/test -v cilium-114511:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1668787669-15272@sha256:06094fc04b5dc02fbf1e2de7723c2a6db5d24c21fd2ddda91f6daaf29038cd9c -d /var/lib
I0114 12:01:37.588733 7488 cli_runner.go:217] Completed: docker run --rm --name cilium-114511-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-114511 --entrypoint /usr/bin/test -v cilium-114511:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1668787669-15272@sha256:06094fc04b5dc02fbf1e2de7723c2a6db5d24c21fd2ddda91f6daaf29038cd9c -d /var/lib: (3.8080675s)
I0114 12:01:37.588733 7488 oci.go:107] Successfully prepared a docker volume cilium-114511
I0114 12:01:37.588733 7488 preload.go:132] Checking if preload exists for k8s version v1.25.3 and runtime docker
I0114 12:01:37.588733 7488 kic.go:190] Starting extracting preloaded images to volume ...
I0114 12:01:37.595723 7488 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.25.3-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v cilium-114511:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1668787669-15272@sha256:06094fc04b5dc02fbf1e2de7723c2a6db5d24c21fd2ddda91f6daaf29038cd9c -I lz4 -xf /preloaded.tar -C /extractDir
I0114 12:02:04.145304 7488 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.25.3-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v cilium-114511:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1668787669-15272@sha256:06094fc04b5dc02fbf1e2de7723c2a6db5d24c21fd2ddda91f6daaf29038cd9c -I lz4 -xf /preloaded.tar -C /extractDir: (26.5489964s)
I0114 12:02:04.145356 7488 kic.go:199] duration metric: took 26.556347 seconds to extract preloaded images to volume
I0114 12:02:04.158731 7488 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0114 12:02:04.778607 7488 info.go:266] docker info: {ID:3UBZ:WVUB:HLKZ:K7PJ:5MPF:INSH:AFXZ:DVGD:NGYR:ZXOC:2S5U:CWJN Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:72 OomKillDisable:true NGoroutines:58 SystemTime:2023-01-14 12:02:04.311126 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_
64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.21 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:1c90a442489720eec95342e1789ee8a5e1b9536f Expected:1c90a442489720eec95342e1789ee8a5e1b9536f} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,
profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.9.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.12.2] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.3] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.13] map[Name:sbom Path:C:\Program Files\Docker\cli-plugi
ns\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.21.0]] Warnings:<nil>}}
I0114 12:02:04.789217 7488 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0114 12:02:05.489782 7488 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname cilium-114511 --name cilium-114511 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-114511 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=cilium-114511 --volume cilium-114511:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1668787669-15272@sha256:06094fc04b5dc02fbf1e2de7723c2a6db5d24c21fd2ddda91f6daaf29038cd9c
I0114 12:02:06.902443 7488 cli_runner.go:217] Completed: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname cilium-114511 --name cilium-114511 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-114511 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=cilium-114511 --volume cilium-114511:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1668787669-15272@sha256:06094fc04b5dc02fbf1e2de7723c2a6db5d24c21fd2ddda91f6daaf29038cd9c: (1.4125816s)
I0114 12:02:06.911436 7488 cli_runner.go:164] Run: docker container inspect cilium-114511 --format={{.State.Running}}
I0114 12:02:07.167048 7488 cli_runner.go:164] Run: docker container inspect cilium-114511 --format={{.State.Status}}
I0114 12:02:07.421517 7488 cli_runner.go:164] Run: docker exec cilium-114511 stat /var/lib/dpkg/alternatives/iptables
I0114 12:02:07.870326 7488 oci.go:144] the created container "cilium-114511" has a running status.
I0114 12:02:07.870326 7488 kic.go:221] Creating ssh key for kic: C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\cilium-114511\id_rsa...
I0114 12:02:08.093422 7488 kic_runner.go:191] docker (temp): C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\cilium-114511\id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0114 12:02:08.464198 7488 cli_runner.go:164] Run: docker container inspect cilium-114511 --format={{.State.Status}}
I0114 12:02:08.717469 7488 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0114 12:02:08.717469 7488 kic_runner.go:114] Args: [docker exec --privileged cilium-114511 chown docker:docker /home/docker/.ssh/authorized_keys]
I0114 12:02:09.079715 7488 kic.go:261] ensuring only current user has permissions to key file located at : C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\cilium-114511\id_rsa...
I0114 12:02:09.697527 7488 cli_runner.go:164] Run: docker container inspect cilium-114511 --format={{.State.Status}}
I0114 12:02:09.917777 7488 machine.go:88] provisioning docker machine ...
I0114 12:02:09.917777 7488 ubuntu.go:169] provisioning hostname "cilium-114511"
I0114 12:02:09.924764 7488 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-114511
I0114 12:02:10.143768 7488 main.go:134] libmachine: Using SSH client type: native
I0114 12:02:10.151757 7488 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x68fea0] 0x692e20 <nil> [] 0s} 127.0.0.1 50116 <nil> <nil>}
I0114 12:02:10.151757 7488 main.go:134] libmachine: About to run SSH command:
sudo hostname cilium-114511 && echo "cilium-114511" | sudo tee /etc/hostname
I0114 12:02:10.299771 7488 main.go:134] libmachine: SSH cmd err, output: <nil>: cilium-114511
I0114 12:02:10.306792 7488 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-114511
I0114 12:02:10.509201 7488 main.go:134] libmachine: Using SSH client type: native
I0114 12:02:10.510204 7488 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x68fea0] 0x692e20 <nil> [] 0s} 127.0.0.1 50116 <nil> <nil>}
I0114 12:02:10.510204 7488 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\scilium-114511' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 cilium-114511/g' /etc/hosts;
else
echo '127.0.1.1 cilium-114511' | sudo tee -a /etc/hosts;
fi
fi
I0114 12:02:10.694211 7488 main.go:134] libmachine: SSH cmd err, output: <nil>:
I0114 12:02:10.694211 7488 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube2\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube2\minikube-integration\.minikube}
I0114 12:02:10.694211 7488 ubuntu.go:177] setting up certificates
I0114 12:02:10.694211 7488 provision.go:83] configureAuth start
I0114 12:02:10.705207 7488 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cilium-114511
I0114 12:02:10.932222 7488 provision.go:138] copyHostCerts
I0114 12:02:10.932889 7488 exec_runner.go:144] found C:\Users\jenkins.minikube2\minikube-integration\.minikube/ca.pem, removing ...
I0114 12:02:10.933065 7488 exec_runner.go:207] rm: C:\Users\jenkins.minikube2\minikube-integration\.minikube\ca.pem
I0114 12:02:10.933629 7488 exec_runner.go:151] cp: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube2\minikube-integration\.minikube/ca.pem (1078 bytes)
I0114 12:02:10.935136 7488 exec_runner.go:144] found C:\Users\jenkins.minikube2\minikube-integration\.minikube/cert.pem, removing ...
I0114 12:02:10.935136 7488 exec_runner.go:207] rm: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cert.pem
I0114 12:02:10.935483 7488 exec_runner.go:151] cp: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube2\minikube-integration\.minikube/cert.pem (1123 bytes)
I0114 12:02:10.936862 7488 exec_runner.go:144] found C:\Users\jenkins.minikube2\minikube-integration\.minikube/key.pem, removing ...
I0114 12:02:10.936862 7488 exec_runner.go:207] rm: C:\Users\jenkins.minikube2\minikube-integration\.minikube\key.pem
I0114 12:02:10.937468 7488 exec_runner.go:151] cp: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube2\minikube-integration\.minikube/key.pem (1675 bytes)
I0114 12:02:10.938807 7488 provision.go:112] generating server cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.cilium-114511 san=[172.17.0.2 127.0.0.1 localhost 127.0.0.1 minikube cilium-114511]
I0114 12:02:11.083710 7488 provision.go:172] copyRemoteCerts
I0114 12:02:11.094861 7488 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0114 12:02:11.101619 7488 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-114511
I0114 12:02:11.329368 7488 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50116 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\cilium-114511\id_rsa Username:docker}
I0114 12:02:11.412516 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1216 bytes)
I0114 12:02:11.466522 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0114 12:02:11.513527 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0114 12:02:11.581129 7488 provision.go:86] duration metric: configureAuth took 886.9087ms
I0114 12:02:11.581248 7488 ubuntu.go:193] setting minikube options for container-runtime
I0114 12:02:11.581386 7488 config.go:180] Loaded profile config "cilium-114511": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.25.3
I0114 12:02:11.592010 7488 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-114511
I0114 12:02:11.807173 7488 main.go:134] libmachine: Using SSH client type: native
I0114 12:02:11.808170 7488 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x68fea0] 0x692e20 <nil> [] 0s} 127.0.0.1 50116 <nil> <nil>}
I0114 12:02:11.808170 7488 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0114 12:02:11.986828 7488 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I0114 12:02:11.986828 7488 ubuntu.go:71] root file system type: overlay
I0114 12:02:11.987820 7488 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0114 12:02:11.996821 7488 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-114511
I0114 12:02:12.218913 7488 main.go:134] libmachine: Using SSH client type: native
I0114 12:02:12.218913 7488 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x68fea0] 0x692e20 <nil> [] 0s} 127.0.0.1 50116 <nil> <nil>}
I0114 12:02:12.218913 7488 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0114 12:02:12.446858 7488 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0114 12:02:12.454857 7488 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-114511
I0114 12:02:12.676306 7488 main.go:134] libmachine: Using SSH client type: native
I0114 12:02:12.676306 7488 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x68fea0] 0x692e20 <nil> [] 0s} 127.0.0.1 50116 <nil> <nil>}
I0114 12:02:12.676306 7488 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0114 12:02:14.155886 7488 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-10-25 18:00:04.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2023-01-14 12:02:12.423937000 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0114 12:02:14.155886 7488 machine.go:91] provisioned docker machine in 4.2380649s
I0114 12:02:14.155886 7488 client.go:171] LocalClient.Create took 42.7588465s
I0114 12:02:14.155886 7488 start.go:167] duration metric: libmachine.API.Create for "cilium-114511" took 42.7588465s
I0114 12:02:14.155886 7488 start.go:300] post-start starting for "cilium-114511" (driver="docker")
I0114 12:02:14.155886 7488 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0114 12:02:14.170804 7488 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0114 12:02:14.177805 7488 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-114511
I0114 12:02:14.367318 7488 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50116 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\cilium-114511\id_rsa Username:docker}
I0114 12:02:14.530547 7488 ssh_runner.go:195] Run: cat /etc/os-release
I0114 12:02:14.540560 7488 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0114 12:02:14.540560 7488 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0114 12:02:14.540560 7488 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0114 12:02:14.540560 7488 info.go:137] Remote host: Ubuntu 20.04.5 LTS
I0114 12:02:14.540560 7488 filesync.go:126] Scanning C:\Users\jenkins.minikube2\minikube-integration\.minikube\addons for local assets ...
I0114 12:02:14.540560 7488 filesync.go:126] Scanning C:\Users\jenkins.minikube2\minikube-integration\.minikube\files for local assets ...
I0114 12:02:14.541548 7488 filesync.go:149] local asset: C:\Users\jenkins.minikube2\minikube-integration\.minikube\files\etc\ssl\certs\99682.pem -> 99682.pem in /etc/ssl/certs
I0114 12:02:14.556555 7488 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0114 12:02:14.580551 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\files\etc\ssl\certs\99682.pem --> /etc/ssl/certs/99682.pem (1708 bytes)
I0114 12:02:14.635910 7488 start.go:303] post-start completed in 480.0183ms
I0114 12:02:14.648846 7488 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cilium-114511
I0114 12:02:14.865627 7488 profile.go:148] Saving config to C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\config.json ...
I0114 12:02:14.888774 7488 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0114 12:02:14.903975 7488 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-114511
I0114 12:02:15.100472 7488 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50116 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\cilium-114511\id_rsa Username:docker}
I0114 12:02:15.255252 7488 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0114 12:02:15.267272 7488 start.go:128] duration metric: createHost completed in 43.8752411s
I0114 12:02:15.267272 7488 start.go:83] releasing machines lock for "cilium-114511", held for 43.8761903s
I0114 12:02:15.275258 7488 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cilium-114511
I0114 12:02:15.483191 7488 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0114 12:02:15.495622 7488 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-114511
I0114 12:02:15.496243 7488 ssh_runner.go:195] Run: cat /version.json
I0114 12:02:15.504930 7488 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-114511
I0114 12:02:15.715670 7488 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50116 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\cilium-114511\id_rsa Username:docker}
I0114 12:02:15.731231 7488 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50116 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\cilium-114511\id_rsa Username:docker}
I0114 12:02:15.799526 7488 ssh_runner.go:195] Run: systemctl --version
I0114 12:02:15.907569 7488 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0114 12:02:15.933665 7488 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (233 bytes)
I0114 12:02:15.983271 7488 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0114 12:02:16.169721 7488 ssh_runner.go:195] Run: sudo systemctl restart cri-docker
I0114 12:02:16.389862 7488 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0114 12:02:16.413871 7488 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0114 12:02:16.422907 7488 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0114 12:02:16.449147 7488 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
image-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0114 12:02:16.512217 7488 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0114 12:02:16.699670 7488 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0114 12:02:16.898295 7488 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0114 12:02:17.079444 7488 ssh_runner.go:195] Run: sudo systemctl restart docker
I0114 12:02:17.741034 7488 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0114 12:02:17.939318 7488 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0114 12:02:18.148710 7488 ssh_runner.go:195] Run: sudo systemctl start cri-docker.socket
I0114 12:02:18.179745 7488 start.go:451] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0114 12:02:18.194774 7488 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0114 12:02:18.213548 7488 start.go:472] Will wait 60s for crictl version
I0114 12:02:18.223091 7488 ssh_runner.go:195] Run: which crictl
I0114 12:02:18.250089 7488 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0114 12:02:18.332774 7488 start.go:488] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 20.10.21
RuntimeApiVersion: 1.41.0
I0114 12:02:18.341850 7488 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0114 12:02:18.427131 7488 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0114 12:02:18.501134 7488 out.go:204] * Preparing Kubernetes v1.25.3 on Docker 20.10.21 ...
I0114 12:02:18.509133 7488 cli_runner.go:164] Run: docker exec -t cilium-114511 dig +short host.docker.internal
I0114 12:02:18.838656 7488 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0114 12:02:18.847638 7488 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0114 12:02:18.859652 7488 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0114 12:02:18.904463 7488 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" cilium-114511
I0114 12:02:19.122457 7488 preload.go:132] Checking if preload exists for k8s version v1.25.3 and runtime docker
I0114 12:02:19.131456 7488 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0114 12:02:19.191053 7488 docker.go:613] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.25.3
registry.k8s.io/kube-controller-manager:v1.25.3
registry.k8s.io/kube-scheduler:v1.25.3
registry.k8s.io/kube-proxy:v1.25.3
registry.k8s.io/pause:3.8
registry.k8s.io/etcd:3.5.4-0
registry.k8s.io/coredns/coredns:v1.9.3
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0114 12:02:19.191053 7488 docker.go:543] Images already preloaded, skipping extraction
I0114 12:02:19.198059 7488 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0114 12:02:19.267695 7488 docker.go:613] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.25.3
registry.k8s.io/kube-controller-manager:v1.25.3
registry.k8s.io/kube-scheduler:v1.25.3
registry.k8s.io/kube-proxy:v1.25.3
registry.k8s.io/pause:3.8
registry.k8s.io/etcd:3.5.4-0
registry.k8s.io/coredns/coredns:v1.9.3
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0114 12:02:19.267695 7488 cache_images.go:84] Images are preloaded, skipping loading
I0114 12:02:19.276707 7488 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0114 12:02:19.431509 7488 cni.go:95] Creating CNI manager for "cilium"
I0114 12:02:19.432099 7488 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0114 12:02:19.432099 7488 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:172.17.0.2 APIServerPort:8443 KubernetesVersion:v1.25.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:cilium-114511 NodeName:cilium-114511 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "172.17.0.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:172.17.0.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/
manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[]}
I0114 12:02:19.432394 7488 kubeadm.go:163] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 172.17.0.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/cri-dockerd.sock
name: "cilium-114511"
kubeletExtraArgs:
node-ip: 172.17.0.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "172.17.0.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.25.3
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0114 12:02:19.432558 7488 kubeadm.go:962] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.25.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=/var/run/cri-dockerd.sock --hostname-override=cilium-114511 --image-service-endpoint=/var/run/cri-dockerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=172.17.0.2 --runtime-request-timeout=15m
[Install]
config:
{KubernetesVersion:v1.25.3 ClusterName:cilium-114511 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium NodeIP: NodePort:8443 NodeName:}
I0114 12:02:19.444767 7488 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.25.3
I0114 12:02:19.465760 7488 binaries.go:44] Found k8s binaries, skipping transfer
I0114 12:02:19.474767 7488 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0114 12:02:19.497386 7488 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (473 bytes)
I0114 12:02:19.530379 7488 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0114 12:02:19.567432 7488 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2030 bytes)
I0114 12:02:19.622395 7488 ssh_runner.go:195] Run: grep 172.17.0.2 control-plane.minikube.internal$ /etc/hosts
I0114 12:02:19.635388 7488 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "172.17.0.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0114 12:02:19.674405 7488 certs.go:54] Setting up C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511 for IP: 172.17.0.2
I0114 12:02:19.674405 7488 certs.go:182] skipping minikubeCA CA generation: C:\Users\jenkins.minikube2\minikube-integration\.minikube\ca.key
I0114 12:02:19.674405 7488 certs.go:182] skipping proxyClientCA CA generation: C:\Users\jenkins.minikube2\minikube-integration\.minikube\proxy-client-ca.key
I0114 12:02:19.676426 7488 certs.go:302] generating minikube-user signed cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\client.key
I0114 12:02:19.676426 7488 crypto.go:68] Generating cert C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\client.crt with IP's: []
I0114 12:02:19.841431 7488 crypto.go:156] Writing cert to C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\client.crt ...
I0114 12:02:19.841431 7488 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\client.crt: {Name:mkaf8e80072c92404ac4518f27a424772b3a6c0f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0114 12:02:19.842389 7488 crypto.go:164] Writing key to C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\client.key ...
I0114 12:02:19.842389 7488 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\client.key: {Name:mk0fa9f221ab96d6597b33b378ce1f54a0d7c3bd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0114 12:02:19.844415 7488 certs.go:302] generating minikube signed cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\apiserver.key.7b749c5f
I0114 12:02:19.844415 7488 crypto.go:68] Generating cert C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\apiserver.crt.7b749c5f with IP's: [172.17.0.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0114 12:02:20.080391 7488 crypto.go:156] Writing cert to C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\apiserver.crt.7b749c5f ...
I0114 12:02:20.080391 7488 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\apiserver.crt.7b749c5f: {Name:mkcfdfafe50e0693af235eddcaa75499bd4a5486 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0114 12:02:20.081073 7488 crypto.go:164] Writing key to C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\apiserver.key.7b749c5f ...
I0114 12:02:20.082065 7488 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\apiserver.key.7b749c5f: {Name:mk9a4b762609fa41ab9b602e20bb8585f9750cd1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0114 12:02:20.082733 7488 certs.go:320] copying C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\apiserver.crt.7b749c5f -> C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\apiserver.crt
I0114 12:02:20.089763 7488 certs.go:324] copying C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\apiserver.key.7b749c5f -> C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\apiserver.key
I0114 12:02:20.090752 7488 certs.go:302] generating aggregator signed cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\proxy-client.key
I0114 12:02:20.090752 7488 crypto.go:68] Generating cert C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\proxy-client.crt with IP's: []
I0114 12:02:20.262296 7488 crypto.go:156] Writing cert to C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\proxy-client.crt ...
I0114 12:02:20.262296 7488 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\proxy-client.crt: {Name:mk99ec9cfa6b4205d420bcfc93eab37ba41e00e9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0114 12:02:20.263935 7488 crypto.go:164] Writing key to C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\proxy-client.key ...
I0114 12:02:20.263935 7488 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\proxy-client.key: {Name:mka9b0980e4714e3c624fdf43d01b72e175120d4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0114 12:02:20.271694 7488 certs.go:388] found cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\9968.pem (1338 bytes)
W0114 12:02:20.272941 7488 certs.go:384] ignoring C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\9968_empty.pem, impossibly tiny 0 bytes
I0114 12:02:20.272941 7488 certs.go:388] found cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca-key.pem (1675 bytes)
I0114 12:02:20.273192 7488 certs.go:388] found cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca.pem (1078 bytes)
I0114 12:02:20.273450 7488 certs.go:388] found cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\cert.pem (1123 bytes)
I0114 12:02:20.273668 7488 certs.go:388] found cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\key.pem (1675 bytes)
I0114 12:02:20.273876 7488 certs.go:388] found cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins.minikube2\minikube-integration\.minikube\files\etc\ssl\certs\99682.pem (1708 bytes)
I0114 12:02:20.275436 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0114 12:02:20.332779 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0114 12:02:20.397113 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0114 12:02:20.447734 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\cilium-114511\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0114 12:02:20.505205 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0114 12:02:20.559017 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0114 12:02:20.626489 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0114 12:02:20.679075 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0114 12:02:20.734472 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\files\etc\ssl\certs\99682.pem --> /usr/share/ca-certificates/99682.pem (1708 bytes)
I0114 12:02:20.788816 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0114 12:02:20.839908 7488 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\9968.pem --> /usr/share/ca-certificates/9968.pem (1338 bytes)
I0114 12:02:20.893814 7488 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0114 12:02:20.939672 7488 ssh_runner.go:195] Run: openssl version
I0114 12:02:20.963680 7488 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/99682.pem && ln -fs /usr/share/ca-certificates/99682.pem /etc/ssl/certs/99682.pem"
I0114 12:02:21.006219 7488 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/99682.pem
I0114 12:02:21.018218 7488 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jan 14 10:21 /usr/share/ca-certificates/99682.pem
I0114 12:02:21.027222 7488 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/99682.pem
I0114 12:02:21.067944 7488 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/99682.pem /etc/ssl/certs/3ec20f2e.0"
I0114 12:02:21.098944 7488 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0114 12:02:21.131991 7488 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0114 12:02:21.141948 7488 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jan 14 10:11 /usr/share/ca-certificates/minikubeCA.pem
I0114 12:02:21.159992 7488 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0114 12:02:21.182979 7488 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0114 12:02:21.222107 7488 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9968.pem && ln -fs /usr/share/ca-certificates/9968.pem /etc/ssl/certs/9968.pem"
I0114 12:02:21.258097 7488 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9968.pem
I0114 12:02:21.269083 7488 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jan 14 10:21 /usr/share/ca-certificates/9968.pem
I0114 12:02:21.279082 7488 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9968.pem
I0114 12:02:21.299095 7488 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/9968.pem /etc/ssl/certs/51391683.0"
I0114 12:02:21.322086 7488 kubeadm.go:396] StartCluster: {Name:cilium-114511 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1668787669-15272@sha256:06094fc04b5dc02fbf1e2de7723c2a6db5d24c21fd2ddda91f6daaf29038cd9c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.25.3 ClusterName:cilium-114511 Namespace:default APIServerName:minikubeCA APIServerNames:[] APISe
rverIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:172.17.0.2 Port:8443 KubernetesVersion:v1.25.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube2:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:f
alse DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}
I0114 12:02:21.329157 7488 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0114 12:02:21.395553 7488 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0114 12:02:21.435236 7488 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0114 12:02:21.456334 7488 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0114 12:02:21.467348 7488 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0114 12:02:21.489349 7488 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0114 12:02:21.489349 7488 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.25.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0114 12:02:21.579715 7488 kubeadm.go:317] W0114 12:02:21.576664 1236 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0114 12:02:21.666231 7488 kubeadm.go:317] [WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet
I0114 12:02:21.844066 7488 kubeadm.go:317] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0114 12:02:46.275276 7488 kubeadm.go:317] [init] Using Kubernetes version: v1.25.3
I0114 12:02:46.275276 7488 kubeadm.go:317] [preflight] Running pre-flight checks
I0114 12:02:46.275276 7488 kubeadm.go:317] [preflight] Pulling images required for setting up a Kubernetes cluster
I0114 12:02:46.276549 7488 kubeadm.go:317] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0114 12:02:46.276549 7488 kubeadm.go:317] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0114 12:02:46.276549 7488 kubeadm.go:317] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0114 12:02:46.279970 7488 out.go:204] - Generating certificates and keys ...
I0114 12:02:46.279970 7488 kubeadm.go:317] [certs] Using existing ca certificate authority
I0114 12:02:46.280650 7488 kubeadm.go:317] [certs] Using existing apiserver certificate and key on disk
I0114 12:02:46.280650 7488 kubeadm.go:317] [certs] Generating "apiserver-kubelet-client" certificate and key
I0114 12:02:46.280650 7488 kubeadm.go:317] [certs] Generating "front-proxy-ca" certificate and key
I0114 12:02:46.280650 7488 kubeadm.go:317] [certs] Generating "front-proxy-client" certificate and key
I0114 12:02:46.280650 7488 kubeadm.go:317] [certs] Generating "etcd/ca" certificate and key
I0114 12:02:46.281663 7488 kubeadm.go:317] [certs] Generating "etcd/server" certificate and key
I0114 12:02:46.282674 7488 kubeadm.go:317] [certs] etcd/server serving cert is signed for DNS names [cilium-114511 localhost] and IPs [172.17.0.2 127.0.0.1 ::1]
I0114 12:02:46.282674 7488 kubeadm.go:317] [certs] Generating "etcd/peer" certificate and key
I0114 12:02:46.282674 7488 kubeadm.go:317] [certs] etcd/peer serving cert is signed for DNS names [cilium-114511 localhost] and IPs [172.17.0.2 127.0.0.1 ::1]
I0114 12:02:46.282674 7488 kubeadm.go:317] [certs] Generating "etcd/healthcheck-client" certificate and key
I0114 12:02:46.282674 7488 kubeadm.go:317] [certs] Generating "apiserver-etcd-client" certificate and key
I0114 12:02:46.283633 7488 kubeadm.go:317] [certs] Generating "sa" key and public key
I0114 12:02:46.283633 7488 kubeadm.go:317] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0114 12:02:46.283633 7488 kubeadm.go:317] [kubeconfig] Writing "admin.conf" kubeconfig file
I0114 12:02:46.283633 7488 kubeadm.go:317] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0114 12:02:46.283633 7488 kubeadm.go:317] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0114 12:02:46.284519 7488 kubeadm.go:317] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0114 12:02:46.284909 7488 kubeadm.go:317] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0114 12:02:46.284909 7488 kubeadm.go:317] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0114 12:02:46.284909 7488 kubeadm.go:317] [kubelet-start] Starting the kubelet
I0114 12:02:46.285564 7488 kubeadm.go:317] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0114 12:02:46.288641 7488 out.go:204] - Booting up control plane ...
I0114 12:02:46.288726 7488 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0114 12:02:46.288726 7488 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0114 12:02:46.289273 7488 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0114 12:02:46.289561 7488 kubeadm.go:317] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0114 12:02:46.290350 7488 kubeadm.go:317] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0114 12:02:46.290350 7488 kubeadm.go:317] [apiclient] All control plane components are healthy after 18.006771 seconds
I0114 12:02:46.290350 7488 kubeadm.go:317] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0114 12:02:46.291249 7488 kubeadm.go:317] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0114 12:02:46.291249 7488 kubeadm.go:317] [upload-certs] Skipping phase. Please see --upload-certs
I0114 12:02:46.291974 7488 kubeadm.go:317] [mark-control-plane] Marking the node cilium-114511 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0114 12:02:46.291974 7488 kubeadm.go:317] [bootstrap-token] Using token: ea1krx.mfvgb6kvn0irxfze
I0114 12:02:46.295152 7488 out.go:204] - Configuring RBAC rules ...
I0114 12:02:46.295487 7488 kubeadm.go:317] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0114 12:02:46.295668 7488 kubeadm.go:317] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0114 12:02:46.295886 7488 kubeadm.go:317] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0114 12:02:46.296214 7488 kubeadm.go:317] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0114 12:02:46.296464 7488 kubeadm.go:317] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0114 12:02:46.296464 7488 kubeadm.go:317] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0114 12:02:46.296464 7488 kubeadm.go:317] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0114 12:02:46.297109 7488 kubeadm.go:317] [addons] Applied essential addon: CoreDNS
I0114 12:02:46.297109 7488 kubeadm.go:317] [addons] Applied essential addon: kube-proxy
I0114 12:02:46.297109 7488 kubeadm.go:317]
I0114 12:02:46.297109 7488 kubeadm.go:317] Your Kubernetes control-plane has initialized successfully!
I0114 12:02:46.297109 7488 kubeadm.go:317]
I0114 12:02:46.297109 7488 kubeadm.go:317] To start using your cluster, you need to run the following as a regular user:
I0114 12:02:46.297109 7488 kubeadm.go:317]
I0114 12:02:46.297699 7488 kubeadm.go:317] mkdir -p $HOME/.kube
I0114 12:02:46.297699 7488 kubeadm.go:317] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0114 12:02:46.297699 7488 kubeadm.go:317] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0114 12:02:46.297699 7488 kubeadm.go:317]
I0114 12:02:46.297699 7488 kubeadm.go:317] Alternatively, if you are the root user, you can run:
I0114 12:02:46.297699 7488 kubeadm.go:317]
I0114 12:02:46.298485 7488 kubeadm.go:317] export KUBECONFIG=/etc/kubernetes/admin.conf
I0114 12:02:46.298561 7488 kubeadm.go:317]
I0114 12:02:46.298608 7488 kubeadm.go:317] You should now deploy a pod network to the cluster.
I0114 12:02:46.298608 7488 kubeadm.go:317] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0114 12:02:46.298608 7488 kubeadm.go:317] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0114 12:02:46.298608 7488 kubeadm.go:317]
I0114 12:02:46.298608 7488 kubeadm.go:317] You can now join any number of control-plane nodes by copying certificate authorities
I0114 12:02:46.299430 7488 kubeadm.go:317] and service account keys on each node and then running the following as root:
I0114 12:02:46.299430 7488 kubeadm.go:317]
I0114 12:02:46.299430 7488 kubeadm.go:317] kubeadm join control-plane.minikube.internal:8443 --token ea1krx.mfvgb6kvn0irxfze \
I0114 12:02:46.299958 7488 kubeadm.go:317] --discovery-token-ca-cert-hash sha256:d4abf46d00e7a9b2779f6d5264f268d71e7682a3ed209a13fd506918ad0491d1 \
I0114 12:02:46.300061 7488 kubeadm.go:317] --control-plane
I0114 12:02:46.300061 7488 kubeadm.go:317]
I0114 12:02:46.300192 7488 kubeadm.go:317] Then you can join any number of worker nodes by running the following on each as root:
I0114 12:02:46.300192 7488 kubeadm.go:317]
I0114 12:02:46.300192 7488 kubeadm.go:317] kubeadm join control-plane.minikube.internal:8443 --token ea1krx.mfvgb6kvn0irxfze \
I0114 12:02:46.300948 7488 kubeadm.go:317] --discovery-token-ca-cert-hash sha256:d4abf46d00e7a9b2779f6d5264f268d71e7682a3ed209a13fd506918ad0491d1
I0114 12:02:46.301016 7488 cni.go:95] Creating CNI manager for "cilium"
I0114 12:02:46.303165 7488 out.go:177] * Configuring Cilium (Container Networking Interface) ...
I0114 12:02:46.319491 7488 ssh_runner.go:195] Run: sudo /bin/bash -c "grep 'bpffs /sys/fs/bpf' /proc/mounts || sudo mount bpffs -t bpf /sys/fs/bpf"
I0114 12:02:46.452800 7488 cilium.go:832] Using pod CIDR: 10.244.0.0/16
I0114 12:02:46.452800 7488 cilium.go:843] cilium options: {PodSubnet:10.244.0.0/16}
I0114 12:02:46.452800 7488 cilium.go:847] cilium config:
---
# Source: cilium/templates/cilium-agent-serviceaccount.yaml
apiVersion: v1
kind: ServiceAccount
metadata:
name: cilium
namespace: kube-system
---
# Source: cilium/templates/cilium-operator-serviceaccount.yaml
apiVersion: v1
kind: ServiceAccount
metadata:
name: cilium-operator
namespace: kube-system
---
# Source: cilium/templates/cilium-configmap.yaml
apiVersion: v1
kind: ConfigMap
metadata:
name: cilium-config
namespace: kube-system
data:
# Identity allocation mode selects how identities are shared between cilium
# nodes by setting how they are stored. The options are "crd" or "kvstore".
# - "crd" stores identities in kubernetes as CRDs (custom resource definition).
# These can be queried with:
# kubectl get ciliumid
# - "kvstore" stores identities in a kvstore, etcd or consul, that is
# configured below. Cilium versions before 1.6 supported only the kvstore
# backend. Upgrades from these older cilium versions should continue using
# the kvstore by commenting out the identity-allocation-mode below, or
# setting it to "kvstore".
identity-allocation-mode: crd
cilium-endpoint-gc-interval: "5m0s"
# If you want to run cilium in debug mode change this value to true
debug: "false"
# The agent can be put into the following three policy enforcement modes
# default, always and never.
# https://docs.cilium.io/en/latest/policy/intro/#policy-enforcement-modes
enable-policy: "default"
# Enable IPv4 addressing. If enabled, all endpoints are allocated an IPv4
# address.
enable-ipv4: "true"
# Enable IPv6 addressing. If enabled, all endpoints are allocated an IPv6
# address.
enable-ipv6: "false"
# Users who wish to specify their own custom CNI configuration file must set
# custom-cni-conf to "true", otherwise Cilium may overwrite the configuration.
custom-cni-conf: "false"
enable-bpf-clock-probe: "true"
# If you want cilium monitor to aggregate tracing for packets, set this level
# to "low", "medium", or "maximum". The higher the level, the less packets
# that will be seen in monitor output.
monitor-aggregation: medium
# The monitor aggregation interval governs the typical time between monitor
# notification events for each allowed connection.
#
# Only effective when monitor aggregation is set to "medium" or higher.
monitor-aggregation-interval: 5s
# The monitor aggregation flags determine which TCP flags which, upon the
# first observation, cause monitor notifications to be generated.
#
# Only effective when monitor aggregation is set to "medium" or higher.
monitor-aggregation-flags: all
# Specifies the ratio (0.0-1.0) of total system memory to use for dynamic
# sizing of the TCP CT, non-TCP CT, NAT and policy BPF maps.
bpf-map-dynamic-size-ratio: "0.0025"
# bpf-policy-map-max specifies the maximum number of entries in endpoint
# policy map (per endpoint)
bpf-policy-map-max: "16384"
# bpf-lb-map-max specifies the maximum number of entries in bpf lb service,
# backend and affinity maps.
bpf-lb-map-max: "65536"
# Pre-allocation of map entries allows per-packet latency to be reduced, at
# the expense of up-front memory allocation for the entries in the maps. The
# default value below will minimize memory usage in the default installation;
# users who are sensitive to latency may consider setting this to "true".
#
# This option was introduced in Cilium 1.4. Cilium 1.3 and earlier ignore
# this option and behave as though it is set to "true".
#
# If this value is modified, then during the next Cilium startup the restore
# of existing endpoints and tracking of ongoing connections may be disrupted.
# As a result, reply packets may be dropped and the load-balancing decisions
# for established connections may change.
#
# If this option is set to "false" during an upgrade from 1.3 or earlier to
# 1.4 or later, then it may cause one-time disruptions during the upgrade.
preallocate-bpf-maps: "false"
# Regular expression matching compatible Istio sidecar istio-proxy
# container image names
sidecar-istio-proxy-image: "cilium/istio_proxy"
# Name of the cluster. Only relevant when building a mesh of clusters.
cluster-name: cluster
# Unique ID of the cluster. Must be unique across all conneted clusters and
# in the range of 1 and 255. Only relevant when building a mesh of clusters.
cluster-id: "1"
# Encapsulation mode for communication between nodes
# Possible values:
# - disabled
# - vxlan (default)
# - geneve
tunnel: vxlan
# Enables L7 proxy for L7 policy enforcement and visibility
enable-l7-proxy: "true"
# wait-bpf-mount makes init container wait until bpf filesystem is mounted
wait-bpf-mount: "false"
masquerade: "true"
enable-bpf-masquerade: "true"
enable-xt-socket-fallback: "true"
install-iptables-rules: "true"
auto-direct-node-routes: "false"
enable-bandwidth-manager: "false"
enable-local-redirect-policy: "false"
kube-proxy-replacement: "probe"
kube-proxy-replacement-healthz-bind-address: ""
enable-health-check-nodeport: "true"
node-port-bind-protection: "true"
enable-auto-protect-node-port-range: "true"
enable-session-affinity: "true"
k8s-require-ipv4-pod-cidr: "true"
k8s-require-ipv6-pod-cidr: "false"
enable-endpoint-health-checking: "true"
enable-health-checking: "true"
enable-well-known-identities: "false"
enable-remote-node-identity: "true"
operator-api-serve-addr: "127.0.0.1:9234"
# Enable Hubble gRPC service.
enable-hubble: "true"
# UNIX domain socket for Hubble server to listen to.
hubble-socket-path: "/var/run/cilium/hubble.sock"
# An additional address for Hubble server to listen to (e.g. ":4244").
hubble-listen-address: ":4244"
hubble-disable-tls: "false"
hubble-tls-cert-file: /var/lib/cilium/tls/hubble/server.crt
hubble-tls-key-file: /var/lib/cilium/tls/hubble/server.key
hubble-tls-client-ca-files: /var/lib/cilium/tls/hubble/client-ca.crt
ipam: "cluster-pool"
cluster-pool-ipv4-cidr: "10.244.0.0/16"
cluster-pool-ipv4-mask-size: "24"
disable-cnp-status-updates: "true"
cgroup-root: "/run/cilium/cgroupv2"
---
# Source: cilium/templates/cilium-agent-clusterrole.yaml
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
name: cilium
rules:
- apiGroups:
- networking.k8s.io
resources:
- networkpolicies
verbs:
- get
- list
- watch
- apiGroups:
- discovery.k8s.io
resources:
- endpointslices
verbs:
- get
- list
- watch
- apiGroups:
- ""
resources:
- namespaces
- services
- nodes
- endpoints
verbs:
- get
- list
- watch
- apiGroups:
- ""
resources:
- pods
- pods/finalizers
verbs:
- get
- list
- watch
- update
- delete
- apiGroups:
- ""
resources:
- nodes
verbs:
- get
- list
- watch
- update
- apiGroups:
- ""
resources:
- nodes
- nodes/status
verbs:
- patch
- apiGroups:
- apiextensions.k8s.io
resources:
- customresourcedefinitions
verbs:
# Deprecated for removal in v1.10
- create
- list
- watch
- update
# This is used when validating policies in preflight. This will need to stay
# until we figure out how to avoid "get" inside the preflight, and then
# should be removed ideally.
- get
- apiGroups:
- cilium.io
resources:
- ciliumnetworkpolicies
- ciliumnetworkpolicies/status
- ciliumnetworkpolicies/finalizers
- ciliumclusterwidenetworkpolicies
- ciliumclusterwidenetworkpolicies/status
- ciliumclusterwidenetworkpolicies/finalizers
- ciliumendpoints
- ciliumendpoints/status
- ciliumendpoints/finalizers
- ciliumnodes
- ciliumnodes/status
- ciliumnodes/finalizers
- ciliumidentities
- ciliumidentities/finalizers
- ciliumlocalredirectpolicies
- ciliumlocalredirectpolicies/status
- ciliumlocalredirectpolicies/finalizers
verbs:
- '*'
---
# Source: cilium/templates/cilium-operator-clusterrole.yaml
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
name: cilium-operator
rules:
- apiGroups:
- ""
resources:
# to automatically delete [core|kube]dns pods so that are starting to being
# managed by Cilium
- pods
verbs:
- get
- list
- watch
- delete
- apiGroups:
- ""
resources:
- nodes
verbs:
- list
- watch
- apiGroups:
- ""
resources:
# To remove node taints
- nodes
# To set NetworkUnavailable false on startup
- nodes/status
verbs:
- patch
- apiGroups:
- discovery.k8s.io
resources:
- endpointslices
verbs:
- get
- list
- watch
- apiGroups:
- ""
resources:
# to perform the translation of a CNP that contains 'ToGroup' to its endpoints
- services
- endpoints
# to check apiserver connectivity
- namespaces
verbs:
- get
- list
- watch
- apiGroups:
- cilium.io
resources:
- ciliumnetworkpolicies
- ciliumnetworkpolicies/status
- ciliumnetworkpolicies/finalizers
- ciliumclusterwidenetworkpolicies
- ciliumclusterwidenetworkpolicies/status
- ciliumclusterwidenetworkpolicies/finalizers
- ciliumendpoints
- ciliumendpoints/status
- ciliumendpoints/finalizers
- ciliumnodes
- ciliumnodes/status
- ciliumnodes/finalizers
- ciliumidentities
- ciliumidentities/status
- ciliumidentities/finalizers
- ciliumlocalredirectpolicies
- ciliumlocalredirectpolicies/status
- ciliumlocalredirectpolicies/finalizers
verbs:
- '*'
- apiGroups:
- apiextensions.k8s.io
resources:
- customresourcedefinitions
verbs:
- create
- get
- list
- update
- watch
# For cilium-operator running in HA mode.
#
# Cilium operator running in HA mode requires the use of ResourceLock for Leader Election
# between multiple running instances.
# The preferred way of doing this is to use LeasesResourceLock as edits to Leases are less
# common and fewer objects in the cluster watch "all Leases".
# The support for leases was introduced in coordination.k8s.io/v1 during Kubernetes 1.14 release.
# In Cilium we currently don't support HA mode for K8s version < 1.14. This condition make sure
# that we only authorize access to leases resources in supported K8s versions.
- apiGroups:
- coordination.k8s.io
resources:
- leases
verbs:
- create
- get
- update
---
# Source: cilium/templates/cilium-agent-clusterrolebinding.yaml
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:
name: cilium
roleRef:
apiGroup: rbac.authorization.k8s.io
kind: ClusterRole
name: cilium
subjects:
- kind: ServiceAccount
name: cilium
namespace: kube-system
---
# Source: cilium/templates/cilium-operator-clusterrolebinding.yaml
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:
name: cilium-operator
roleRef:
apiGroup: rbac.authorization.k8s.io
kind: ClusterRole
name: cilium-operator
subjects:
- kind: ServiceAccount
name: cilium-operator
namespace: kube-system
---
# Source: cilium/templates/cilium-agent-daemonset.yaml
apiVersion: apps/v1
kind: DaemonSet
metadata:
labels:
k8s-app: cilium
name: cilium
namespace: kube-system
spec:
selector:
matchLabels:
k8s-app: cilium
updateStrategy:
rollingUpdate:
maxUnavailable: 2
type: RollingUpdate
template:
metadata:
annotations:
# This annotation plus the CriticalAddonsOnly toleration makes
# cilium to be a critical pod in the cluster, which ensures cilium
# gets priority scheduling.
# https://kubernetes.io/docs/tasks/administer-cluster/guaranteed-scheduling-critical-addon-pods/
scheduler.alpha.kubernetes.io/critical-pod: ""
labels:
k8s-app: cilium
spec:
affinity:
podAntiAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
- labelSelector:
matchExpressions:
- key: k8s-app
operator: In
values:
- cilium
topologyKey: kubernetes.io/hostname
containers:
- args:
- --config-dir=/tmp/cilium/config-map
command:
- cilium-agent
livenessProbe:
httpGet:
host: '127.0.0.1'
path: /healthz
port: 9879
scheme: HTTP
httpHeaders:
- name: "brief"
value: "true"
failureThreshold: 10
# The initial delay for the liveness probe is intentionally large to
# avoid an endless kill & restart cycle if in the event that the initial
# bootstrapping takes longer than expected.
initialDelaySeconds: 120
periodSeconds: 30
successThreshold: 1
timeoutSeconds: 5
readinessProbe:
httpGet:
host: '127.0.0.1'
path: /healthz
port: 9879
scheme: HTTP
httpHeaders:
- name: "brief"
value: "true"
failureThreshold: 3
initialDelaySeconds: 5
periodSeconds: 30
successThreshold: 1
timeoutSeconds: 5
env:
- name: K8S_NODE_NAME
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: spec.nodeName
- name: CILIUM_K8S_NAMESPACE
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: metadata.namespace
- name: CILIUM_FLANNEL_MASTER_DEVICE
valueFrom:
configMapKeyRef:
key: flannel-master-device
name: cilium-config
optional: true
- name: CILIUM_FLANNEL_UNINSTALL_ON_EXIT
valueFrom:
configMapKeyRef:
key: flannel-uninstall-on-exit
name: cilium-config
optional: true
- name: CILIUM_CLUSTERMESH_CONFIG
value: /var/lib/cilium/clustermesh/
- name: CILIUM_CNI_CHAINING_MODE
valueFrom:
configMapKeyRef:
key: cni-chaining-mode
name: cilium-config
optional: true
- name: CILIUM_CUSTOM_CNI_CONF
valueFrom:
configMapKeyRef:
key: custom-cni-conf
name: cilium-config
optional: true
image: "quay.io/cilium/cilium:v1.12.3@sha256:30de50c4dc0a1e1077e9e7917a54d5cab253058b3f779822aec00f5c817ca826"
imagePullPolicy: IfNotPresent
lifecycle:
postStart:
exec:
command:
- "/cni-install.sh"
- "--enable-debug=false"
preStop:
exec:
command:
- /cni-uninstall.sh
name: cilium-agent
securityContext:
capabilities:
add:
- NET_ADMIN
- SYS_MODULE
privileged: true
volumeMounts:
- mountPath: /sys/fs/bpf
name: bpf-maps
- mountPath: /var/run/cilium
name: cilium-run
- mountPath: /host/opt/cni/bin
name: cni-path
- mountPath: /host/etc/cni/net.d
name: etc-cni-netd
- mountPath: /var/lib/cilium/clustermesh
name: clustermesh-secrets
readOnly: true
- mountPath: /tmp/cilium/config-map
name: cilium-config-path
readOnly: true
# Needed to be able to load kernel modules
- mountPath: /lib/modules
name: lib-modules
readOnly: true
- mountPath: /run/xtables.lock
name: xtables-lock
- mountPath: /var/lib/cilium/tls/hubble
name: hubble-tls
readOnly: true
hostNetwork: true
initContainers:
# Required to mount cgroup2 filesystem on the underlying Kubernetes node.
# We use nsenter command with host's cgroup and mount namespaces enabled.
- name: mount-cgroup
env:
- name: CGROUP_ROOT
value: /run/cilium/cgroupv2
- name: BIN_PATH
value: /opt/cni/bin
command:
- sh
- -c
# The statically linked Go program binary is invoked to avoid any
# dependency on utilities like sh and mount that can be missing on certain
# distros installed on the underlying host. Copy the binary to the
# same directory where we install cilium cni plugin so that exec permissions
# are available.
- 'cp /usr/bin/cilium-mount /hostbin/cilium-mount && nsenter --cgroup=/hostproc/1/ns/cgroup --mount=/hostproc/1/ns/mnt "${BIN_PATH}/cilium-mount" $CGROUP_ROOT; rm /hostbin/cilium-mount'
image: "quay.io/cilium/cilium:v1.12.3@sha256:30de50c4dc0a1e1077e9e7917a54d5cab253058b3f779822aec00f5c817ca826"
imagePullPolicy: IfNotPresent
volumeMounts:
- mountPath: /hostproc
name: hostproc
- mountPath: /hostbin
name: cni-path
securityContext:
privileged: true
- command:
- /init-container.sh
env:
- name: CILIUM_ALL_STATE
valueFrom:
configMapKeyRef:
key: clean-cilium-state
name: cilium-config
optional: true
- name: CILIUM_BPF_STATE
valueFrom:
configMapKeyRef:
key: clean-cilium-bpf-state
name: cilium-config
optional: true
- name: CILIUM_WAIT_BPF_MOUNT
valueFrom:
configMapKeyRef:
key: wait-bpf-mount
name: cilium-config
optional: true
image: "quay.io/cilium/cilium:v1.12.3@sha256:30de50c4dc0a1e1077e9e7917a54d5cab253058b3f779822aec00f5c817ca826"
imagePullPolicy: IfNotPresent
name: clean-cilium-state
securityContext:
capabilities:
add:
- NET_ADMIN
privileged: true
volumeMounts:
- mountPath: /sys/fs/bpf
name: bpf-maps
mountPropagation: HostToContainer
# Required to mount cgroup filesystem from the host to cilium agent pod
- mountPath: /run/cilium/cgroupv2
name: cilium-cgroup
mountPropagation: HostToContainer
- mountPath: /var/run/cilium
name: cilium-run
resources:
requests:
cpu: 100m
memory: 100Mi
restartPolicy: Always
priorityClassName: system-node-critical
serviceAccount: cilium
serviceAccountName: cilium
terminationGracePeriodSeconds: 1
tolerations:
- operator: Exists
volumes:
# To keep state between restarts / upgrades
- hostPath:
path: /var/run/cilium
type: DirectoryOrCreate
name: cilium-run
# To keep state between restarts / upgrades for bpf maps
- hostPath:
path: /sys/fs/bpf
type: DirectoryOrCreate
name: bpf-maps
# To mount cgroup2 filesystem on the host
- hostPath:
path: /proc
type: Directory
name: hostproc
# To keep state between restarts / upgrades for cgroup2 filesystem
- hostPath:
path: /run/cilium/cgroupv2
type: DirectoryOrCreate
name: cilium-cgroup
# To install cilium cni plugin in the host
- hostPath:
path: /opt/cni/bin
type: DirectoryOrCreate
name: cni-path
# To install cilium cni configuration in the host
- hostPath:
path: /etc/cni/net.d
type: DirectoryOrCreate
name: etc-cni-netd
# To be able to load kernel modules
- hostPath:
path: /lib/modules
name: lib-modules
# To access iptables concurrently with other processes (e.g. kube-proxy)
- hostPath:
path: /run/xtables.lock
type: FileOrCreate
name: xtables-lock
# To read the clustermesh configuration
- name: clustermesh-secrets
secret:
defaultMode: 420
optional: true
secretName: cilium-clustermesh
# To read the configuration from the config map
- configMap:
name: cilium-config
name: cilium-config-path
- name: hubble-tls
projected:
sources:
- secret:
name: hubble-server-certs
items:
- key: tls.crt
path: server.crt
- key: tls.key
path: server.key
optional: true
- configMap:
name: hubble-ca-cert
items:
- key: ca.crt
path: client-ca.crt
optional: true
---
# Source: cilium/templates/cilium-operator-deployment.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
labels:
io.cilium/app: operator
name: cilium-operator
name: cilium-operator
namespace: kube-system
spec:
# We support HA mode only for Kubernetes version > 1.14
# See docs on ServerCapabilities.LeasesResourceLock in file pkg/k8s/version/version.go
# for more details.
replicas: 1
selector:
matchLabels:
io.cilium/app: operator
name: cilium-operator
strategy:
rollingUpdate:
maxSurge: 1
maxUnavailable: 1
type: RollingUpdate
template:
metadata:
annotations:
labels:
io.cilium/app: operator
name: cilium-operator
spec:
# In HA mode, cilium-operator pods must not be scheduled on the same
# node as they will clash with each other.
affinity:
podAntiAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
- labelSelector:
matchExpressions:
- key: io.cilium/app
operator: In
values:
- operator
topologyKey: kubernetes.io/hostname
containers:
- args:
- --config-dir=/tmp/cilium/config-map
- --debug=$(CILIUM_DEBUG)
command:
- cilium-operator-generic
env:
- name: K8S_NODE_NAME
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: spec.nodeName
- name: CILIUM_K8S_NAMESPACE
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: metadata.namespace
- name: CILIUM_DEBUG
valueFrom:
configMapKeyRef:
key: debug
name: cilium-config
optional: true
image: "quay.io/cilium/operator-generic:v1.12.3@sha256:816ec1da586139b595eeb31932c61a7c13b07fb4a0255341c0e0f18608e84eff"
imagePullPolicy: IfNotPresent
name: cilium-operator
livenessProbe:
httpGet:
host: '127.0.0.1'
path: /healthz
port: 9234
scheme: HTTP
initialDelaySeconds: 60
periodSeconds: 10
timeoutSeconds: 3
volumeMounts:
- mountPath: /tmp/cilium/config-map
name: cilium-config-path
readOnly: true
hostNetwork: true
restartPolicy: Always
priorityClassName: system-cluster-critical
serviceAccount: cilium-operator
serviceAccountName: cilium-operator
tolerations:
- operator: Exists
volumes:
# To read the configuration from the config map
- configMap:
name: cilium-config
name: cilium-config-path
I0114 12:02:46.452800 7488 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.25.3/kubectl ...
I0114 12:02:46.453693 7488 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (23434 bytes)
I0114 12:02:46.672103 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0114 12:02:49.284052 7488 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.25.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: (2.6108973s)
I0114 12:02:49.284052 7488 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0114 12:02:49.298042 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl label nodes minikube.k8s.io/version=v1.28.0 minikube.k8s.io/commit=59da54e5a04973bd17dc62cf57cb4173bab7bf81 minikube.k8s.io/name=cilium-114511 minikube.k8s.io/updated_at=2023_01_14T12_02_49_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:49.301038 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:49.304054 7488 ops.go:34] apiserver oom_adj: -16
I0114 12:02:49.678680 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:50.488763 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:50.991050 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:51.492306 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:51.999610 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:52.496741 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:52.993621 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:53.490850 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:53.991647 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:54.492376 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:54.993143 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:55.489686 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:55.993661 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:56.490850 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:56.995275 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:57.497021 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:57.988569 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:58.493859 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:58.992591 7488 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.25.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0114 12:02:59.590005 7488 kubeadm.go:1067] duration metric: took 10.3058452s to wait for elevateKubeSystemPrivileges.
I0114 12:02:59.590005 7488 kubeadm.go:398] StartCluster complete in 38.2675209s
I0114 12:02:59.590005 7488 settings.go:142] acquiring lock: {Name:mk9684611c6005d251a6ecf406b4611c2c1e30f5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0114 12:02:59.590978 7488 settings.go:150] Updating kubeconfig: C:\Users\jenkins.minikube2\minikube-integration\kubeconfig
I0114 12:02:59.597954 7488 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube2\minikube-integration\kubeconfig: {Name:mk7e72b8b9c82f9d87d6aed6af6962a1c1fa489d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0114 12:03:00.367342 7488 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "cilium-114511" rescaled to 1
I0114 12:03:00.367342 7488 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.25.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0114 12:03:00.367342 7488 start.go:212] Will wait 5m0s for node &{Name: IP:172.17.0.2 Port:8443 KubernetesVersion:v1.25.3 ContainerRuntime:docker ControlPlane:true Worker:true}
I0114 12:03:00.373420 7488 out.go:177] * Verifying Kubernetes components...
I0114 12:03:00.367342 7488 addons.go:486] enableAddons start: toEnable=map[], additional=[]
I0114 12:03:00.368343 7488 config.go:180] Loaded profile config "cilium-114511": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.25.3
I0114 12:03:00.373420 7488 addons.go:65] Setting storage-provisioner=true in profile "cilium-114511"
I0114 12:03:00.373420 7488 addons.go:65] Setting default-storageclass=true in profile "cilium-114511"
I0114 12:03:00.373420 7488 addons.go:227] Setting addon storage-provisioner=true in "cilium-114511"
W0114 12:03:00.373420 7488 addons.go:236] addon storage-provisioner should already be in state true
I0114 12:03:00.373420 7488 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "cilium-114511"
I0114 12:03:00.373420 7488 host.go:66] Checking if "cilium-114511" exists ...
I0114 12:03:00.403327 7488 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0114 12:03:00.404485 7488 cli_runner.go:164] Run: docker container inspect cilium-114511 --format={{.State.Status}}
I0114 12:03:00.407325 7488 cli_runner.go:164] Run: docker container inspect cilium-114511 --format={{.State.Status}}
I0114 12:03:00.681623 7488 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0114 12:03:00.684634 7488 addons.go:419] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0114 12:03:00.684634 7488 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0114 12:03:00.695633 7488 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-114511
I0114 12:03:00.730453 7488 addons.go:227] Setting addon default-storageclass=true in "cilium-114511"
W0114 12:03:00.730453 7488 addons.go:236] addon default-storageclass should already be in state true
I0114 12:03:00.730453 7488 host.go:66] Checking if "cilium-114511" exists ...
I0114 12:03:00.738452 7488 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.25.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.2 host.minikube.internal\n fallthrough\n }' | sudo /var/lib/minikube/binaries/v1.25.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0114 12:03:00.752456 7488 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" cilium-114511
I0114 12:03:00.762462 7488 cli_runner.go:164] Run: docker container inspect cilium-114511 --format={{.State.Status}}
I0114 12:03:00.991212 7488 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50116 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\cilium-114511\id_rsa Username:docker}
I0114 12:03:01.025225 7488 node_ready.go:35] waiting up to 5m0s for node "cilium-114511" to be "Ready" ...
I0114 12:03:01.038215 7488 addons.go:419] installing /etc/kubernetes/addons/storageclass.yaml
I0114 12:03:01.038215 7488 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0114 12:03:01.047133 7488 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-114511
I0114 12:03:01.062848 7488 node_ready.go:49] node "cilium-114511" has status "Ready":"True"
I0114 12:03:01.062848 7488 node_ready.go:38] duration metric: took 37.6231ms waiting for node "cilium-114511" to be "Ready" ...
I0114 12:03:01.062848 7488 pod_ready.go:35] extra waiting up to 5m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0114 12:03:01.175835 7488 pod_ready.go:78] waiting up to 5m0s for pod "cilium-4lmht" in "kube-system" namespace to be "Ready" ...
I0114 12:03:01.289842 7488 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50116 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\cilium-114511\id_rsa Username:docker}
I0114 12:03:01.690452 7488 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.25.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0114 12:03:02.178499 7488 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.25.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0114 12:03:03.365460 7488 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.25.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.2 host.minikube.internal\n fallthrough\n }' | sudo /var/lib/minikube/binaries/v1.25.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.6269812s)
I0114 12:03:03.365460 7488 start.go:833] {"host.minikube.internal": 192.168.65.2} host record injected into CoreDNS
I0114 12:03:03.477704 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:04.773239 7488 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.25.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.5947127s)
I0114 12:03:04.773239 7488 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.25.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.082755s)
I0114 12:03:04.777632 7488 out.go:177] * Enabled addons: default-storageclass, storage-provisioner
I0114 12:03:04.781270 7488 addons.go:488] enableAddons completed in 4.4138821s
I0114 12:03:05.898171 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:07.954119 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:10.388999 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:12.886769 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:14.892022 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:16.895216 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:19.375285 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:21.386991 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:23.883476 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:26.386452 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:28.390364 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:30.876548 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:32.888530 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:35.391451 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:37.875936 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:39.894407 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:42.422709 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:44.891262 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:46.900053 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:49.396937 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:51.903642 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:54.384341 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:03:56.387296 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:02.394575 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:04.886714 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:06.887820 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:09.384876 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:11.891085 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:14.386329 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:16.873819 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:19.475691 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:21.878889 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:24.433257 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:26.889218 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:28.955099 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:31.458140 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:34.498344 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:37.248329 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:39.380032 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:41.385521 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:43.456158 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:49.960158 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:52.390458 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:54.953834 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:57.381444 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:04:59.385464 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:01.890007 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:04.390247 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:06.888801 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:09.455751 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:11.879810 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:15.345159 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:17.389712 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:19.562955 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:22.063594 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:24.251258 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:26.393476 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:28.892463 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:39.058083 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:41.383972 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:43.389415 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:45.887520 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:47.895263 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:50.386590 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:52.881440 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:54.882577 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:57.468459 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:05:59.883459 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:02.388708 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:04.390749 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:07.651367 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:11.836637 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:13.887354 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:16.384116 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:18.402470 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:20.893828 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:22.895407 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:25.375519 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:27.391295 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:29.881768 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:31.887994 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:34.382526 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:36.886564 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:39.386855 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:41.882644 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:44.385408 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:46.400778 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:48.881804 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:50.886283 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:53.388859 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:55.896062 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:06:58.399807 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:00.882928 7488 pod_ready.go:102] pod "cilium-4lmht" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:01.402531 7488 pod_ready.go:81] duration metric: took 4m0.2242096s waiting for pod "cilium-4lmht" in "kube-system" namespace to be "Ready" ...
E0114 12:07:01.402531 7488 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting for the condition
I0114 12:07:01.402531 7488 pod_ready.go:78] waiting up to 5m0s for pod "cilium-operator-6b885c4575-8vrwb" in "kube-system" namespace to be "Ready" ...
I0114 12:07:01.415514 7488 pod_ready.go:92] pod "cilium-operator-6b885c4575-8vrwb" in "kube-system" namespace has status "Ready":"True"
I0114 12:07:01.415514 7488 pod_ready.go:81] duration metric: took 12.9822ms waiting for pod "cilium-operator-6b885c4575-8vrwb" in "kube-system" namespace to be "Ready" ...
I0114 12:07:01.415514 7488 pod_ready.go:78] waiting up to 5m0s for pod "coredns-565d847f94-8dms9" in "kube-system" namespace to be "Ready" ...
I0114 12:07:01.427483 7488 pod_ready.go:97] error getting pod "coredns-565d847f94-8dms9" in "kube-system" namespace (skipping!): pods "coredns-565d847f94-8dms9" not found
I0114 12:07:01.427483 7488 pod_ready.go:81] duration metric: took 11.9694ms waiting for pod "coredns-565d847f94-8dms9" in "kube-system" namespace to be "Ready" ...
E0114 12:07:01.427483 7488 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-565d847f94-8dms9" in "kube-system" namespace (skipping!): pods "coredns-565d847f94-8dms9" not found
I0114 12:07:01.427483 7488 pod_ready.go:78] waiting up to 5m0s for pod "coredns-565d847f94-m62vf" in "kube-system" namespace to be "Ready" ...
I0114 12:07:03.470634 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:05.482910 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:07.488653 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:09.966680 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:11.975069 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:14.478063 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:16.483447 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:18.980750 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:21.473454 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:23.976347 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:26.478496 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:28.979354 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:31.471618 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:33.486061 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:35.975522 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:38.474751 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:40.476387 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:42.481666 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:44.987454 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:47.480937 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:49.969154 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:51.974958 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:54.469717 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:56.475935 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:07:58.479694 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:00.975603 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:02.977526 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:05.488384 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:07.979943 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:10.471113 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:12.474268 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:14.485815 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:16.969871 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:18.976778 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:21.477253 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:23.481601 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:25.482116 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:27.969184 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:29.978373 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:31.979841 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:34.472396 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:36.480543 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:38.481227 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:40.973807 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:43.487720 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:45.974546 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:47.981897 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:50.475263 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:52.483098 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:54.974362 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:57.474178 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:08:59.501122 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:01.973812 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:04.478592 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:06.982003 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:09.466719 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:11.481350 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:13.972820 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:15.984939 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:18.472592 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:20.480237 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:22.980086 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:25.486213 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:27.972885 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:29.979097 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:32.487367 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:34.977072 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:36.982250 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:39.473239 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:41.482814 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:43.982002 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:46.475574 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:48.476779 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:50.480462 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:52.969486 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:54.970348 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:56.988663 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:09:59.467586 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:01.477347 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:03.488655 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:05.979739 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:07.980403 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:10.476125 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:12.975769 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:14.976907 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:16.985450 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:19.479308 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:21.973380 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:24.473707 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:26.976767 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:29.485385 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:31.977155 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:34.472773 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:36.978831 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:38.979571 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:41.471520 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:43.485124 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:45.990227 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:48.486094 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:50.987172 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:53.473865 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:55.480240 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:57.485684 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:10:59.994933 7488 pod_ready.go:102] pod "coredns-565d847f94-m62vf" in "kube-system" namespace has status "Ready":"False"
I0114 12:11:01.501844 7488 pod_ready.go:81] duration metric: took 4m0.0718081s waiting for pod "coredns-565d847f94-m62vf" in "kube-system" namespace to be "Ready" ...
E0114 12:11:01.501844 7488 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting for the condition
I0114 12:11:01.501844 7488 pod_ready.go:38] duration metric: took 8m0.4329542s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0114 12:11:01.504873 7488 out.go:177]
W0114 12:11:01.507836 7488 out.go:239] X Exiting due to GUEST_START: wait 5m0s for node: extra waiting: timed out waiting 5m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
X Exiting due to GUEST_START: wait 5m0s for node: extra waiting: timed out waiting 5m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
W0114 12:11:01.507836 7488 out.go:239] *
*
W0114 12:11:01.509850 7488 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0114 12:11:01.512833 7488 out.go:177]
** /stderr **
net_test.go:103: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/cilium/Start (574.04s)