=== RUN TestAddons/serial/Volcano
addons_test.go:905: volcano-admission stabilized in 40.250546ms
addons_test.go:897: volcano-scheduler stabilized in 40.378061ms
addons_test.go:913: volcano-controller stabilized in 40.443858ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-g52qk" [c20956e7-48c7-45a1-b114-f15e80ed770b] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.003723355s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-phvl2" [db0ad15b-1b46-478b-a106-3482b6541bff] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.004558022s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-l985r" [6e9befc4-b3ff-441f-90b4-d32cbd5c073b] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.0037937s
addons_test.go:932: (dbg) Run: kubectl --context addons-606058 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run: kubectl --context addons-606058 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run: kubectl --context addons-606058 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [8a170c3c-b0c6-48f0-a384-d646076e8d41] Pending
helpers_test.go:344: "test-job-nginx-0" [8a170c3c-b0c6-48f0-a384-d646076e8d41] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:964: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:964: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-606058 -n addons-606058
addons_test.go:964: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-08-28 17:55:12.721574774 +0000 UTC m=+435.413714687
addons_test.go:964: (dbg) Run: kubectl --context addons-606058 describe po test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-606058 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-21c14280-9ead-4770-aba3-1c9d88e6a713
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-kqvgf (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-kqvgf:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:964: (dbg) Run: kubectl --context addons-606058 logs test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-606058 logs test-job-nginx-0 -n my-volcano:
addons_test.go:965: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-606058
helpers_test.go:235: (dbg) docker inspect addons-606058:
-- stdout --
[
{
"Id": "ba7fd7a7df26e5864c3cddb4958c1a11cf0d074c58d0723635d40cef8703f8da",
"Created": "2024-08-28T17:48:40.115859028Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 301451,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-08-28T17:48:40.289463083Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:2cc8dc59c2b679153d99f84cc70dab3e87225f8a0d04f61969b54714a9c4cd4d",
"ResolvConfPath": "/var/lib/docker/containers/ba7fd7a7df26e5864c3cddb4958c1a11cf0d074c58d0723635d40cef8703f8da/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/ba7fd7a7df26e5864c3cddb4958c1a11cf0d074c58d0723635d40cef8703f8da/hostname",
"HostsPath": "/var/lib/docker/containers/ba7fd7a7df26e5864c3cddb4958c1a11cf0d074c58d0723635d40cef8703f8da/hosts",
"LogPath": "/var/lib/docker/containers/ba7fd7a7df26e5864c3cddb4958c1a11cf0d074c58d0723635d40cef8703f8da/ba7fd7a7df26e5864c3cddb4958c1a11cf0d074c58d0723635d40cef8703f8da-json.log",
"Name": "/addons-606058",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-606058:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-606058",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/9072efb74f60860eb2dcfbdc676659792e47a344e491a4eebe993ad90afd64d1-init/diff:/var/lib/docker/overlay2/68d9a87ad0f678e89d4bd37593e54708aeddbc1992258326f1e13c1ad826f200/diff",
"MergedDir": "/var/lib/docker/overlay2/9072efb74f60860eb2dcfbdc676659792e47a344e491a4eebe993ad90afd64d1/merged",
"UpperDir": "/var/lib/docker/overlay2/9072efb74f60860eb2dcfbdc676659792e47a344e491a4eebe993ad90afd64d1/diff",
"WorkDir": "/var/lib/docker/overlay2/9072efb74f60860eb2dcfbdc676659792e47a344e491a4eebe993ad90afd64d1/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-606058",
"Source": "/var/lib/docker/volumes/addons-606058/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-606058",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-606058",
"name.minikube.sigs.k8s.io": "addons-606058",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "43337f54cdc85e907c659e5ab5d5a52a52c1a513b5c810aad0547639964b1801",
"SandboxKey": "/var/run/docker/netns/43337f54cdc8",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33138"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33139"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33142"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33140"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33141"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-606058": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "465c1eb3f10dd948f85e5bd2bf9400b423bc9818195afdf2608f02431ac4fd0f",
"EndpointID": "45b988f5a8b3a826b4203dd073a4c59d4b13201d16317b859cfffaf1054df473",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-606058",
"ba7fd7a7df26"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-606058 -n addons-606058
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-606058 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-606058 logs -n 25: (1.601292848s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-567694 | jenkins | v1.33.1 | 28 Aug 24 17:47 UTC | |
| | -p download-only-567694 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.33.1 | 28 Aug 24 17:48 UTC | 28 Aug 24 17:48 UTC |
| delete | -p download-only-567694 | download-only-567694 | jenkins | v1.33.1 | 28 Aug 24 17:48 UTC | 28 Aug 24 17:48 UTC |
| start | -o=json --download-only | download-only-300361 | jenkins | v1.33.1 | 28 Aug 24 17:48 UTC | |
| | -p download-only-300361 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.33.1 | 28 Aug 24 17:48 UTC | 28 Aug 24 17:48 UTC |
| delete | -p download-only-300361 | download-only-300361 | jenkins | v1.33.1 | 28 Aug 24 17:48 UTC | 28 Aug 24 17:48 UTC |
| delete | -p download-only-567694 | download-only-567694 | jenkins | v1.33.1 | 28 Aug 24 17:48 UTC | 28 Aug 24 17:48 UTC |
| delete | -p download-only-300361 | download-only-300361 | jenkins | v1.33.1 | 28 Aug 24 17:48 UTC | 28 Aug 24 17:48 UTC |
| start | --download-only -p | download-docker-843459 | jenkins | v1.33.1 | 28 Aug 24 17:48 UTC | |
| | download-docker-843459 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-843459 | download-docker-843459 | jenkins | v1.33.1 | 28 Aug 24 17:48 UTC | 28 Aug 24 17:48 UTC |
| start | --download-only -p | binary-mirror-394784 | jenkins | v1.33.1 | 28 Aug 24 17:48 UTC | |
| | binary-mirror-394784 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:35691 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-394784 | binary-mirror-394784 | jenkins | v1.33.1 | 28 Aug 24 17:48 UTC | 28 Aug 24 17:48 UTC |
| addons | disable dashboard -p | addons-606058 | jenkins | v1.33.1 | 28 Aug 24 17:48 UTC | |
| | addons-606058 | | | | | |
| addons | enable dashboard -p | addons-606058 | jenkins | v1.33.1 | 28 Aug 24 17:48 UTC | |
| | addons-606058 | | | | | |
| start | -p addons-606058 --wait=true | addons-606058 | jenkins | v1.33.1 | 28 Aug 24 17:48 UTC | 28 Aug 24 17:51 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/08/28 17:48:15
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0828 17:48:15.661929 300953 out.go:345] Setting OutFile to fd 1 ...
I0828 17:48:15.662120 300953 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0828 17:48:15.662134 300953 out.go:358] Setting ErrFile to fd 2...
I0828 17:48:15.662140 300953 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0828 17:48:15.662407 300953 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19529-294791/.minikube/bin
I0828 17:48:15.662878 300953 out.go:352] Setting JSON to false
I0828 17:48:15.663827 300953 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":5445,"bootTime":1724861851,"procs":169,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1068-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0828 17:48:15.663896 300953 start.go:139] virtualization:
I0828 17:48:15.666282 300953 out.go:177] * [addons-606058] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0828 17:48:15.669090 300953 out.go:177] - MINIKUBE_LOCATION=19529
I0828 17:48:15.669245 300953 notify.go:220] Checking for updates...
I0828 17:48:15.673537 300953 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0828 17:48:15.675516 300953 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19529-294791/kubeconfig
I0828 17:48:15.677218 300953 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19529-294791/.minikube
I0828 17:48:15.679022 300953 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0828 17:48:15.680739 300953 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0828 17:48:15.682482 300953 driver.go:392] Setting default libvirt URI to qemu:///system
I0828 17:48:15.702177 300953 docker.go:123] docker version: linux-27.2.0:Docker Engine - Community
I0828 17:48:15.702312 300953 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0828 17:48:15.766975 300953 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-08-28 17:48:15.757351352 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0828 17:48:15.767082 300953 docker.go:307] overlay module found
I0828 17:48:15.770319 300953 out.go:177] * Using the docker driver based on user configuration
I0828 17:48:15.771945 300953 start.go:297] selected driver: docker
I0828 17:48:15.771962 300953 start.go:901] validating driver "docker" against <nil>
I0828 17:48:15.771975 300953 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0828 17:48:15.772596 300953 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0828 17:48:15.821974 300953 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-08-28 17:48:15.812939011 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0828 17:48:15.822144 300953 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0828 17:48:15.822374 300953 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0828 17:48:15.824629 300953 out.go:177] * Using Docker driver with root privileges
I0828 17:48:15.826470 300953 cni.go:84] Creating CNI manager for ""
I0828 17:48:15.826496 300953 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0828 17:48:15.826508 300953 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0828 17:48:15.826627 300953 start.go:340] cluster config:
{Name:addons-606058 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-606058 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0828 17:48:15.828961 300953 out.go:177] * Starting "addons-606058" primary control-plane node in "addons-606058" cluster
I0828 17:48:15.830912 300953 cache.go:121] Beginning downloading kic base image for docker with containerd
I0828 17:48:15.832815 300953 out.go:177] * Pulling base image v0.0.44-1724775115-19521 ...
I0828 17:48:15.834545 300953 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0828 17:48:15.834616 300953 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19529-294791/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4
I0828 17:48:15.834628 300953 cache.go:56] Caching tarball of preloaded images
I0828 17:48:15.834641 300953 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce in local docker daemon
I0828 17:48:15.834708 300953 preload.go:172] Found /home/jenkins/minikube-integration/19529-294791/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0828 17:48:15.834718 300953 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on containerd
I0828 17:48:15.835063 300953 profile.go:143] Saving config to /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/config.json ...
I0828 17:48:15.835094 300953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/config.json: {Name:mk9962814fecf81d0c42293d0d523d39f4ab744b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 17:48:15.850259 300953 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce to local cache
I0828 17:48:15.850366 300953 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce in local cache directory
I0828 17:48:15.850386 300953 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce in local cache directory, skipping pull
I0828 17:48:15.850391 300953 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce exists in cache, skipping pull
I0828 17:48:15.850399 300953 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce as a tarball
I0828 17:48:15.850404 300953 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce from local cache
I0828 17:48:32.778730 300953 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce from cached tarball
I0828 17:48:32.778772 300953 cache.go:194] Successfully downloaded all kic artifacts
I0828 17:48:32.778820 300953 start.go:360] acquireMachinesLock for addons-606058: {Name:mk4f41ddc3c2bf16c6e378a04d7059150e769164 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0828 17:48:32.778939 300953 start.go:364] duration metric: took 94.358µs to acquireMachinesLock for "addons-606058"
I0828 17:48:32.778972 300953 start.go:93] Provisioning new machine with config: &{Name:addons-606058 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-606058 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0828 17:48:32.779054 300953 start.go:125] createHost starting for "" (driver="docker")
I0828 17:48:32.781626 300953 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0828 17:48:32.781878 300953 start.go:159] libmachine.API.Create for "addons-606058" (driver="docker")
I0828 17:48:32.781914 300953 client.go:168] LocalClient.Create starting
I0828 17:48:32.782020 300953 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19529-294791/.minikube/certs/ca.pem
I0828 17:48:33.213363 300953 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19529-294791/.minikube/certs/cert.pem
I0828 17:48:33.716901 300953 cli_runner.go:164] Run: docker network inspect addons-606058 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0828 17:48:33.735764 300953 cli_runner.go:211] docker network inspect addons-606058 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0828 17:48:33.735860 300953 network_create.go:284] running [docker network inspect addons-606058] to gather additional debugging logs...
I0828 17:48:33.735883 300953 cli_runner.go:164] Run: docker network inspect addons-606058
W0828 17:48:33.751054 300953 cli_runner.go:211] docker network inspect addons-606058 returned with exit code 1
I0828 17:48:33.751087 300953 network_create.go:287] error running [docker network inspect addons-606058]: docker network inspect addons-606058: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-606058 not found
I0828 17:48:33.751106 300953 network_create.go:289] output of [docker network inspect addons-606058]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-606058 not found
** /stderr **
I0828 17:48:33.751228 300953 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0828 17:48:33.767346 300953 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40016fc9e0}
I0828 17:48:33.767406 300953 network_create.go:124] attempt to create docker network addons-606058 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0828 17:48:33.767465 300953 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-606058 addons-606058
I0828 17:48:33.835093 300953 network_create.go:108] docker network addons-606058 192.168.49.0/24 created
I0828 17:48:33.835128 300953 kic.go:121] calculated static IP "192.168.49.2" for the "addons-606058" container
I0828 17:48:33.835206 300953 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0828 17:48:33.849336 300953 cli_runner.go:164] Run: docker volume create addons-606058 --label name.minikube.sigs.k8s.io=addons-606058 --label created_by.minikube.sigs.k8s.io=true
I0828 17:48:33.866998 300953 oci.go:103] Successfully created a docker volume addons-606058
I0828 17:48:33.867104 300953 cli_runner.go:164] Run: docker run --rm --name addons-606058-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-606058 --entrypoint /usr/bin/test -v addons-606058:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce -d /var/lib
I0828 17:48:35.906041 300953 cli_runner.go:217] Completed: docker run --rm --name addons-606058-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-606058 --entrypoint /usr/bin/test -v addons-606058:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce -d /var/lib: (2.038893296s)
I0828 17:48:35.906077 300953 oci.go:107] Successfully prepared a docker volume addons-606058
I0828 17:48:35.906092 300953 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0828 17:48:35.906112 300953 kic.go:194] Starting extracting preloaded images to volume ...
I0828 17:48:35.906196 300953 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19529-294791/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-606058:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce -I lz4 -xf /preloaded.tar -C /extractDir
I0828 17:48:40.029719 300953 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19529-294791/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-606058:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce -I lz4 -xf /preloaded.tar -C /extractDir: (4.123480484s)
I0828 17:48:40.029752 300953 kic.go:203] duration metric: took 4.12363657s to extract preloaded images to volume ...
W0828 17:48:40.029909 300953 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0828 17:48:40.030024 300953 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0828 17:48:40.100544 300953 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-606058 --name addons-606058 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-606058 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-606058 --network addons-606058 --ip 192.168.49.2 --volume addons-606058:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce
I0828 17:48:40.446830 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Running}}
I0828 17:48:40.471050 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:48:40.498312 300953 cli_runner.go:164] Run: docker exec addons-606058 stat /var/lib/dpkg/alternatives/iptables
I0828 17:48:40.554508 300953 oci.go:144] the created container "addons-606058" has a running status.
I0828 17:48:40.554536 300953 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa...
I0828 17:48:40.877576 300953 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0828 17:48:40.907930 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:48:40.931020 300953 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0828 17:48:40.931045 300953 kic_runner.go:114] Args: [docker exec --privileged addons-606058 chown docker:docker /home/docker/.ssh/authorized_keys]
I0828 17:48:41.033404 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:48:41.062090 300953 machine.go:93] provisionDockerMachine start ...
I0828 17:48:41.062184 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:48:41.084140 300953 main.go:141] libmachine: Using SSH client type: native
I0828 17:48:41.084405 300953 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0828 17:48:41.084419 300953 main.go:141] libmachine: About to run SSH command:
hostname
I0828 17:48:41.266715 300953 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-606058
I0828 17:48:41.266740 300953 ubuntu.go:169] provisioning hostname "addons-606058"
I0828 17:48:41.266813 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:48:41.289912 300953 main.go:141] libmachine: Using SSH client type: native
I0828 17:48:41.290152 300953 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0828 17:48:41.290165 300953 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-606058 && echo "addons-606058" | sudo tee /etc/hostname
I0828 17:48:41.461275 300953 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-606058
I0828 17:48:41.461354 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:48:41.485659 300953 main.go:141] libmachine: Using SSH client type: native
I0828 17:48:41.485916 300953 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0828 17:48:41.485940 300953 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-606058' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-606058/g' /etc/hosts;
else
echo '127.0.1.1 addons-606058' | sudo tee -a /etc/hosts;
fi
fi
I0828 17:48:41.619233 300953 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0828 17:48:41.619263 300953 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19529-294791/.minikube CaCertPath:/home/jenkins/minikube-integration/19529-294791/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19529-294791/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19529-294791/.minikube}
I0828 17:48:41.619293 300953 ubuntu.go:177] setting up certificates
I0828 17:48:41.619306 300953 provision.go:84] configureAuth start
I0828 17:48:41.619368 300953 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-606058
I0828 17:48:41.635274 300953 provision.go:143] copyHostCerts
I0828 17:48:41.635359 300953 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19529-294791/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19529-294791/.minikube/cert.pem (1123 bytes)
I0828 17:48:41.635495 300953 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19529-294791/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19529-294791/.minikube/key.pem (1679 bytes)
I0828 17:48:41.635571 300953 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19529-294791/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19529-294791/.minikube/ca.pem (1082 bytes)
I0828 17:48:41.635629 300953 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19529-294791/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19529-294791/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19529-294791/.minikube/certs/ca-key.pem org=jenkins.addons-606058 san=[127.0.0.1 192.168.49.2 addons-606058 localhost minikube]
I0828 17:48:42.226419 300953 provision.go:177] copyRemoteCerts
I0828 17:48:42.226501 300953 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0828 17:48:42.226549 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:48:42.248856 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:48:42.344807 300953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-294791/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0828 17:48:42.371267 300953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-294791/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0828 17:48:42.397137 300953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-294791/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0828 17:48:42.422156 300953 provision.go:87] duration metric: took 802.834933ms to configureAuth
I0828 17:48:42.422183 300953 ubuntu.go:193] setting minikube options for container-runtime
I0828 17:48:42.422375 300953 config.go:182] Loaded profile config "addons-606058": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0828 17:48:42.422391 300953 machine.go:96] duration metric: took 1.36028234s to provisionDockerMachine
I0828 17:48:42.422399 300953 client.go:171] duration metric: took 9.640474075s to LocalClient.Create
I0828 17:48:42.422412 300953 start.go:167] duration metric: took 9.640536237s to libmachine.API.Create "addons-606058"
I0828 17:48:42.422426 300953 start.go:293] postStartSetup for "addons-606058" (driver="docker")
I0828 17:48:42.422436 300953 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0828 17:48:42.422494 300953 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0828 17:48:42.422547 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:48:42.438305 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:48:42.532423 300953 ssh_runner.go:195] Run: cat /etc/os-release
I0828 17:48:42.535440 300953 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0828 17:48:42.535475 300953 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0828 17:48:42.535497 300953 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0828 17:48:42.535506 300953 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0828 17:48:42.535520 300953 filesync.go:126] Scanning /home/jenkins/minikube-integration/19529-294791/.minikube/addons for local assets ...
I0828 17:48:42.535587 300953 filesync.go:126] Scanning /home/jenkins/minikube-integration/19529-294791/.minikube/files for local assets ...
I0828 17:48:42.535610 300953 start.go:296] duration metric: took 113.178484ms for postStartSetup
I0828 17:48:42.535928 300953 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-606058
I0828 17:48:42.550954 300953 profile.go:143] Saving config to /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/config.json ...
I0828 17:48:42.551232 300953 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0828 17:48:42.551282 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:48:42.567598 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:48:42.660257 300953 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0828 17:48:42.664671 300953 start.go:128] duration metric: took 9.885601287s to createHost
I0828 17:48:42.664738 300953 start.go:83] releasing machines lock for "addons-606058", held for 9.885783628s
I0828 17:48:42.664818 300953 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-606058
I0828 17:48:42.680417 300953 ssh_runner.go:195] Run: cat /version.json
I0828 17:48:42.680433 300953 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0828 17:48:42.680475 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:48:42.680475 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:48:42.702434 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:48:42.702843 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:48:42.927140 300953 ssh_runner.go:195] Run: systemctl --version
I0828 17:48:42.931766 300953 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0828 17:48:42.936187 300953 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0828 17:48:42.959658 300953 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0828 17:48:42.959734 300953 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0828 17:48:42.987280 300953 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0828 17:48:42.987305 300953 start.go:495] detecting cgroup driver to use...
I0828 17:48:42.987342 300953 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0828 17:48:42.987422 300953 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0828 17:48:43.000001 300953 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0828 17:48:43.019456 300953 docker.go:217] disabling cri-docker service (if available) ...
I0828 17:48:43.019571 300953 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0828 17:48:43.034236 300953 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0828 17:48:43.052673 300953 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0828 17:48:43.143107 300953 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0828 17:48:43.237789 300953 docker.go:233] disabling docker service ...
I0828 17:48:43.237893 300953 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0828 17:48:43.256754 300953 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0828 17:48:43.268796 300953 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0828 17:48:43.359346 300953 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0828 17:48:43.448434 300953 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0828 17:48:43.459882 300953 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0828 17:48:43.475356 300953 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0828 17:48:43.484546 300953 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0828 17:48:43.493651 300953 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0828 17:48:43.493735 300953 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0828 17:48:43.502802 300953 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0828 17:48:43.512326 300953 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0828 17:48:43.521426 300953 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0828 17:48:43.530742 300953 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0828 17:48:43.539710 300953 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0828 17:48:43.548634 300953 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0828 17:48:43.557583 300953 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0828 17:48:43.567144 300953 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0828 17:48:43.575316 300953 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0828 17:48:43.584226 300953 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0828 17:48:43.681101 300953 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0828 17:48:43.803225 300953 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0828 17:48:43.803344 300953 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0828 17:48:43.806753 300953 start.go:563] Will wait 60s for crictl version
I0828 17:48:43.806853 300953 ssh_runner.go:195] Run: which crictl
I0828 17:48:43.810061 300953 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0828 17:48:43.844950 300953 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.20
RuntimeApiVersion: v1
I0828 17:48:43.845069 300953 ssh_runner.go:195] Run: containerd --version
I0828 17:48:43.865530 300953 ssh_runner.go:195] Run: containerd --version
I0828 17:48:43.888004 300953 out.go:177] * Preparing Kubernetes v1.31.0 on containerd 1.7.20 ...
I0828 17:48:43.890038 300953 cli_runner.go:164] Run: docker network inspect addons-606058 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0828 17:48:43.905938 300953 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0828 17:48:43.909477 300953 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0828 17:48:43.920095 300953 kubeadm.go:883] updating cluster {Name:addons-606058 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-606058 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0828 17:48:43.920219 300953 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0828 17:48:43.920283 300953 ssh_runner.go:195] Run: sudo crictl images --output json
I0828 17:48:43.959769 300953 containerd.go:627] all images are preloaded for containerd runtime.
I0828 17:48:43.959791 300953 containerd.go:534] Images already preloaded, skipping extraction
I0828 17:48:43.959853 300953 ssh_runner.go:195] Run: sudo crictl images --output json
I0828 17:48:43.996372 300953 containerd.go:627] all images are preloaded for containerd runtime.
I0828 17:48:43.996396 300953 cache_images.go:84] Images are preloaded, skipping loading
I0828 17:48:43.996405 300953 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.0 containerd true true} ...
I0828 17:48:43.996508 300953 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-606058 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.0 ClusterName:addons-606058 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0828 17:48:43.996575 300953 ssh_runner.go:195] Run: sudo crictl info
I0828 17:48:44.036108 300953 cni.go:84] Creating CNI manager for ""
I0828 17:48:44.036136 300953 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0828 17:48:44.036146 300953 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0828 17:48:44.036169 300953 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-606058 NodeName:addons-606058 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0828 17:48:44.036314 300953 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-606058"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0828 17:48:44.036406 300953 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0
I0828 17:48:44.045832 300953 binaries.go:44] Found k8s binaries, skipping transfer
I0828 17:48:44.045929 300953 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0828 17:48:44.055150 300953 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0828 17:48:44.073184 300953 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0828 17:48:44.091730 300953 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0828 17:48:44.110022 300953 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0828 17:48:44.113497 300953 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0828 17:48:44.124149 300953 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0828 17:48:44.216761 300953 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0828 17:48:44.230532 300953 certs.go:68] Setting up /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058 for IP: 192.168.49.2
I0828 17:48:44.230554 300953 certs.go:194] generating shared ca certs ...
I0828 17:48:44.230571 300953 certs.go:226] acquiring lock for ca certs: {Name:mke663c906ba93beaf12a5613882d3e46b93d46c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 17:48:44.230691 300953 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19529-294791/.minikube/ca.key
I0828 17:48:45.516091 300953 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19529-294791/.minikube/ca.crt ...
I0828 17:48:45.516127 300953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-294791/.minikube/ca.crt: {Name:mkd50fecf78ee072735e6ed8bbeaca83037d486c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 17:48:45.516369 300953 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19529-294791/.minikube/ca.key ...
I0828 17:48:45.516386 300953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-294791/.minikube/ca.key: {Name:mkc446a30de3b85a3b2bd12dfb35cf7658b122ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 17:48:45.517576 300953 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19529-294791/.minikube/proxy-client-ca.key
I0828 17:48:46.425841 300953 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19529-294791/.minikube/proxy-client-ca.crt ...
I0828 17:48:46.425869 300953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-294791/.minikube/proxy-client-ca.crt: {Name:mk6f6c9f8f7cabea0315ddd95e085e461d87d4c9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 17:48:46.426046 300953 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19529-294791/.minikube/proxy-client-ca.key ...
I0828 17:48:46.426059 300953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-294791/.minikube/proxy-client-ca.key: {Name:mka37fb33cd7f991e0118d1a007852c9374d7e3e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 17:48:46.426145 300953 certs.go:256] generating profile certs ...
I0828 17:48:46.426206 300953 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/client.key
I0828 17:48:46.426226 300953 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/client.crt with IP's: []
I0828 17:48:46.827366 300953 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/client.crt ...
I0828 17:48:46.827403 300953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/client.crt: {Name:mk78998033ac92996a462b952d46bc9823b49625 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 17:48:46.827585 300953 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/client.key ...
I0828 17:48:46.827600 300953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/client.key: {Name:mk42ada07658224e7bb5c0ac04cb382af63b3e9a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 17:48:46.828325 300953 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/apiserver.key.34728fe6
I0828 17:48:46.828351 300953 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/apiserver.crt.34728fe6 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0828 17:48:47.773413 300953 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/apiserver.crt.34728fe6 ...
I0828 17:48:47.773451 300953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/apiserver.crt.34728fe6: {Name:mk305e813116060ee227e4a91ff5881ccc353829 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 17:48:47.773644 300953 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/apiserver.key.34728fe6 ...
I0828 17:48:47.773661 300953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/apiserver.key.34728fe6: {Name:mk50a9e2fc4969df77ed8f04270ff8b6cbfca3b5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 17:48:47.773752 300953 certs.go:381] copying /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/apiserver.crt.34728fe6 -> /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/apiserver.crt
I0828 17:48:47.773837 300953 certs.go:385] copying /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/apiserver.key.34728fe6 -> /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/apiserver.key
I0828 17:48:47.773895 300953 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/proxy-client.key
I0828 17:48:47.773918 300953 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/proxy-client.crt with IP's: []
I0828 17:48:48.570342 300953 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/proxy-client.crt ...
I0828 17:48:48.570377 300953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/proxy-client.crt: {Name:mk00e51deadd86c2efef561cc10b7145df107dfa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 17:48:48.570566 300953 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/proxy-client.key ...
I0828 17:48:48.570581 300953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/proxy-client.key: {Name:mk72293e93fa8c84d0ea6b712c8e850e574d63b8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 17:48:48.571195 300953 certs.go:484] found cert: /home/jenkins/minikube-integration/19529-294791/.minikube/certs/ca-key.pem (1675 bytes)
I0828 17:48:48.571240 300953 certs.go:484] found cert: /home/jenkins/minikube-integration/19529-294791/.minikube/certs/ca.pem (1082 bytes)
I0828 17:48:48.571271 300953 certs.go:484] found cert: /home/jenkins/minikube-integration/19529-294791/.minikube/certs/cert.pem (1123 bytes)
I0828 17:48:48.571299 300953 certs.go:484] found cert: /home/jenkins/minikube-integration/19529-294791/.minikube/certs/key.pem (1679 bytes)
I0828 17:48:48.571967 300953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-294791/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0828 17:48:48.599692 300953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-294791/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0828 17:48:48.625294 300953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-294791/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0828 17:48:48.650427 300953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-294791/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0828 17:48:48.676139 300953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0828 17:48:48.702405 300953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0828 17:48:48.727772 300953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0828 17:48:48.753678 300953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-294791/.minikube/profiles/addons-606058/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0828 17:48:48.777594 300953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-294791/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0828 17:48:48.802142 300953 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0828 17:48:48.819749 300953 ssh_runner.go:195] Run: openssl version
I0828 17:48:48.825099 300953 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0828 17:48:48.834553 300953 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0828 17:48:48.837879 300953 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 28 17:48 /usr/share/ca-certificates/minikubeCA.pem
I0828 17:48:48.837974 300953 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0828 17:48:48.844940 300953 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0828 17:48:48.854237 300953 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0828 17:48:48.857327 300953 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0828 17:48:48.857398 300953 kubeadm.go:392] StartCluster: {Name:addons-606058 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-606058 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0828 17:48:48.857495 300953 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0828 17:48:48.857561 300953 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0828 17:48:48.894253 300953 cri.go:89] found id: ""
I0828 17:48:48.894322 300953 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0828 17:48:48.903173 300953 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0828 17:48:48.911824 300953 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0828 17:48:48.911919 300953 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0828 17:48:48.922713 300953 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0828 17:48:48.922735 300953 kubeadm.go:157] found existing configuration files:
I0828 17:48:48.922808 300953 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0828 17:48:48.931712 300953 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0828 17:48:48.931802 300953 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0828 17:48:48.940259 300953 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0828 17:48:48.949855 300953 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0828 17:48:48.949926 300953 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0828 17:48:48.958551 300953 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0828 17:48:48.967081 300953 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0828 17:48:48.967176 300953 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0828 17:48:48.975734 300953 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0828 17:48:48.984247 300953 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0828 17:48:48.984336 300953 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0828 17:48:48.992760 300953 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0828 17:48:49.033687 300953 kubeadm.go:310] [init] Using Kubernetes version: v1.31.0
I0828 17:48:49.033774 300953 kubeadm.go:310] [preflight] Running pre-flight checks
I0828 17:48:49.053930 300953 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0828 17:48:49.054045 300953 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1068-aws[0m
I0828 17:48:49.054125 300953 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0828 17:48:49.054193 300953 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0828 17:48:49.054266 300953 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0828 17:48:49.054341 300953 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0828 17:48:49.054410 300953 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0828 17:48:49.054476 300953 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0828 17:48:49.054545 300953 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0828 17:48:49.054619 300953 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0828 17:48:49.054685 300953 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0828 17:48:49.054749 300953 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0828 17:48:49.114724 300953 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0828 17:48:49.114890 300953 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0828 17:48:49.115010 300953 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0828 17:48:49.120992 300953 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0828 17:48:49.124929 300953 out.go:235] - Generating certificates and keys ...
I0828 17:48:49.125034 300953 kubeadm.go:310] [certs] Using existing ca certificate authority
I0828 17:48:49.125105 300953 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0828 17:48:49.654304 300953 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0828 17:48:50.137318 300953 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0828 17:48:50.666194 300953 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0828 17:48:51.145062 300953 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0828 17:48:51.268025 300953 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0828 17:48:51.268261 300953 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-606058 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0828 17:48:51.529983 300953 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0828 17:48:51.530243 300953 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-606058 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0828 17:48:52.197303 300953 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0828 17:48:52.867609 300953 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0828 17:48:53.273846 300953 kubeadm.go:310] [certs] Generating "sa" key and public key
I0828 17:48:53.274078 300953 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0828 17:48:53.669803 300953 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0828 17:48:54.416003 300953 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0828 17:48:54.903097 300953 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0828 17:48:55.381586 300953 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0828 17:48:55.932520 300953 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0828 17:48:55.933374 300953 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0828 17:48:55.936252 300953 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0828 17:48:55.938745 300953 out.go:235] - Booting up control plane ...
I0828 17:48:55.938856 300953 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0828 17:48:55.938938 300953 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0828 17:48:55.939974 300953 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0828 17:48:55.951983 300953 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0828 17:48:55.958108 300953 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0828 17:48:55.958452 300953 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0828 17:48:56.069321 300953 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0828 17:48:56.069448 300953 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0828 17:48:58.070396 300953 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 2.001402869s
I0828 17:48:58.070492 300953 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0828 17:49:05.571808 300953 kubeadm.go:310] [api-check] The API server is healthy after 7.501394211s
I0828 17:49:05.591125 300953 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0828 17:49:05.604511 300953 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0828 17:49:05.626301 300953 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0828 17:49:05.626492 300953 kubeadm.go:310] [mark-control-plane] Marking the node addons-606058 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0828 17:49:05.650576 300953 kubeadm.go:310] [bootstrap-token] Using token: rc5yir.v1lskskoe71bqpba
I0828 17:49:05.652413 300953 out.go:235] - Configuring RBAC rules ...
I0828 17:49:05.652536 300953 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0828 17:49:05.670148 300953 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0828 17:49:05.684001 300953 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0828 17:49:05.687659 300953 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0828 17:49:05.691112 300953 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0828 17:49:05.695023 300953 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0828 17:49:05.978860 300953 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0828 17:49:06.403428 300953 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0828 17:49:06.978753 300953 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0828 17:49:06.980021 300953 kubeadm.go:310]
I0828 17:49:06.980090 300953 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0828 17:49:06.980096 300953 kubeadm.go:310]
I0828 17:49:06.980170 300953 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0828 17:49:06.980175 300953 kubeadm.go:310]
I0828 17:49:06.980199 300953 kubeadm.go:310] mkdir -p $HOME/.kube
I0828 17:49:06.980255 300953 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0828 17:49:06.980304 300953 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0828 17:49:06.980309 300953 kubeadm.go:310]
I0828 17:49:06.980360 300953 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0828 17:49:06.980365 300953 kubeadm.go:310]
I0828 17:49:06.980411 300953 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0828 17:49:06.980415 300953 kubeadm.go:310]
I0828 17:49:06.980468 300953 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0828 17:49:06.980540 300953 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0828 17:49:06.980605 300953 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0828 17:49:06.980610 300953 kubeadm.go:310]
I0828 17:49:06.980692 300953 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0828 17:49:06.980766 300953 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0828 17:49:06.980770 300953 kubeadm.go:310]
I0828 17:49:06.980852 300953 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token rc5yir.v1lskskoe71bqpba \
I0828 17:49:06.980950 300953 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:ebdbb96f571584ee7b5643d73c7e5f5ab59e30b970ea1dcadc55b518b8df31ff \
I0828 17:49:06.980970 300953 kubeadm.go:310] --control-plane
I0828 17:49:06.980975 300953 kubeadm.go:310]
I0828 17:49:06.981056 300953 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0828 17:49:06.981066 300953 kubeadm.go:310]
I0828 17:49:06.981144 300953 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token rc5yir.v1lskskoe71bqpba \
I0828 17:49:06.981242 300953 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:ebdbb96f571584ee7b5643d73c7e5f5ab59e30b970ea1dcadc55b518b8df31ff
I0828 17:49:06.984212 300953 kubeadm.go:310] W0828 17:48:49.029908 1044 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0828 17:49:06.984505 300953 kubeadm.go:310] W0828 17:48:49.030920 1044 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0828 17:49:06.984721 300953 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1068-aws\n", err: exit status 1
I0828 17:49:06.984828 300953 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0828 17:49:06.984852 300953 cni.go:84] Creating CNI manager for ""
I0828 17:49:06.984866 300953 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0828 17:49:06.986839 300953 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0828 17:49:06.988639 300953 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0828 17:49:06.992319 300953 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.0/kubectl ...
I0828 17:49:06.992338 300953 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0828 17:49:07.031038 300953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0828 17:49:07.328376 300953 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0828 17:49:07.328441 300953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0828 17:49:07.328511 300953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-606058 minikube.k8s.io/updated_at=2024_08_28T17_49_07_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=6f256f0bf490fd67de29a75a245d072e85b1b216 minikube.k8s.io/name=addons-606058 minikube.k8s.io/primary=true
I0828 17:49:07.539598 300953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0828 17:49:07.539660 300953 ops.go:34] apiserver oom_adj: -16
I0828 17:49:08.040616 300953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0828 17:49:08.540167 300953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0828 17:49:09.039812 300953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0828 17:49:09.539726 300953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0828 17:49:10.040389 300953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0828 17:49:10.539878 300953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0828 17:49:11.040419 300953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0828 17:49:11.540696 300953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0828 17:49:11.692823 300953 kubeadm.go:1113] duration metric: took 4.364442951s to wait for elevateKubeSystemPrivileges
I0828 17:49:11.692860 300953 kubeadm.go:394] duration metric: took 22.835489094s to StartCluster
I0828 17:49:11.692879 300953 settings.go:142] acquiring lock: {Name:mka844fbf5a951ef11587fd548e96fc1d30af8b5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 17:49:11.693002 300953 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19529-294791/kubeconfig
I0828 17:49:11.693386 300953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-294791/kubeconfig: {Name:mkdafb119dde5c297a9c0a5213c3687bb184c63e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 17:49:11.693565 300953 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0828 17:49:11.693601 300953 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0828 17:49:11.693853 300953 config.go:182] Loaded profile config "addons-606058": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0828 17:49:11.693895 300953 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0828 17:49:11.693974 300953 addons.go:69] Setting yakd=true in profile "addons-606058"
I0828 17:49:11.694001 300953 addons.go:234] Setting addon yakd=true in "addons-606058"
I0828 17:49:11.694029 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:11.694472 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.694843 300953 addons.go:69] Setting inspektor-gadget=true in profile "addons-606058"
I0828 17:49:11.694875 300953 addons.go:234] Setting addon inspektor-gadget=true in "addons-606058"
I0828 17:49:11.694906 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:11.695341 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.695784 300953 addons.go:69] Setting metrics-server=true in profile "addons-606058"
I0828 17:49:11.695818 300953 addons.go:234] Setting addon metrics-server=true in "addons-606058"
I0828 17:49:11.695843 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:11.696231 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.699365 300953 addons.go:69] Setting cloud-spanner=true in profile "addons-606058"
I0828 17:49:11.699468 300953 addons.go:234] Setting addon cloud-spanner=true in "addons-606058"
I0828 17:49:11.699527 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:11.700001 300953 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-606058"
I0828 17:49:11.700027 300953 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-606058"
I0828 17:49:11.700048 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:11.700415 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.700687 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.701421 300953 addons.go:69] Setting default-storageclass=true in profile "addons-606058"
I0828 17:49:11.701457 300953 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-606058"
I0828 17:49:11.701699 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.706687 300953 addons.go:69] Setting registry=true in profile "addons-606058"
I0828 17:49:11.706825 300953 addons.go:234] Setting addon registry=true in "addons-606058"
I0828 17:49:11.706869 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:11.713767 300953 addons.go:69] Setting gcp-auth=true in profile "addons-606058"
I0828 17:49:11.713831 300953 mustload.go:65] Loading cluster: addons-606058
I0828 17:49:11.714011 300953 config.go:182] Loaded profile config "addons-606058": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0828 17:49:11.714266 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.718001 300953 addons.go:69] Setting storage-provisioner=true in profile "addons-606058"
I0828 17:49:11.718085 300953 addons.go:234] Setting addon storage-provisioner=true in "addons-606058"
I0828 17:49:11.718152 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:11.718639 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.724275 300953 addons.go:69] Setting ingress=true in profile "addons-606058"
I0828 17:49:11.724331 300953 addons.go:234] Setting addon ingress=true in "addons-606058"
I0828 17:49:11.724375 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:11.724852 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.729994 300953 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-606058"
I0828 17:49:11.730132 300953 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-606058"
I0828 17:49:11.730635 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.735072 300953 addons.go:69] Setting ingress-dns=true in profile "addons-606058"
I0828 17:49:11.735141 300953 addons.go:234] Setting addon ingress-dns=true in "addons-606058"
I0828 17:49:11.735197 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:11.735663 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.748306 300953 addons.go:69] Setting volcano=true in profile "addons-606058"
I0828 17:49:11.748414 300953 addons.go:234] Setting addon volcano=true in "addons-606058"
I0828 17:49:11.748489 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:11.749048 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.700837 300953 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-606058"
I0828 17:49:11.751577 300953 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-606058"
I0828 17:49:11.751619 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:11.752075 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.762379 300953 addons.go:69] Setting volumesnapshots=true in profile "addons-606058"
I0828 17:49:11.762489 300953 addons.go:234] Setting addon volumesnapshots=true in "addons-606058"
I0828 17:49:11.762536 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:11.762759 300953 out.go:177] * Verifying Kubernetes components...
I0828 17:49:11.763227 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.787630 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.808043 300953 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0828 17:49:11.810921 300953 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0
I0828 17:49:11.812603 300953 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0828 17:49:11.812622 300953 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0828 17:49:11.812685 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:11.815748 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:11.830746 300953 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0828 17:49:11.830909 300953 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0828 17:49:11.831483 300953 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0828 17:49:11.833065 300953 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0828 17:49:11.835514 300953 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0828 17:49:11.835596 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:11.833198 300953 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0828 17:49:11.836313 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0828 17:49:11.836365 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:11.837599 300953 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0828 17:49:11.837662 300953 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0828 17:49:11.837756 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:11.853697 300953 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0828 17:49:11.855678 300953 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0828 17:49:11.859003 300953 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0828 17:49:11.861020 300953 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0828 17:49:11.861039 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0828 17:49:11.861114 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:11.916376 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:11.917284 300953 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0828 17:49:11.923486 300953 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0828 17:49:11.925758 300953 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0828 17:49:11.926185 300953 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0828 17:49:11.928646 300953 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0828 17:49:11.928669 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0828 17:49:11.928731 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:11.929443 300953 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0828 17:49:11.929460 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0828 17:49:11.929511 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:11.947112 300953 addons.go:234] Setting addon default-storageclass=true in "addons-606058"
I0828 17:49:11.947190 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:11.947778 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:11.964732 300953 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0828 17:49:11.966415 300953 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0828 17:49:11.970194 300953 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0828 17:49:11.972030 300953 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0828 17:49:11.973844 300953 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0828 17:49:11.977090 300953 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0828 17:49:11.979459 300953 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0828 17:49:11.979544 300953 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0828 17:49:11.982334 300953 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0828 17:49:11.982507 300953 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0828 17:49:11.982521 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0828 17:49:11.982581 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:11.986950 300953 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0828 17:49:11.986973 300953 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0828 17:49:11.987045 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:12.015281 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:12.016597 300953 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-606058"
I0828 17:49:12.016635 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:12.017049 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:12.037715 300953 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0828 17:49:12.043555 300953 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0828 17:49:12.043591 300953 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0828 17:49:12.043665 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:12.049912 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:12.107873 300953 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0828 17:49:12.107896 300953 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0828 17:49:12.107963 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:12.131440 300953 out.go:177] - Using image docker.io/registry:2.8.3
I0828 17:49:12.135089 300953 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0828 17:49:12.137179 300953 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0828 17:49:12.137202 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0828 17:49:12.137269 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:12.159578 300953 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0828 17:49:12.161859 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:12.162499 300953 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0828 17:49:12.162515 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0828 17:49:12.162570 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:12.182321 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:12.194382 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:12.227510 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:12.230124 300953 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0828 17:49:12.231898 300953 out.go:177] - Using image docker.io/busybox:stable
I0828 17:49:12.238503 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:12.238971 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:12.240502 300953 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0828 17:49:12.240524 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0828 17:49:12.240589 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:12.250738 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:12.268576 300953 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0828 17:49:12.268692 300953 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0828 17:49:12.294299 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:12.309198 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:12.309877 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
W0828 17:49:12.313737 300953 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0828 17:49:12.313768 300953 retry.go:31] will retry after 129.388073ms: ssh: handshake failed: EOF
I0828 17:49:12.319588 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:12.651026 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0828 17:49:12.705920 300953 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0828 17:49:12.705944 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0828 17:49:12.754187 300953 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0828 17:49:12.754212 300953 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0828 17:49:12.768143 300953 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0828 17:49:12.768170 300953 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0828 17:49:12.845633 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0828 17:49:12.908587 300953 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0828 17:49:12.908658 300953 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0828 17:49:12.947748 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0828 17:49:12.959602 300953 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0828 17:49:12.959628 300953 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0828 17:49:12.961326 300953 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0828 17:49:12.961347 300953 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0828 17:49:13.002789 300953 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0828 17:49:13.002825 300953 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0828 17:49:13.112578 300953 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0828 17:49:13.112606 300953 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0828 17:49:13.143127 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0828 17:49:13.164425 300953 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0828 17:49:13.164451 300953 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0828 17:49:13.173650 300953 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0828 17:49:13.173677 300953 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0828 17:49:13.183933 300953 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0828 17:49:13.183960 300953 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0828 17:49:13.190778 300953 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0828 17:49:13.190806 300953 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0828 17:49:13.227875 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0828 17:49:13.234971 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0828 17:49:13.277852 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0828 17:49:13.283179 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0828 17:49:13.290265 300953 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0828 17:49:13.290338 300953 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0828 17:49:13.336491 300953 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0828 17:49:13.336558 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0828 17:49:13.408162 300953 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0828 17:49:13.408220 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0828 17:49:13.474373 300953 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0828 17:49:13.474452 300953 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0828 17:49:13.528829 300953 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0828 17:49:13.528900 300953 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0828 17:49:13.535765 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0828 17:49:13.613418 300953 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0828 17:49:13.613493 300953 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0828 17:49:13.690790 300953 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0828 17:49:13.690873 300953 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0828 17:49:13.766101 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0828 17:49:13.806860 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0828 17:49:13.840456 300953 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0828 17:49:13.840543 300953 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0828 17:49:13.949112 300953 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0828 17:49:13.949193 300953 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0828 17:49:14.112101 300953 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0828 17:49:14.112173 300953 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0828 17:49:14.197702 300953 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0828 17:49:14.197774 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0828 17:49:14.469305 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (1.818245882s)
I0828 17:49:14.469439 300953 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.200838551s)
I0828 17:49:14.469548 300953 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.200530598s)
I0828 17:49:14.469533 300953 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0828 17:49:14.470598 300953 node_ready.go:35] waiting up to 6m0s for node "addons-606058" to be "Ready" ...
I0828 17:49:14.475115 300953 node_ready.go:49] node "addons-606058" has status "Ready":"True"
I0828 17:49:14.475144 300953 node_ready.go:38] duration metric: took 4.492642ms for node "addons-606058" to be "Ready" ...
I0828 17:49:14.475155 300953 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0828 17:49:14.484330 300953 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-b4l47" in "kube-system" namespace to be "Ready" ...
I0828 17:49:14.610737 300953 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0828 17:49:14.610762 300953 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0828 17:49:14.740749 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0828 17:49:14.829916 300953 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0828 17:49:14.829985 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0828 17:49:14.948827 300953 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0828 17:49:14.948900 300953 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0828 17:49:14.973857 300953 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-606058" context rescaled to 1 replicas
I0828 17:49:15.050686 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0828 17:49:15.269546 300953 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0828 17:49:15.269619 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0828 17:49:15.643929 300953 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0828 17:49:15.644004 300953 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0828 17:49:15.921698 300953 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0828 17:49:15.921770 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0828 17:49:15.987439 300953 pod_ready.go:98] error getting pod "coredns-6f6b679f8f-b4l47" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-b4l47" not found
I0828 17:49:15.987510 300953 pod_ready.go:82] duration metric: took 1.503139076s for pod "coredns-6f6b679f8f-b4l47" in "kube-system" namespace to be "Ready" ...
E0828 17:49:15.987537 300953 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-6f6b679f8f-b4l47" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-b4l47" not found
I0828 17:49:15.987559 300953 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-p9qlh" in "kube-system" namespace to be "Ready" ...
I0828 17:49:16.659523 300953 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0828 17:49:16.659594 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0828 17:49:16.939665 300953 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0828 17:49:16.939740 300953 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0828 17:49:17.318173 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0828 17:49:17.995721 300953 pod_ready.go:103] pod "coredns-6f6b679f8f-p9qlh" in "kube-system" namespace has status "Ready":"False"
I0828 17:49:19.042331 300953 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0828 17:49:19.042522 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:19.076594 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:19.515810 300953 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0828 17:49:19.618956 300953 addons.go:234] Setting addon gcp-auth=true in "addons-606058"
I0828 17:49:19.619010 300953 host.go:66] Checking if "addons-606058" exists ...
I0828 17:49:19.619499 300953 cli_runner.go:164] Run: docker container inspect addons-606058 --format={{.State.Status}}
I0828 17:49:19.648545 300953 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0828 17:49:19.648612 300953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-606058
I0828 17:49:19.679728 300953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19529-294791/.minikube/machines/addons-606058/id_rsa Username:docker}
I0828 17:49:19.978557 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.132893607s)
I0828 17:49:19.978598 300953 addons.go:475] Verifying addon ingress=true in "addons-606058"
I0828 17:49:19.978856 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (7.031081576s)
I0828 17:49:19.978924 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (6.835772581s)
I0828 17:49:19.978960 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (6.751023412s)
I0828 17:49:19.978981 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (6.743946396s)
I0828 17:49:19.980457 300953 out.go:177] * Verifying ingress addon...
I0828 17:49:19.983065 300953 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0828 17:49:19.990338 300953 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0828 17:49:19.990413 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:20.001551 300953 pod_ready.go:103] pod "coredns-6f6b679f8f-p9qlh" in "kube-system" namespace has status "Ready":"False"
I0828 17:49:20.487910 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:21.066497 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:21.538313 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:21.994383 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:22.021826 300953 pod_ready.go:103] pod "coredns-6f6b679f8f-p9qlh" in "kube-system" namespace has status "Ready":"False"
I0828 17:49:22.245477 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.709632827s)
I0828 17:49:22.245511 300953 addons.go:475] Verifying addon metrics-server=true in "addons-606058"
I0828 17:49:22.245546 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.479376615s)
I0828 17:49:22.245555 300953 addons.go:475] Verifying addon registry=true in "addons-606058"
I0828 17:49:22.245701 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (8.962146466s)
I0828 17:49:22.246006 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (8.968084682s)
I0828 17:49:22.246013 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (8.43907307s)
I0828 17:49:22.246096 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.505271082s)
W0828 17:49:22.246138 300953 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0828 17:49:22.246160 300953 retry.go:31] will retry after 357.788788ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0828 17:49:22.246256 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (7.195494577s)
I0828 17:49:22.247815 300953 out.go:177] * Verifying registry addon...
I0828 17:49:22.249347 300953 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-606058 service yakd-dashboard -n yakd-dashboard
I0828 17:49:22.251507 300953 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0828 17:49:22.269477 300953 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0828 17:49:22.269505 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:22.526297 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:22.604499 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0828 17:49:22.773833 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:22.909285 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (5.591019357s)
I0828 17:49:22.909374 300953 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-606058"
I0828 17:49:22.909591 300953 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.26102126s)
I0828 17:49:22.912534 300953 out.go:177] * Verifying csi-hostpath-driver addon...
I0828 17:49:22.912541 300953 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0828 17:49:22.919212 300953 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0828 17:49:22.923336 300953 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0828 17:49:22.926500 300953 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0828 17:49:22.926522 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:22.928469 300953 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0828 17:49:22.928506 300953 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0828 17:49:22.988316 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:22.988813 300953 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0828 17:49:22.988835 300953 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0828 17:49:23.058974 300953 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0828 17:49:23.058998 300953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0828 17:49:23.105992 300953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0828 17:49:23.256100 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:23.433371 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:23.533372 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:23.755789 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:23.924866 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:23.987841 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:24.248042 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.643448704s)
I0828 17:49:24.267632 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:24.296608 300953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.190572063s)
I0828 17:49:24.300108 300953 addons.go:475] Verifying addon gcp-auth=true in "addons-606058"
I0828 17:49:24.303019 300953 out.go:177] * Verifying gcp-auth addon...
I0828 17:49:24.306141 300953 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0828 17:49:24.358280 300953 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0828 17:49:24.423754 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:24.487888 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:24.493968 300953 pod_ready.go:103] pod "coredns-6f6b679f8f-p9qlh" in "kube-system" namespace has status "Ready":"False"
I0828 17:49:24.756147 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:24.924813 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:24.988374 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:25.256418 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:25.424487 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:25.487807 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:25.755916 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:25.924783 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:26.026492 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:26.256483 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:26.426361 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:26.505760 300953 pod_ready.go:103] pod "coredns-6f6b679f8f-p9qlh" in "kube-system" namespace has status "Ready":"False"
I0828 17:49:26.537684 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:26.762443 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:26.924542 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:26.987871 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:27.256200 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:27.425018 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:27.487994 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:27.756547 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:27.924661 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:27.987544 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:28.258027 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:28.428917 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:28.488072 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:28.755726 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:28.924193 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:28.987881 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:28.993455 300953 pod_ready.go:103] pod "coredns-6f6b679f8f-p9qlh" in "kube-system" namespace has status "Ready":"False"
I0828 17:49:29.254980 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:29.425538 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:29.487900 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:29.755977 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:29.924529 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:29.987847 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:30.272727 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:30.423756 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:30.492084 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:30.755997 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:30.924292 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:30.988303 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:30.993829 300953 pod_ready.go:103] pod "coredns-6f6b679f8f-p9qlh" in "kube-system" namespace has status "Ready":"False"
I0828 17:49:31.255406 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:31.424021 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:31.487970 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:31.756865 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:31.924686 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:31.988279 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:32.255614 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:32.424716 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:32.488144 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:32.756011 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:32.924269 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:32.987605 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:33.255048 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:33.424255 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:33.488208 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:33.494561 300953 pod_ready.go:103] pod "coredns-6f6b679f8f-p9qlh" in "kube-system" namespace has status "Ready":"False"
I0828 17:49:33.756762 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:33.924690 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:33.988067 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:34.256585 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:34.459131 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:34.487802 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:34.756048 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:34.924629 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:34.987818 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:35.255836 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:35.424994 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:35.494764 300953 pod_ready.go:103] pod "coredns-6f6b679f8f-p9qlh" in "kube-system" namespace has status "Ready":"False"
I0828 17:49:35.525096 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:35.755643 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:35.924127 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:35.987996 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:36.256066 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:36.425565 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:36.488973 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:36.755808 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:36.925478 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:37.026386 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:37.256212 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:37.426034 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:37.490098 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:37.496518 300953 pod_ready.go:103] pod "coredns-6f6b679f8f-p9qlh" in "kube-system" namespace has status "Ready":"False"
I0828 17:49:37.756882 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:37.923732 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:37.987798 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:38.256226 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:38.424475 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:38.487777 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:38.755997 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:38.928684 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:38.988768 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:38.996749 300953 pod_ready.go:93] pod "coredns-6f6b679f8f-p9qlh" in "kube-system" namespace has status "Ready":"True"
I0828 17:49:38.996775 300953 pod_ready.go:82] duration metric: took 23.009187778s for pod "coredns-6f6b679f8f-p9qlh" in "kube-system" namespace to be "Ready" ...
I0828 17:49:38.996788 300953 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-606058" in "kube-system" namespace to be "Ready" ...
I0828 17:49:39.003782 300953 pod_ready.go:93] pod "etcd-addons-606058" in "kube-system" namespace has status "Ready":"True"
I0828 17:49:39.003817 300953 pod_ready.go:82] duration metric: took 7.020935ms for pod "etcd-addons-606058" in "kube-system" namespace to be "Ready" ...
I0828 17:49:39.003837 300953 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-606058" in "kube-system" namespace to be "Ready" ...
I0828 17:49:39.012257 300953 pod_ready.go:93] pod "kube-apiserver-addons-606058" in "kube-system" namespace has status "Ready":"True"
I0828 17:49:39.012295 300953 pod_ready.go:82] duration metric: took 8.448711ms for pod "kube-apiserver-addons-606058" in "kube-system" namespace to be "Ready" ...
I0828 17:49:39.012308 300953 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-606058" in "kube-system" namespace to be "Ready" ...
I0828 17:49:39.027906 300953 pod_ready.go:93] pod "kube-controller-manager-addons-606058" in "kube-system" namespace has status "Ready":"True"
I0828 17:49:39.027938 300953 pod_ready.go:82] duration metric: took 15.622827ms for pod "kube-controller-manager-addons-606058" in "kube-system" namespace to be "Ready" ...
I0828 17:49:39.027953 300953 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-9d9sc" in "kube-system" namespace to be "Ready" ...
I0828 17:49:39.035504 300953 pod_ready.go:93] pod "kube-proxy-9d9sc" in "kube-system" namespace has status "Ready":"True"
I0828 17:49:39.035535 300953 pod_ready.go:82] duration metric: took 7.506488ms for pod "kube-proxy-9d9sc" in "kube-system" namespace to be "Ready" ...
I0828 17:49:39.035548 300953 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-606058" in "kube-system" namespace to be "Ready" ...
I0828 17:49:39.257339 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:39.392817 300953 pod_ready.go:93] pod "kube-scheduler-addons-606058" in "kube-system" namespace has status "Ready":"True"
I0828 17:49:39.392842 300953 pod_ready.go:82] duration metric: took 357.286669ms for pod "kube-scheduler-addons-606058" in "kube-system" namespace to be "Ready" ...
I0828 17:49:39.392855 300953 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-gvhjt" in "kube-system" namespace to be "Ready" ...
I0828 17:49:39.425377 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:39.488506 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:39.756509 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:39.792621 300953 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-gvhjt" in "kube-system" namespace has status "Ready":"True"
I0828 17:49:39.792654 300953 pod_ready.go:82] duration metric: took 399.791592ms for pod "nvidia-device-plugin-daemonset-gvhjt" in "kube-system" namespace to be "Ready" ...
I0828 17:49:39.792666 300953 pod_ready.go:39] duration metric: took 25.31749901s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0828 17:49:39.792681 300953 api_server.go:52] waiting for apiserver process to appear ...
I0828 17:49:39.792757 300953 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0828 17:49:39.807993 300953 api_server.go:72] duration metric: took 28.11436303s to wait for apiserver process to appear ...
I0828 17:49:39.808028 300953 api_server.go:88] waiting for apiserver healthz status ...
I0828 17:49:39.808047 300953 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0828 17:49:39.817481 300953 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0828 17:49:39.818530 300953 api_server.go:141] control plane version: v1.31.0
I0828 17:49:39.818555 300953 api_server.go:131] duration metric: took 10.520144ms to wait for apiserver health ...
I0828 17:49:39.818564 300953 system_pods.go:43] waiting for kube-system pods to appear ...
I0828 17:49:39.924389 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:39.987780 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:40.000605 300953 system_pods.go:59] 18 kube-system pods found
I0828 17:49:40.000663 300953 system_pods.go:61] "coredns-6f6b679f8f-p9qlh" [6b94cdae-a69f-4822-9edb-8a70bb608e0c] Running
I0828 17:49:40.000675 300953 system_pods.go:61] "csi-hostpath-attacher-0" [d1da15b2-47e1-4352-8f6c-03a70a96147c] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0828 17:49:40.000688 300953 system_pods.go:61] "csi-hostpath-resizer-0" [7035d70b-7337-4486-b2e5-f216e56d7354] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0828 17:49:40.000701 300953 system_pods.go:61] "csi-hostpathplugin-vj7zr" [6edb235e-a6bb-4337-b61a-e306c569bca8] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0828 17:49:40.000711 300953 system_pods.go:61] "etcd-addons-606058" [e16ce8d0-f011-4a5e-b359-b03d95d33c95] Running
I0828 17:49:40.000717 300953 system_pods.go:61] "kindnet-rs9hc" [5fd12f47-b1aa-41a4-a1ef-0ad020bc0967] Running
I0828 17:49:40.000721 300953 system_pods.go:61] "kube-apiserver-addons-606058" [50ec6f4e-55f1-4aa7-af89-6de599323909] Running
I0828 17:49:40.000726 300953 system_pods.go:61] "kube-controller-manager-addons-606058" [27cc4dc8-fd3d-4c20-b464-b4b609ae93ae] Running
I0828 17:49:40.000736 300953 system_pods.go:61] "kube-ingress-dns-minikube" [b0c54fba-444f-458f-896b-801671bc78c3] Running
I0828 17:49:40.000740 300953 system_pods.go:61] "kube-proxy-9d9sc" [5cffa2cf-7756-4bc0-82ba-73c89fcbd5fc] Running
I0828 17:49:40.000744 300953 system_pods.go:61] "kube-scheduler-addons-606058" [dc56bd52-3cf0-4645-8c6c-20567ed62fa5] Running
I0828 17:49:40.000751 300953 system_pods.go:61] "metrics-server-84c5f94fbc-6724d" [dfa449a9-0492-4e3c-8e8c-a7325a127ba0] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0828 17:49:40.000760 300953 system_pods.go:61] "nvidia-device-plugin-daemonset-gvhjt" [51a2fbcb-34cf-48c0-bcb5-bf6371120839] Running
I0828 17:49:40.000768 300953 system_pods.go:61] "registry-6fb4cdfc84-qgmt4" [50643f06-10a7-469b-a36a-3c6496036a8b] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0828 17:49:40.000774 300953 system_pods.go:61] "registry-proxy-mjx8k" [064f11d9-7ab2-407b-9cef-5c27002ca5e1] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0828 17:49:40.000784 300953 system_pods.go:61] "snapshot-controller-56fcc65765-b85q6" [4786a9bd-caba-496d-a1fd-f578c7d65c23] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0828 17:49:40.000793 300953 system_pods.go:61] "snapshot-controller-56fcc65765-zlsdt" [ff395c47-e0be-4990-abcc-abdbb6d16397] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0828 17:49:40.000801 300953 system_pods.go:61] "storage-provisioner" [a664bf09-8e5d-4ba0-8ee3-a76454810ef9] Running
I0828 17:49:40.000810 300953 system_pods.go:74] duration metric: took 182.238688ms to wait for pod list to return data ...
I0828 17:49:40.000823 300953 default_sa.go:34] waiting for default service account to be created ...
I0828 17:49:40.191861 300953 default_sa.go:45] found service account: "default"
I0828 17:49:40.191886 300953 default_sa.go:55] duration metric: took 191.056596ms for default service account to be created ...
I0828 17:49:40.191897 300953 system_pods.go:116] waiting for k8s-apps to be running ...
I0828 17:49:40.257988 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:40.400612 300953 system_pods.go:86] 18 kube-system pods found
I0828 17:49:40.400650 300953 system_pods.go:89] "coredns-6f6b679f8f-p9qlh" [6b94cdae-a69f-4822-9edb-8a70bb608e0c] Running
I0828 17:49:40.400662 300953 system_pods.go:89] "csi-hostpath-attacher-0" [d1da15b2-47e1-4352-8f6c-03a70a96147c] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0828 17:49:40.400672 300953 system_pods.go:89] "csi-hostpath-resizer-0" [7035d70b-7337-4486-b2e5-f216e56d7354] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0828 17:49:40.400681 300953 system_pods.go:89] "csi-hostpathplugin-vj7zr" [6edb235e-a6bb-4337-b61a-e306c569bca8] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0828 17:49:40.400686 300953 system_pods.go:89] "etcd-addons-606058" [e16ce8d0-f011-4a5e-b359-b03d95d33c95] Running
I0828 17:49:40.400692 300953 system_pods.go:89] "kindnet-rs9hc" [5fd12f47-b1aa-41a4-a1ef-0ad020bc0967] Running
I0828 17:49:40.400697 300953 system_pods.go:89] "kube-apiserver-addons-606058" [50ec6f4e-55f1-4aa7-af89-6de599323909] Running
I0828 17:49:40.400708 300953 system_pods.go:89] "kube-controller-manager-addons-606058" [27cc4dc8-fd3d-4c20-b464-b4b609ae93ae] Running
I0828 17:49:40.400714 300953 system_pods.go:89] "kube-ingress-dns-minikube" [b0c54fba-444f-458f-896b-801671bc78c3] Running
I0828 17:49:40.400726 300953 system_pods.go:89] "kube-proxy-9d9sc" [5cffa2cf-7756-4bc0-82ba-73c89fcbd5fc] Running
I0828 17:49:40.400733 300953 system_pods.go:89] "kube-scheduler-addons-606058" [dc56bd52-3cf0-4645-8c6c-20567ed62fa5] Running
I0828 17:49:40.400740 300953 system_pods.go:89] "metrics-server-84c5f94fbc-6724d" [dfa449a9-0492-4e3c-8e8c-a7325a127ba0] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0828 17:49:40.400749 300953 system_pods.go:89] "nvidia-device-plugin-daemonset-gvhjt" [51a2fbcb-34cf-48c0-bcb5-bf6371120839] Running
I0828 17:49:40.400757 300953 system_pods.go:89] "registry-6fb4cdfc84-qgmt4" [50643f06-10a7-469b-a36a-3c6496036a8b] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0828 17:49:40.400765 300953 system_pods.go:89] "registry-proxy-mjx8k" [064f11d9-7ab2-407b-9cef-5c27002ca5e1] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0828 17:49:40.400776 300953 system_pods.go:89] "snapshot-controller-56fcc65765-b85q6" [4786a9bd-caba-496d-a1fd-f578c7d65c23] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0828 17:49:40.400784 300953 system_pods.go:89] "snapshot-controller-56fcc65765-zlsdt" [ff395c47-e0be-4990-abcc-abdbb6d16397] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0828 17:49:40.400789 300953 system_pods.go:89] "storage-provisioner" [a664bf09-8e5d-4ba0-8ee3-a76454810ef9] Running
I0828 17:49:40.400802 300953 system_pods.go:126] duration metric: took 208.897465ms to wait for k8s-apps to be running ...
I0828 17:49:40.400815 300953 system_svc.go:44] waiting for kubelet service to be running ....
I0828 17:49:40.400873 300953 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0828 17:49:40.415647 300953 system_svc.go:56] duration metric: took 14.822379ms WaitForService to wait for kubelet
I0828 17:49:40.415725 300953 kubeadm.go:582] duration metric: took 28.722092903s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0828 17:49:40.415762 300953 node_conditions.go:102] verifying NodePressure condition ...
I0828 17:49:40.425115 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:40.488799 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:40.592106 300953 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0828 17:49:40.592138 300953 node_conditions.go:123] node cpu capacity is 2
I0828 17:49:40.592151 300953 node_conditions.go:105] duration metric: took 176.353888ms to run NodePressure ...
I0828 17:49:40.592176 300953 start.go:241] waiting for startup goroutines ...
I0828 17:49:40.764518 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:40.957155 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:41.008586 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:41.256620 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:41.425817 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:41.488510 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:41.758863 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:41.923958 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:41.987475 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:42.257581 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:42.428083 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:42.488036 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:42.757166 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:42.925134 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:42.987535 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:43.255172 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:43.424469 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:43.487485 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:43.755876 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:43.924198 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:43.987707 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:44.257374 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:44.424807 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:44.487798 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:44.756921 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:44.924688 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:44.987590 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:45.257378 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:45.425545 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:45.487593 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:45.756680 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:45.924788 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:45.987447 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:46.255801 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:46.457753 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:46.489582 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:46.763744 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:46.924466 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:47.012924 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:47.255208 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:47.426048 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:47.488940 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:47.756320 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:47.924754 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:47.987618 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:48.255612 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:48.424327 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:48.488070 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:48.757948 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:48.923934 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:48.989617 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:49.256427 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:49.424420 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:49.488002 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:49.759676 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:49.924930 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:50.028381 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:50.255893 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0828 17:49:50.429386 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:50.488485 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:50.775084 300953 kapi.go:107] duration metric: took 28.523573988s to wait for kubernetes.io/minikube-addons=registry ...
I0828 17:49:50.926605 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:50.987674 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:51.427049 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:51.524431 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:51.933804 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:51.988288 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:52.424225 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:52.487336 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:52.924418 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:52.995684 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:53.424857 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:53.488710 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:53.924444 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:53.987305 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:54.424254 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:54.488156 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:54.924890 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:55.006377 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:55.425142 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:55.488116 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:55.923914 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:55.987945 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:56.425725 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:56.489635 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:56.923991 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:56.988212 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:57.424800 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:57.487600 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:57.924617 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:57.987946 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:58.423868 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:58.488094 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:58.925345 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:58.988193 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:59.424391 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:59.487593 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:49:59.927879 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:49:59.988628 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:00.434248 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:00.489252 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:00.924807 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:00.988235 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:01.434696 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:01.555602 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:01.926288 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:01.988383 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:02.424475 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:02.488208 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:02.925093 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:03.034439 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:03.424263 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:03.488150 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:03.924430 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:03.987679 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:04.425106 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:04.488166 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:04.924086 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:04.987255 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:05.423939 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:05.488429 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:05.924063 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:05.987896 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:06.432638 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:06.525407 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:06.923599 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:06.987680 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:07.423749 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:07.488284 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:07.924581 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:08.025097 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:08.425028 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:08.487977 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:08.923633 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:08.988982 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:09.423780 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:09.487553 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:09.923738 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:09.987762 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:10.426949 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:10.533729 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:10.924327 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:10.987737 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:11.424755 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:11.487838 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:11.924628 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:11.991490 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:12.425527 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:12.488023 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:12.924447 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0828 17:50:13.025056 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:13.423947 300953 kapi.go:107] duration metric: took 50.5047329s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0828 17:50:13.487656 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:13.987619 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:14.487895 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:14.987161 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:15.487639 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:15.987532 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:16.488069 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:16.988094 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:17.487731 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:17.987547 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:18.488111 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:18.987296 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:19.487492 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:19.987830 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:20.487879 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:20.987083 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:21.487951 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:21.987847 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:22.487282 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:22.987465 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:23.487952 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:23.987909 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:24.488011 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:24.987681 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:25.488280 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:25.987724 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:26.489086 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:26.987446 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:27.488690 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:27.989792 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:28.487436 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:28.988446 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:29.488228 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:29.988613 300953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0828 17:50:30.486939 300953 kapi.go:107] duration metric: took 1m10.503870925s to wait for app.kubernetes.io/name=ingress-nginx ...
I0828 17:50:47.310629 300953 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0828 17:50:47.310650 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:47.810542 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:48.310062 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:48.810222 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:49.309551 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:49.810156 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:50.309502 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:50.810678 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:51.309887 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:51.810206 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:52.309469 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:52.810574 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:53.310532 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:53.810162 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:54.309745 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:54.810244 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:55.310139 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:55.810489 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:56.310483 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:56.809933 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:57.309884 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:57.809428 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:58.310420 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:58.810221 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:59.310105 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:50:59.809629 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:00.321427 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:00.810426 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:01.309731 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:01.809886 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:02.309751 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:02.809690 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:03.309812 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:03.814505 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:04.310191 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:04.810166 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:05.309256 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:05.810558 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:06.310142 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:06.810294 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:07.310173 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:07.809546 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:08.310823 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:08.809823 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:09.310224 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:09.809630 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:10.309972 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:10.809992 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:11.310422 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:11.810093 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:12.309681 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:12.810347 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:13.310158 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:13.809794 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:14.309383 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:14.809877 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:15.309621 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:15.809735 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:16.309901 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:16.810366 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:17.309176 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:17.809725 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:18.309723 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:18.810296 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:19.309633 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:19.809724 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:20.309576 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:20.825978 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:21.310227 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:21.810832 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:22.309109 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:22.809641 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:23.310850 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:23.809899 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:24.310614 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:24.809783 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:25.309395 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:25.810340 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:26.309689 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:26.809750 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:27.314393 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:27.811039 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:28.309790 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:28.809941 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:29.313930 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:29.809908 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:30.310284 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:30.810297 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:31.310418 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:31.810414 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:32.310083 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:32.809270 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:33.310290 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:33.810908 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:34.309174 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:34.810200 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:35.309595 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:35.810020 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:36.310141 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:36.809443 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:37.310333 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:37.809357 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:38.309885 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:38.810497 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:39.310409 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:39.810652 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:40.309503 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:40.810371 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:41.310442 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:41.809884 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:42.310349 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:42.810232 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:43.309701 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:43.809935 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:44.309605 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:44.809284 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:45.312498 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:45.809473 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:46.309996 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:46.809671 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:47.309617 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:47.810279 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:48.310018 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:48.810048 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:49.310221 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:49.809888 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:50.309823 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:50.809511 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:51.310548 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:51.810024 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:52.310284 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:52.810090 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:53.310924 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:53.809587 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:54.309933 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:54.809884 300953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0828 17:51:55.324357 300953 kapi.go:107] duration metric: took 2m31.018214709s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0828 17:51:55.326453 300953 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-606058 cluster.
I0828 17:51:55.328829 300953 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0828 17:51:55.330768 300953 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0828 17:51:55.332801 300953 out.go:177] * Enabled addons: nvidia-device-plugin, cloud-spanner, storage-provisioner, ingress-dns, default-storageclass, metrics-server, volcano, inspektor-gadget, yakd, storage-provisioner-rancher, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
I0828 17:51:55.334620 300953 addons.go:510] duration metric: took 2m43.640718921s for enable addons: enabled=[nvidia-device-plugin cloud-spanner storage-provisioner ingress-dns default-storageclass metrics-server volcano inspektor-gadget yakd storage-provisioner-rancher volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
I0828 17:51:55.334669 300953 start.go:246] waiting for cluster config update ...
I0828 17:51:55.334692 300953 start.go:255] writing updated cluster config ...
I0828 17:51:55.334991 300953 ssh_runner.go:195] Run: rm -f paused
I0828 17:51:55.717013 300953 start.go:600] kubectl: 1.31.0, cluster: 1.31.0 (minor skew: 0)
I0828 17:51:55.719159 300953 out.go:177] * Done! kubectl is now configured to use "addons-606058" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
1faf6e3c3fb51 e2d3313f65753 2 minutes ago Exited gadget 5 86976d3ec8afe gadget-snx4z
09499aa13fd50 6ef582f3ec844 3 minutes ago Running gcp-auth 0 940ecab6484b6 gcp-auth-89d5ffd79-bp25j
aab8612fb956a 8b46b1cd48760 4 minutes ago Running admission 0 7d1beb438add4 volcano-admission-77d7d48b68-phvl2
de4353fc468cf 289a818c8d9c5 4 minutes ago Running controller 0 7e696e6be9e0d ingress-nginx-controller-bc57996ff-xd7zj
079f8cb4357f6 ee6d597e62dc8 5 minutes ago Running csi-snapshotter 0 a3128b7fdb3d0 csi-hostpathplugin-vj7zr
b39343c6ebacf 642ded511e141 5 minutes ago Running csi-provisioner 0 a3128b7fdb3d0 csi-hostpathplugin-vj7zr
b45f54a21cd47 420193b27261a 5 minutes ago Exited patch 2 43c3a70132e5e ingress-nginx-admission-patch-pj42r
6b292f8da9e6a 922312104da8a 5 minutes ago Running liveness-probe 0 a3128b7fdb3d0 csi-hostpathplugin-vj7zr
65af315667257 08f6b2990811a 5 minutes ago Running hostpath 0 a3128b7fdb3d0 csi-hostpathplugin-vj7zr
88267d3c2a039 0107d56dbc0be 5 minutes ago Running node-driver-registrar 0 a3128b7fdb3d0 csi-hostpathplugin-vj7zr
05973f6cb6989 9a80d518f102c 5 minutes ago Running csi-attacher 0 b85d3a0e0cc3f csi-hostpath-attacher-0
0d1bc7183f8b1 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 a3128b7fdb3d0 csi-hostpathplugin-vj7zr
7c98202b18c3f 1505f556b3a7b 5 minutes ago Running volcano-controllers 0 881523711890f volcano-controllers-56675bb4d5-l985r
79fe6ea48d9e0 d9c7ad4c226bf 5 minutes ago Running volcano-scheduler 0 1fbe6d42648a7 volcano-scheduler-576bc46687-g52qk
48be797894322 487fa743e1e22 5 minutes ago Running csi-resizer 0 c7da08c848b38 csi-hostpath-resizer-0
604847db2069f 420193b27261a 5 minutes ago Exited create 0 4ed3baf3f697d ingress-nginx-admission-create-vvgj8
843b9b69f1748 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 cd093295e3fde snapshot-controller-56fcc65765-zlsdt
53194bee74f7c 7ce2150c8929b 5 minutes ago Running local-path-provisioner 0 2ffab575312ad local-path-provisioner-86d989889c-jk6wv
ee8f5a02b7ca4 6fed88f43b276 5 minutes ago Running registry 0 3bb7012a053c9 registry-6fb4cdfc84-qgmt4
144de57189543 5548a49bb60ba 5 minutes ago Running metrics-server 0 765e0e247717e metrics-server-84c5f94fbc-6724d
954f4e8f9949d 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 285a7d6dc6033 snapshot-controller-56fcc65765-b85q6
aabeaea3e6a1b 77bdba588b953 5 minutes ago Running yakd 0 3cc7202b10ded yakd-dashboard-67d98fc6b-lxv5t
aabbf97d38f6a 3410e1561990a 5 minutes ago Running registry-proxy 0 c6658ef61f036 registry-proxy-mjx8k
9c28faff36414 2437cf7621777 5 minutes ago Running coredns 0 e9631053e5961 coredns-6f6b679f8f-p9qlh
c36db598c302d 8be4bcf8ec607 5 minutes ago Running cloud-spanner-emulator 0 175165e1ef960 cloud-spanner-emulator-769b77f747-hxrwq
e24eda3e360c6 a9bac31a5be8d 5 minutes ago Running nvidia-device-plugin-ctr 0 8c8e8f2a6c48a nvidia-device-plugin-daemonset-gvhjt
53954971ba354 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 8b2715d088f08 kube-ingress-dns-minikube
d19b76dd6a724 ba04bb24b9575 5 minutes ago Running storage-provisioner 0 83c98ac3c5c86 storage-provisioner
3d1909867035f 6a23fa8fd2b78 5 minutes ago Running kindnet-cni 0 6a6427bdb2879 kindnet-rs9hc
3e92639301efb 71d55d66fd4ee 6 minutes ago Running kube-proxy 0 658ea788529f2 kube-proxy-9d9sc
ee7f582b2645b cd0f0ae0ec9e0 6 minutes ago Running kube-apiserver 0 ed4b6c42b3f96 kube-apiserver-addons-606058
6c58422a4e59c fcb0683e6bdbd 6 minutes ago Running kube-controller-manager 0 3525b89c3a1c5 kube-controller-manager-addons-606058
cd0f2d03ad6fc fbbbd428abb4d 6 minutes ago Running kube-scheduler 0 f50212f65a1c7 kube-scheduler-addons-606058
fb9915a887efb 27e3830e14027 6 minutes ago Running etcd 0 c31be0be60953 etcd-addons-606058
==> containerd <==
Aug 28 17:52:06 addons-606058 containerd[819]: time="2024-08-28T17:52:06.431558717Z" level=info msg="RemovePodSandbox \"cf900e2f697ae3ebedac4717c5dbca86fe2b242a0fe1f0ff620d47f59572a985\" returns successfully"
Aug 28 17:52:53 addons-606058 containerd[819]: time="2024-08-28T17:52:53.344405180Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\""
Aug 28 17:52:53 addons-606058 containerd[819]: time="2024-08-28T17:52:53.478750167Z" level=info msg="ImageUpdate event name:\"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Aug 28 17:52:53 addons-606058 containerd[819]: time="2024-08-28T17:52:53.480475206Z" level=info msg="stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc: active requests=0, bytes read=89"
Aug 28 17:52:53 addons-606058 containerd[819]: time="2024-08-28T17:52:53.484766223Z" level=info msg="Pulled image \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" with image id \"sha256:e2d3313f65753f82428cf312f6e4b9237983de19680bde57ca1c0935cadbe630\", repo tag \"\", repo digest \"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\", size \"69907666\" in 140.311132ms"
Aug 28 17:52:53 addons-606058 containerd[819]: time="2024-08-28T17:52:53.484819138Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" returns image reference \"sha256:e2d3313f65753f82428cf312f6e4b9237983de19680bde57ca1c0935cadbe630\""
Aug 28 17:52:53 addons-606058 containerd[819]: time="2024-08-28T17:52:53.486886912Z" level=info msg="CreateContainer within sandbox \"86976d3ec8afecbbc1e98fe9d2c398750e70d973b54f51f8eaac3f2afee02b77\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Aug 28 17:52:53 addons-606058 containerd[819]: time="2024-08-28T17:52:53.504647443Z" level=info msg="CreateContainer within sandbox \"86976d3ec8afecbbc1e98fe9d2c398750e70d973b54f51f8eaac3f2afee02b77\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9\""
Aug 28 17:52:53 addons-606058 containerd[819]: time="2024-08-28T17:52:53.505257008Z" level=info msg="StartContainer for \"1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9\""
Aug 28 17:52:53 addons-606058 containerd[819]: time="2024-08-28T17:52:53.556492474Z" level=info msg="StartContainer for \"1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9\" returns successfully"
Aug 28 17:52:54 addons-606058 containerd[819]: time="2024-08-28T17:52:54.811483259Z" level=info msg="shim disconnected" id=1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9 namespace=k8s.io
Aug 28 17:52:54 addons-606058 containerd[819]: time="2024-08-28T17:52:54.811540564Z" level=warning msg="cleaning up after shim disconnected" id=1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9 namespace=k8s.io
Aug 28 17:52:54 addons-606058 containerd[819]: time="2024-08-28T17:52:54.811549909Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 28 17:52:55 addons-606058 containerd[819]: time="2024-08-28T17:52:55.462188543Z" level=info msg="RemoveContainer for \"9817895969b971c1619d7099d63b350eed3ea4f1e4e9016dab1f1bdbbd6cd42f\""
Aug 28 17:52:55 addons-606058 containerd[819]: time="2024-08-28T17:52:55.471837396Z" level=info msg="RemoveContainer for \"9817895969b971c1619d7099d63b350eed3ea4f1e4e9016dab1f1bdbbd6cd42f\" returns successfully"
Aug 28 17:53:06 addons-606058 containerd[819]: time="2024-08-28T17:53:06.435981524Z" level=info msg="RemoveContainer for \"ffce7a57b8ec9c942389d692e1f0a0f31ba4459537bbc42e9abce7e7b875df35\""
Aug 28 17:53:06 addons-606058 containerd[819]: time="2024-08-28T17:53:06.442288180Z" level=info msg="RemoveContainer for \"ffce7a57b8ec9c942389d692e1f0a0f31ba4459537bbc42e9abce7e7b875df35\" returns successfully"
Aug 28 17:53:06 addons-606058 containerd[819]: time="2024-08-28T17:53:06.444258502Z" level=info msg="StopPodSandbox for \"2d98e533993af7306b96b6811022ca5cccc832bc0010fde24a061b23ceb380d0\""
Aug 28 17:53:06 addons-606058 containerd[819]: time="2024-08-28T17:53:06.454795778Z" level=info msg="TearDown network for sandbox \"2d98e533993af7306b96b6811022ca5cccc832bc0010fde24a061b23ceb380d0\" successfully"
Aug 28 17:53:06 addons-606058 containerd[819]: time="2024-08-28T17:53:06.454838100Z" level=info msg="StopPodSandbox for \"2d98e533993af7306b96b6811022ca5cccc832bc0010fde24a061b23ceb380d0\" returns successfully"
Aug 28 17:53:06 addons-606058 containerd[819]: time="2024-08-28T17:53:06.455337814Z" level=info msg="RemovePodSandbox for \"2d98e533993af7306b96b6811022ca5cccc832bc0010fde24a061b23ceb380d0\""
Aug 28 17:53:06 addons-606058 containerd[819]: time="2024-08-28T17:53:06.455416395Z" level=info msg="Forcibly stopping sandbox \"2d98e533993af7306b96b6811022ca5cccc832bc0010fde24a061b23ceb380d0\""
Aug 28 17:53:06 addons-606058 containerd[819]: time="2024-08-28T17:53:06.462691793Z" level=info msg="TearDown network for sandbox \"2d98e533993af7306b96b6811022ca5cccc832bc0010fde24a061b23ceb380d0\" successfully"
Aug 28 17:53:06 addons-606058 containerd[819]: time="2024-08-28T17:53:06.469411912Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"2d98e533993af7306b96b6811022ca5cccc832bc0010fde24a061b23ceb380d0\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Aug 28 17:53:06 addons-606058 containerd[819]: time="2024-08-28T17:53:06.469526423Z" level=info msg="RemovePodSandbox \"2d98e533993af7306b96b6811022ca5cccc832bc0010fde24a061b23ceb380d0\" returns successfully"
==> coredns [9c28faff364142bd5ad9d86145c1839a73ede2b695accffeea35338d5afd70bc] <==
[INFO] 10.244.0.4:56606 - 45334 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000048911s
[INFO] 10.244.0.4:37732 - 21144 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002274402s
[INFO] 10.244.0.4:37732 - 26534 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001155581s
[INFO] 10.244.0.4:54589 - 20399 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000055843s
[INFO] 10.244.0.4:54589 - 59561 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000043667s
[INFO] 10.244.0.4:36767 - 36575 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000095425s
[INFO] 10.244.0.4:36767 - 56800 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000047368s
[INFO] 10.244.0.4:54540 - 9222 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000055819s
[INFO] 10.244.0.4:54540 - 8708 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000036127s
[INFO] 10.244.0.4:42192 - 32454 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000053915s
[INFO] 10.244.0.4:42192 - 41411 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000035569s
[INFO] 10.244.0.4:58126 - 12217 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001906085s
[INFO] 10.244.0.4:58126 - 955 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001291637s
[INFO] 10.244.0.4:41418 - 49235 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000046039s
[INFO] 10.244.0.4:41418 - 34893 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000047458s
[INFO] 10.244.0.24:50728 - 4415 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.003588932s
[INFO] 10.244.0.24:43195 - 55516 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.004484518s
[INFO] 10.244.0.24:46019 - 46473 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000198965s
[INFO] 10.244.0.24:35238 - 58871 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.00013124s
[INFO] 10.244.0.24:35587 - 14432 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000209132s
[INFO] 10.244.0.24:42713 - 5647 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000231039s
[INFO] 10.244.0.24:38303 - 53723 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002888242s
[INFO] 10.244.0.24:42621 - 37551 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002140151s
[INFO] 10.244.0.24:44617 - 7179 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.00479367s
[INFO] 10.244.0.24:43688 - 13225 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.002194173s
==> describe nodes <==
Name: addons-606058
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-606058
kubernetes.io/os=linux
minikube.k8s.io/commit=6f256f0bf490fd67de29a75a245d072e85b1b216
minikube.k8s.io/name=addons-606058
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_08_28T17_49_07_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-606058
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-606058"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 28 Aug 2024 17:49:03 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-606058
AcquireTime: <unset>
RenewTime: Wed, 28 Aug 2024 17:55:12 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 28 Aug 2024 17:52:10 +0000 Wed, 28 Aug 2024 17:48:59 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 28 Aug 2024 17:52:10 +0000 Wed, 28 Aug 2024 17:48:59 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 28 Aug 2024 17:52:10 +0000 Wed, 28 Aug 2024 17:48:59 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 28 Aug 2024 17:52:10 +0000 Wed, 28 Aug 2024 17:49:04 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-606058
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
System Info:
Machine ID: dcb09f1e6df4498e9d536e14cadc64f1
System UUID: 8a6ebe57-45d3-4c09-96d3-b7fdafbac000
Boot ID: d0152fd0-4c93-4332-a156-fea49619c341
Kernel Version: 5.15.0-1068-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.20
Kubelet Version: v1.31.0
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-769b77f747-hxrwq 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
gadget gadget-snx4z 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
gcp-auth gcp-auth-89d5ffd79-bp25j 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m27s
ingress-nginx ingress-nginx-controller-bc57996ff-xd7zj 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m55s
kube-system coredns-6f6b679f8f-p9qlh 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m3s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpathplugin-vj7zr 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system etcd-addons-606058 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m8s
kube-system kindnet-rs9hc 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m3s
kube-system kube-apiserver-addons-606058 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system kube-controller-manager-addons-606058 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system kube-proxy-9d9sc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m3s
kube-system kube-scheduler-addons-606058 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system metrics-server-84c5f94fbc-6724d 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 5m57s
kube-system nvidia-device-plugin-daemonset-gvhjt 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
kube-system registry-6fb4cdfc84-qgmt4 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system registry-proxy-mjx8k 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system snapshot-controller-56fcc65765-b85q6 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system snapshot-controller-56fcc65765-zlsdt 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
local-path-storage local-path-provisioner-86d989889c-jk6wv 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
volcano-system volcano-admission-77d7d48b68-phvl2 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
volcano-system volcano-controllers-56675bb4d5-l985r 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
volcano-system volcano-scheduler-576bc46687-g52qk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
yakd-dashboard yakd-dashboard-67d98fc6b-lxv5t 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m57s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m1s kube-proxy
Normal Starting 6m8s kubelet Starting kubelet.
Warning CgroupV1 6m8s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m8s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m8s kubelet Node addons-606058 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m8s kubelet Node addons-606058 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m8s kubelet Node addons-606058 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m4s node-controller Node addons-606058 event: Registered Node addons-606058 in Controller
==> dmesg <==
[Aug28 16:17] ACPI: SRAT not present
[ +0.000000] ACPI: SRAT not present
[ +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
[ +0.014863] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ +0.434530] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.056418] systemd[1]: /lib/systemd/system/cloud-init-local.service:15: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.002651] systemd[1]: /lib/systemd/system/cloud-init.service:19: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.015530] systemd[1]: /lib/systemd/system/cloud-init.target:15: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.004137] systemd[1]: /lib/systemd/system/cloud-final.service:9: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.003926] systemd[1]: /lib/systemd/system/cloud-config.service:8: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.610422] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
[ +6.526921] kauditd_printk_skb: 36 callbacks suppressed
[Aug28 16:44] hrtimer: interrupt took 13474972 ns
[Aug28 17:17] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> etcd [fb9915a887efb7b8da01657b6e58daac8c4341a5843e284b51f2d588bc87a48b] <==
{"level":"info","ts":"2024-08-28T17:48:58.709340Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-08-28T17:48:58.709636Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-08-28T17:48:58.709661Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-08-28T17:48:58.709744Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-08-28T17:48:58.709754Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-08-28T17:48:59.179432Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-08-28T17:48:59.179670Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-08-28T17:48:59.179761Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-08-28T17:48:59.179919Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-08-28T17:48:59.179998Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-08-28T17:48:59.180098Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-08-28T17:48:59.180176Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-08-28T17:48:59.183585Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-606058 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-08-28T17:48:59.183950Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-08-28T17:48:59.184527Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-28T17:48:59.184808Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-08-28T17:48:59.186024Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-08-28T17:48:59.187462Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-08-28T17:48:59.187494Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-08-28T17:48:59.188085Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-08-28T17:48:59.188933Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-08-28T17:48:59.189521Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-28T17:48:59.189731Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-28T17:48:59.195764Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-28T17:48:59.212212Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
==> gcp-auth [09499aa13fd50e29ea40f643d7d95a147e0ffed3497e23d49ee3389315e09358] <==
2024/08/28 17:51:54 GCP Auth Webhook started!
2024/08/28 17:52:12 Ready to marshal response ...
2024/08/28 17:52:12 Ready to write response ...
2024/08/28 17:52:12 Ready to marshal response ...
2024/08/28 17:52:12 Ready to write response ...
==> kernel <==
17:55:14 up 1:37, 0 users, load average: 0.15, 1.12, 2.13
Linux addons-606058 5.15.0-1068-aws #74~20.04.1-Ubuntu SMP Tue Aug 6 19:45:17 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [3d1909867035f0afbd244afb6e24b11984e37d490bf2f73f58f51c8897b87eb4] <==
I0828 17:53:05.229647 1 main.go:299] handling current node
I0828 17:53:15.222719 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0828 17:53:15.222762 1 main.go:299] handling current node
I0828 17:53:25.227532 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0828 17:53:25.227571 1 main.go:299] handling current node
I0828 17:53:35.229881 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0828 17:53:35.229915 1 main.go:299] handling current node
I0828 17:53:45.230278 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0828 17:53:45.230341 1 main.go:299] handling current node
I0828 17:53:55.227924 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0828 17:53:55.228011 1 main.go:299] handling current node
I0828 17:54:05.222268 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0828 17:54:05.222367 1 main.go:299] handling current node
I0828 17:54:15.223088 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0828 17:54:15.223132 1 main.go:299] handling current node
I0828 17:54:25.230198 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0828 17:54:25.230234 1 main.go:299] handling current node
I0828 17:54:35.231094 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0828 17:54:35.231132 1 main.go:299] handling current node
I0828 17:54:45.227663 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0828 17:54:45.227708 1 main.go:299] handling current node
I0828 17:54:55.226652 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0828 17:54:55.226694 1 main.go:299] handling current node
I0828 17:55:05.231450 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0828 17:55:05.231489 1 main.go:299] handling current node
==> kube-apiserver [ee7f582b2645be88c0e83a46e504759f0894da8933ec72ee5aec6aca6ae6bb89] <==
W0828 17:50:26.164210 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.99.92.97:443: connect: connection refused
W0828 17:50:27.182673 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.99.92.97:443: connect: connection refused
W0828 17:50:27.264882 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.111.205.60:443: connect: connection refused
E0828 17:50:27.264919 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.111.205.60:443: connect: connection refused" logger="UnhandledError"
W0828 17:50:27.266672 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.99.92.97:443: connect: connection refused
W0828 17:50:27.357446 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.111.205.60:443: connect: connection refused
E0828 17:50:27.357486 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.111.205.60:443: connect: connection refused" logger="UnhandledError"
W0828 17:50:27.359069 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.99.92.97:443: connect: connection refused
W0828 17:50:28.201061 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.99.92.97:443: connect: connection refused
W0828 17:50:29.280390 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.99.92.97:443: connect: connection refused
W0828 17:50:30.288765 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.99.92.97:443: connect: connection refused
W0828 17:50:31.344443 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.99.92.97:443: connect: connection refused
W0828 17:50:32.370258 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.99.92.97:443: connect: connection refused
W0828 17:50:33.440480 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.99.92.97:443: connect: connection refused
W0828 17:50:34.454980 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.99.92.97:443: connect: connection refused
W0828 17:50:35.523933 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.99.92.97:443: connect: connection refused
W0828 17:50:36.553309 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.99.92.97:443: connect: connection refused
W0828 17:50:47.182948 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.111.205.60:443: connect: connection refused
E0828 17:50:47.182990 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.111.205.60:443: connect: connection refused" logger="UnhandledError"
W0828 17:51:27.276006 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.111.205.60:443: connect: connection refused
E0828 17:51:27.276054 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.111.205.60:443: connect: connection refused" logger="UnhandledError"
W0828 17:51:27.365726 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.111.205.60:443: connect: connection refused
E0828 17:51:27.365768 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.111.205.60:443: connect: connection refused" logger="UnhandledError"
I0828 17:52:12.244578 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0828 17:52:12.290097 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [6c58422a4e59c01ce6bc793d93c1c04487c86c020c8649fb7bf4bb8f448ae3fc] <==
I0828 17:51:27.292920 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0828 17:51:27.301663 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0828 17:51:27.314315 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0828 17:51:27.375527 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0828 17:51:27.390322 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0828 17:51:27.390438 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0828 17:51:27.400763 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0828 17:51:28.206228 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0828 17:51:28.218409 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0828 17:51:29.314465 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0828 17:51:29.337906 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0828 17:51:30.322657 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0828 17:51:30.332856 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0828 17:51:30.339827 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0828 17:51:30.350397 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0828 17:51:30.361313 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0828 17:51:30.367464 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0828 17:51:55.318045 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="11.118337ms"
I0828 17:51:55.318232 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="121.427µs"
I0828 17:52:00.095719 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0828 17:52:00.096213 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0828 17:52:00.312618 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0828 17:52:00.362236 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0828 17:52:10.793727 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-606058"
I0828 17:52:11.955638 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
==> kube-proxy [3e92639301efb48dca67937c8521361f53deb77ed65f1a19c780c61c12cd2f15] <==
I0828 17:49:12.702460 1 server_linux.go:66] "Using iptables proxy"
I0828 17:49:12.812751 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0828 17:49:12.812814 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0828 17:49:12.870383 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0828 17:49:12.870454 1 server_linux.go:169] "Using iptables Proxier"
I0828 17:49:12.872850 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0828 17:49:12.873319 1 server.go:483] "Version info" version="v1.31.0"
I0828 17:49:12.873334 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0828 17:49:12.885942 1 config.go:197] "Starting service config controller"
I0828 17:49:12.885969 1 shared_informer.go:313] Waiting for caches to sync for service config
I0828 17:49:12.885997 1 config.go:104] "Starting endpoint slice config controller"
I0828 17:49:12.886001 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0828 17:49:12.886393 1 config.go:326] "Starting node config controller"
I0828 17:49:12.886401 1 shared_informer.go:313] Waiting for caches to sync for node config
I0828 17:49:12.990436 1 shared_informer.go:320] Caches are synced for node config
I0828 17:49:12.990476 1 shared_informer.go:320] Caches are synced for service config
I0828 17:49:12.990516 1 shared_informer.go:320] Caches are synced for endpoint slice config
==> kube-scheduler [cd0f2d03ad6fc5d884aaca2f5eb1860c9954f8d215ee2d3c18443a488a71e30e] <==
W0828 17:49:03.749426 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0828 17:49:03.749443 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0828 17:49:03.749506 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0828 17:49:03.749528 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0828 17:49:03.749569 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0828 17:49:03.749586 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0828 17:49:03.749634 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0828 17:49:03.749692 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0828 17:49:03.749772 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0828 17:49:03.749824 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0828 17:49:03.749958 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0828 17:49:03.750003 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0828 17:49:03.750050 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0828 17:49:03.750096 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0828 17:49:04.663094 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0828 17:49:04.663316 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0828 17:49:04.732449 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0828 17:49:04.732497 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0828 17:49:04.786290 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0828 17:49:04.786339 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0828 17:49:04.853184 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0828 17:49:04.853388 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0828 17:49:05.057010 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0828 17:49:05.057073 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
I0828 17:49:06.727796 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Aug 28 17:53:10 addons-606058 kubelet[1498]: I0828 17:53:10.343631 1498 scope.go:117] "RemoveContainer" containerID="1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9"
Aug 28 17:53:10 addons-606058 kubelet[1498]: E0828 17:53:10.343819 1498 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-snx4z_gadget(dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856)\"" pod="gadget/gadget-snx4z" podUID="dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856"
Aug 28 17:53:10 addons-606058 kubelet[1498]: I0828 17:53:10.344346 1498 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-mjx8k" secret="" err="secret \"gcp-auth\" not found"
Aug 28 17:53:25 addons-606058 kubelet[1498]: I0828 17:53:25.342786 1498 scope.go:117] "RemoveContainer" containerID="1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9"
Aug 28 17:53:25 addons-606058 kubelet[1498]: E0828 17:53:25.342996 1498 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-snx4z_gadget(dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856)\"" pod="gadget/gadget-snx4z" podUID="dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856"
Aug 28 17:53:38 addons-606058 kubelet[1498]: I0828 17:53:38.343456 1498 scope.go:117] "RemoveContainer" containerID="1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9"
Aug 28 17:53:38 addons-606058 kubelet[1498]: E0828 17:53:38.343651 1498 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-snx4z_gadget(dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856)\"" pod="gadget/gadget-snx4z" podUID="dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856"
Aug 28 17:53:53 addons-606058 kubelet[1498]: I0828 17:53:53.343261 1498 scope.go:117] "RemoveContainer" containerID="1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9"
Aug 28 17:53:53 addons-606058 kubelet[1498]: E0828 17:53:53.343517 1498 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-snx4z_gadget(dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856)\"" pod="gadget/gadget-snx4z" podUID="dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856"
Aug 28 17:54:05 addons-606058 kubelet[1498]: I0828 17:54:05.343114 1498 scope.go:117] "RemoveContainer" containerID="1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9"
Aug 28 17:54:05 addons-606058 kubelet[1498]: E0828 17:54:05.343338 1498 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-snx4z_gadget(dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856)\"" pod="gadget/gadget-snx4z" podUID="dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856"
Aug 28 17:54:08 addons-606058 kubelet[1498]: I0828 17:54:08.342720 1498 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-6fb4cdfc84-qgmt4" secret="" err="secret \"gcp-auth\" not found"
Aug 28 17:54:19 addons-606058 kubelet[1498]: I0828 17:54:19.343318 1498 scope.go:117] "RemoveContainer" containerID="1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9"
Aug 28 17:54:19 addons-606058 kubelet[1498]: I0828 17:54:19.343416 1498 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-gvhjt" secret="" err="secret \"gcp-auth\" not found"
Aug 28 17:54:19 addons-606058 kubelet[1498]: E0828 17:54:19.344098 1498 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-snx4z_gadget(dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856)\"" pod="gadget/gadget-snx4z" podUID="dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856"
Aug 28 17:54:22 addons-606058 kubelet[1498]: I0828 17:54:22.342779 1498 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-mjx8k" secret="" err="secret \"gcp-auth\" not found"
Aug 28 17:54:32 addons-606058 kubelet[1498]: I0828 17:54:32.342847 1498 scope.go:117] "RemoveContainer" containerID="1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9"
Aug 28 17:54:32 addons-606058 kubelet[1498]: E0828 17:54:32.343046 1498 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-snx4z_gadget(dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856)\"" pod="gadget/gadget-snx4z" podUID="dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856"
Aug 28 17:54:45 addons-606058 kubelet[1498]: I0828 17:54:45.343565 1498 scope.go:117] "RemoveContainer" containerID="1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9"
Aug 28 17:54:45 addons-606058 kubelet[1498]: E0828 17:54:45.343795 1498 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-snx4z_gadget(dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856)\"" pod="gadget/gadget-snx4z" podUID="dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856"
Aug 28 17:54:59 addons-606058 kubelet[1498]: I0828 17:54:59.342651 1498 scope.go:117] "RemoveContainer" containerID="1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9"
Aug 28 17:54:59 addons-606058 kubelet[1498]: E0828 17:54:59.342881 1498 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-snx4z_gadget(dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856)\"" pod="gadget/gadget-snx4z" podUID="dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856"
Aug 28 17:55:10 addons-606058 kubelet[1498]: I0828 17:55:10.343009 1498 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-6fb4cdfc84-qgmt4" secret="" err="secret \"gcp-auth\" not found"
Aug 28 17:55:14 addons-606058 kubelet[1498]: I0828 17:55:14.343710 1498 scope.go:117] "RemoveContainer" containerID="1faf6e3c3fb5147e4a3929c5de86f49db318bc084563b9459fb665304d7f38f9"
Aug 28 17:55:14 addons-606058 kubelet[1498]: E0828 17:55:14.344432 1498 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-snx4z_gadget(dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856)\"" pod="gadget/gadget-snx4z" podUID="dd2cd5ef-ec5b-4a0b-b3e1-ab7f034d7856"
==> storage-provisioner [d19b76dd6a724b3b3469d59691f93b8b9deccaea97448d535408d2620114907b] <==
I0828 17:49:17.892362 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0828 17:49:17.917930 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0828 17:49:17.917972 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0828 17:49:17.927093 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0828 17:49:17.927563 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-606058_58e0ec2f-dd94-42df-9570-ad39defe3c4c!
I0828 17:49:17.927636 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"43b044ef-8291-4ad4-8fb1-401568c39318", APIVersion:"v1", ResourceVersion:"584", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-606058_58e0ec2f-dd94-42df-9570-ad39defe3c4c became leader
I0828 17:49:18.032465 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-606058_58e0ec2f-dd94-42df-9570-ad39defe3c4c!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-606058 -n addons-606058
helpers_test.go:261: (dbg) Run: kubectl --context addons-606058 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-vvgj8 ingress-nginx-admission-patch-pj42r test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-606058 describe pod ingress-nginx-admission-create-vvgj8 ingress-nginx-admission-patch-pj42r test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-606058 describe pod ingress-nginx-admission-create-vvgj8 ingress-nginx-admission-patch-pj42r test-job-nginx-0: exit status 1 (90.476354ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-vvgj8" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-pj42r" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-606058 describe pod ingress-nginx-admission-create-vvgj8 ingress-nginx-admission-patch-pj42r test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (199.87s)