=== RUN TestAddons/serial/Volcano
addons_test.go:897: volcano-scheduler stabilized in 59.493267ms
addons_test.go:905: volcano-admission stabilized in 60.130334ms
addons_test.go:913: volcano-controller stabilized in 60.281246ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-2mczk" [da8b8868-ea9c-4b63-b515-4cb9bcf96635] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.004004163s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-mx4tr" [13b51014-a423-4242-8282-a2ee9c29f945] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.003715308s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-47pmz" [1ed7d265-940b-4553-8eef-9f3ce761ac67] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.004045737s
addons_test.go:932: (dbg) Run: kubectl --context addons-663433 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run: kubectl --context addons-663433 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run: kubectl --context addons-663433 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [f0b30973-453e-4754-93d6-449a5c812433] Pending
helpers_test.go:344: "test-job-nginx-0" [f0b30973-453e-4754-93d6-449a5c812433] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:964: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:964: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-663433 -n addons-663433
addons_test.go:964: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-09-06 18:36:39.987457451 +0000 UTC m=+435.688958850
addons_test.go:964: (dbg) Run: kubectl --context addons-663433 describe po test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-663433 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-2a055d2a-b868-4f31-b66a-ced277958126
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-h48w4 (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-h48w4:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:964: (dbg) Run: kubectl --context addons-663433 logs test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-663433 logs test-job-nginx-0 -n my-volcano:
addons_test.go:965: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-663433
helpers_test.go:235: (dbg) docker inspect addons-663433:
-- stdout --
[
{
"Id": "1cd649a6ff5c712445baaceea43501134091b4386c7fe1fc3d4ae11d2b050efb",
"Created": "2024-09-06T18:30:07.875530732Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 8905,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-06T18:30:08.082055754Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:8411aacd61cb8f2a7ae48c92e2c9e76ad4dd701b3dba8b30393c5cc31fbd2b15",
"ResolvConfPath": "/var/lib/docker/containers/1cd649a6ff5c712445baaceea43501134091b4386c7fe1fc3d4ae11d2b050efb/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/1cd649a6ff5c712445baaceea43501134091b4386c7fe1fc3d4ae11d2b050efb/hostname",
"HostsPath": "/var/lib/docker/containers/1cd649a6ff5c712445baaceea43501134091b4386c7fe1fc3d4ae11d2b050efb/hosts",
"LogPath": "/var/lib/docker/containers/1cd649a6ff5c712445baaceea43501134091b4386c7fe1fc3d4ae11d2b050efb/1cd649a6ff5c712445baaceea43501134091b4386c7fe1fc3d4ae11d2b050efb-json.log",
"Name": "/addons-663433",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-663433:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-663433",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/d756fe605aafcbfe051a7838871e0220c00da88d3b6df733663b3637a5bee48a-init/diff:/var/lib/docker/overlay2/e1d41880879a75cd3e4a60c31d9b14f7f93644b90678ee4622bd30dc9907c43e/diff",
"MergedDir": "/var/lib/docker/overlay2/d756fe605aafcbfe051a7838871e0220c00da88d3b6df733663b3637a5bee48a/merged",
"UpperDir": "/var/lib/docker/overlay2/d756fe605aafcbfe051a7838871e0220c00da88d3b6df733663b3637a5bee48a/diff",
"WorkDir": "/var/lib/docker/overlay2/d756fe605aafcbfe051a7838871e0220c00da88d3b6df733663b3637a5bee48a/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-663433",
"Source": "/var/lib/docker/volumes/addons-663433/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-663433",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-663433",
"name.minikube.sigs.k8s.io": "addons-663433",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "ae3abf49aa458085cb77be314b7f19fcec51c7ca7e9bf628961642b495ff965a",
"SandboxKey": "/var/run/docker/netns/ae3abf49aa45",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32768"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32769"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32772"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32770"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32771"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-663433": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "f5b1465c61bcfb7e7d8b51d351ab3022cb8a016cf72d3aa7ae06bfd23d2e791f",
"EndpointID": "863feb2ed178f774fb442281c4426e8d6814d8862193d482604f91abfbf27a5b",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-663433",
"1cd649a6ff5c"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-663433 -n addons-663433
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-663433 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-663433 logs -n 25: (1.698741387s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-998007 | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | |
| | -p download-only-998007 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | 06 Sep 24 18:29 UTC |
| delete | -p download-only-998007 | download-only-998007 | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | 06 Sep 24 18:29 UTC |
| start | -o=json --download-only | download-only-582754 | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | |
| | -p download-only-582754 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | 06 Sep 24 18:29 UTC |
| delete | -p download-only-582754 | download-only-582754 | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | 06 Sep 24 18:29 UTC |
| delete | -p download-only-998007 | download-only-998007 | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | 06 Sep 24 18:29 UTC |
| delete | -p download-only-582754 | download-only-582754 | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | 06 Sep 24 18:29 UTC |
| start | --download-only -p | download-docker-126447 | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | |
| | download-docker-126447 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-126447 | download-docker-126447 | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | 06 Sep 24 18:29 UTC |
| start | --download-only -p | binary-mirror-873447 | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | |
| | binary-mirror-873447 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:36941 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-873447 | binary-mirror-873447 | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | 06 Sep 24 18:29 UTC |
| addons | enable dashboard -p | addons-663433 | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | |
| | addons-663433 | | | | | |
| addons | disable dashboard -p | addons-663433 | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | |
| | addons-663433 | | | | | |
| start | -p addons-663433 --wait=true | addons-663433 | jenkins | v1.34.0 | 06 Sep 24 18:29 UTC | 06 Sep 24 18:33 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/06 18:29:42
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0906 18:29:42.093459 8404 out.go:345] Setting OutFile to fd 1 ...
I0906 18:29:42.093612 8404 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0906 18:29:42.093623 8404 out.go:358] Setting ErrFile to fd 2...
I0906 18:29:42.093628 8404 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0906 18:29:42.093866 8404 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19576-2243/.minikube/bin
I0906 18:29:42.094340 8404 out.go:352] Setting JSON to false
I0906 18:29:42.095159 8404 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":730,"bootTime":1725646652,"procs":146,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1068-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0906 18:29:42.095239 8404 start.go:139] virtualization:
I0906 18:29:42.100267 8404 out.go:177] * [addons-663433] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0906 18:29:42.102886 8404 out.go:177] - MINIKUBE_LOCATION=19576
I0906 18:29:42.102995 8404 notify.go:220] Checking for updates...
I0906 18:29:42.109061 8404 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0906 18:29:42.111306 8404 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19576-2243/kubeconfig
I0906 18:29:42.113842 8404 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19576-2243/.minikube
I0906 18:29:42.116861 8404 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0906 18:29:42.119189 8404 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0906 18:29:42.121505 8404 driver.go:394] Setting default libvirt URI to qemu:///system
I0906 18:29:42.150038 8404 docker.go:123] docker version: linux-27.2.0:Docker Engine - Community
I0906 18:29:42.150179 8404 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0906 18:29:42.232221 8404 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-06 18:29:42.219963405 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0906 18:29:42.232567 8404 docker.go:318] overlay module found
I0906 18:29:42.235185 8404 out.go:177] * Using the docker driver based on user configuration
I0906 18:29:42.237478 8404 start.go:297] selected driver: docker
I0906 18:29:42.237507 8404 start.go:901] validating driver "docker" against <nil>
I0906 18:29:42.237523 8404 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0906 18:29:42.238259 8404 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0906 18:29:42.300354 8404 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-06 18:29:42.290727786 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0906 18:29:42.300561 8404 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0906 18:29:42.300835 8404 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0906 18:29:42.302889 8404 out.go:177] * Using Docker driver with root privileges
I0906 18:29:42.304930 8404 cni.go:84] Creating CNI manager for ""
I0906 18:29:42.304957 8404 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0906 18:29:42.304968 8404 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0906 18:29:42.305061 8404 start.go:340] cluster config:
{Name:addons-663433 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-663433 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: N
etworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 G
PUs: AutoPauseInterval:1m0s}
I0906 18:29:42.307443 8404 out.go:177] * Starting "addons-663433" primary control-plane node in "addons-663433" cluster
I0906 18:29:42.309447 8404 cache.go:121] Beginning downloading kic base image for docker with containerd
I0906 18:29:42.312203 8404 out.go:177] * Pulling base image v0.0.45 ...
I0906 18:29:42.314542 8404 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0906 18:29:42.314624 8404 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19576-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4
I0906 18:29:42.314638 8404 cache.go:56] Caching tarball of preloaded images
I0906 18:29:42.314646 8404 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 in local docker daemon
I0906 18:29:42.314724 8404 preload.go:172] Found /home/jenkins/minikube-integration/19576-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0906 18:29:42.314735 8404 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on containerd
I0906 18:29:42.315117 8404 profile.go:143] Saving config to /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/config.json ...
I0906 18:29:42.315216 8404 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/config.json: {Name:mke55920259ad4aebc8752aa90343945cda0d586 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 18:29:42.331888 8404 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 to local cache
I0906 18:29:42.332019 8404 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 in local cache directory
I0906 18:29:42.332044 8404 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 in local cache directory, skipping pull
I0906 18:29:42.332051 8404 image.go:135] gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 exists in cache, skipping pull
I0906 18:29:42.332064 8404 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 as a tarball
I0906 18:29:42.332076 8404 cache.go:162] Loading gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 from local cache
I0906 18:29:59.517129 8404 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 from cached tarball
I0906 18:29:59.517180 8404 cache.go:194] Successfully downloaded all kic artifacts
I0906 18:29:59.517217 8404 start.go:360] acquireMachinesLock for addons-663433: {Name:mkc0ab1738c29a3ee40a550d2b671e1276cd2098 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0906 18:29:59.517401 8404 start.go:364] duration metric: took 166.172µs to acquireMachinesLock for "addons-663433"
I0906 18:29:59.517428 8404 start.go:93] Provisioning new machine with config: &{Name:addons-663433 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-663433 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[
] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePa
th: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0906 18:29:59.517506 8404 start.go:125] createHost starting for "" (driver="docker")
I0906 18:29:59.519622 8404 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0906 18:29:59.519859 8404 start.go:159] libmachine.API.Create for "addons-663433" (driver="docker")
I0906 18:29:59.519893 8404 client.go:168] LocalClient.Create starting
I0906 18:29:59.520005 8404 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19576-2243/.minikube/certs/ca.pem
I0906 18:29:59.940671 8404 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19576-2243/.minikube/certs/cert.pem
I0906 18:30:00.936325 8404 cli_runner.go:164] Run: docker network inspect addons-663433 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0906 18:30:00.953014 8404 cli_runner.go:211] docker network inspect addons-663433 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0906 18:30:00.953123 8404 network_create.go:284] running [docker network inspect addons-663433] to gather additional debugging logs...
I0906 18:30:00.953149 8404 cli_runner.go:164] Run: docker network inspect addons-663433
W0906 18:30:00.968349 8404 cli_runner.go:211] docker network inspect addons-663433 returned with exit code 1
I0906 18:30:00.968388 8404 network_create.go:287] error running [docker network inspect addons-663433]: docker network inspect addons-663433: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-663433 not found
I0906 18:30:00.968404 8404 network_create.go:289] output of [docker network inspect addons-663433]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-663433 not found
** /stderr **
I0906 18:30:00.968534 8404 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0906 18:30:00.985722 8404 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4000563df0}
I0906 18:30:00.985767 8404 network_create.go:124] attempt to create docker network addons-663433 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0906 18:30:00.985828 8404 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-663433 addons-663433
I0906 18:30:01.101697 8404 network_create.go:108] docker network addons-663433 192.168.49.0/24 created
I0906 18:30:01.101740 8404 kic.go:121] calculated static IP "192.168.49.2" for the "addons-663433" container
I0906 18:30:01.101819 8404 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0906 18:30:01.116925 8404 cli_runner.go:164] Run: docker volume create addons-663433 --label name.minikube.sigs.k8s.io=addons-663433 --label created_by.minikube.sigs.k8s.io=true
I0906 18:30:01.136104 8404 oci.go:103] Successfully created a docker volume addons-663433
I0906 18:30:01.136202 8404 cli_runner.go:164] Run: docker run --rm --name addons-663433-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-663433 --entrypoint /usr/bin/test -v addons-663433:/var gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 -d /var/lib
I0906 18:30:03.332051 8404 cli_runner.go:217] Completed: docker run --rm --name addons-663433-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-663433 --entrypoint /usr/bin/test -v addons-663433:/var gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 -d /var/lib: (2.195809836s)
I0906 18:30:03.332079 8404 oci.go:107] Successfully prepared a docker volume addons-663433
I0906 18:30:03.332106 8404 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0906 18:30:03.332125 8404 kic.go:194] Starting extracting preloaded images to volume ...
I0906 18:30:03.332208 8404 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19576-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-663433:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 -I lz4 -xf /preloaded.tar -C /extractDir
I0906 18:30:07.807659 8404 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19576-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-663433:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 -I lz4 -xf /preloaded.tar -C /extractDir: (4.475404799s)
I0906 18:30:07.807692 8404 kic.go:203] duration metric: took 4.475563455s to extract preloaded images to volume ...
W0906 18:30:07.807834 8404 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0906 18:30:07.807956 8404 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0906 18:30:07.861024 8404 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-663433 --name addons-663433 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-663433 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-663433 --network addons-663433 --ip 192.168.49.2 --volume addons-663433:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85
I0906 18:30:08.244847 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Running}}
I0906 18:30:08.263705 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:08.287262 8404 cli_runner.go:164] Run: docker exec addons-663433 stat /var/lib/dpkg/alternatives/iptables
I0906 18:30:08.355361 8404 oci.go:144] the created container "addons-663433" has a running status.
I0906 18:30:08.355398 8404 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa...
I0906 18:30:09.031130 8404 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0906 18:30:09.070457 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:09.093588 8404 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0906 18:30:09.093609 8404 kic_runner.go:114] Args: [docker exec --privileged addons-663433 chown docker:docker /home/docker/.ssh/authorized_keys]
I0906 18:30:09.159956 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:09.185501 8404 machine.go:93] provisionDockerMachine start ...
I0906 18:30:09.185586 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:09.204457 8404 main.go:141] libmachine: Using SSH client type: native
I0906 18:30:09.204746 8404 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0906 18:30:09.204761 8404 main.go:141] libmachine: About to run SSH command:
hostname
I0906 18:30:09.336105 8404 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-663433
I0906 18:30:09.336176 8404 ubuntu.go:169] provisioning hostname "addons-663433"
I0906 18:30:09.336269 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:09.359692 8404 main.go:141] libmachine: Using SSH client type: native
I0906 18:30:09.359946 8404 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0906 18:30:09.359957 8404 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-663433 && echo "addons-663433" | sudo tee /etc/hostname
I0906 18:30:09.501178 8404 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-663433
I0906 18:30:09.501266 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:09.519225 8404 main.go:141] libmachine: Using SSH client type: native
I0906 18:30:09.519467 8404 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0906 18:30:09.519484 8404 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-663433' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-663433/g' /etc/hosts;
else
echo '127.0.1.1 addons-663433' | sudo tee -a /etc/hosts;
fi
fi
I0906 18:30:09.636368 8404 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0906 18:30:09.636393 8404 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19576-2243/.minikube CaCertPath:/home/jenkins/minikube-integration/19576-2243/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19576-2243/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19576-2243/.minikube}
I0906 18:30:09.636422 8404 ubuntu.go:177] setting up certificates
I0906 18:30:09.636453 8404 provision.go:84] configureAuth start
I0906 18:30:09.636516 8404 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-663433
I0906 18:30:09.653795 8404 provision.go:143] copyHostCerts
I0906 18:30:09.653897 8404 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19576-2243/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19576-2243/.minikube/ca.pem (1078 bytes)
I0906 18:30:09.654022 8404 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19576-2243/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19576-2243/.minikube/cert.pem (1123 bytes)
I0906 18:30:09.654086 8404 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19576-2243/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19576-2243/.minikube/key.pem (1675 bytes)
I0906 18:30:09.654139 8404 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19576-2243/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19576-2243/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19576-2243/.minikube/certs/ca-key.pem org=jenkins.addons-663433 san=[127.0.0.1 192.168.49.2 addons-663433 localhost minikube]
I0906 18:30:10.008760 8404 provision.go:177] copyRemoteCerts
I0906 18:30:10.008850 8404 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0906 18:30:10.008937 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:10.044563 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:10.146818 8404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-2243/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0906 18:30:10.176654 8404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-2243/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0906 18:30:10.202916 8404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-2243/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0906 18:30:10.228169 8404 provision.go:87] duration metric: took 591.69934ms to configureAuth
I0906 18:30:10.228238 8404 ubuntu.go:193] setting minikube options for container-runtime
I0906 18:30:10.228483 8404 config.go:182] Loaded profile config "addons-663433": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0906 18:30:10.228498 8404 machine.go:96] duration metric: took 1.042979554s to provisionDockerMachine
I0906 18:30:10.228506 8404 client.go:171] duration metric: took 10.70860249s to LocalClient.Create
I0906 18:30:10.228522 8404 start.go:167] duration metric: took 10.708664407s to libmachine.API.Create "addons-663433"
I0906 18:30:10.228530 8404 start.go:293] postStartSetup for "addons-663433" (driver="docker")
I0906 18:30:10.228539 8404 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0906 18:30:10.228594 8404 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0906 18:30:10.228633 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:10.246030 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:10.337403 8404 ssh_runner.go:195] Run: cat /etc/os-release
I0906 18:30:10.340525 8404 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0906 18:30:10.340560 8404 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0906 18:30:10.340572 8404 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0906 18:30:10.340584 8404 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0906 18:30:10.340594 8404 filesync.go:126] Scanning /home/jenkins/minikube-integration/19576-2243/.minikube/addons for local assets ...
I0906 18:30:10.340671 8404 filesync.go:126] Scanning /home/jenkins/minikube-integration/19576-2243/.minikube/files for local assets ...
I0906 18:30:10.340695 8404 start.go:296] duration metric: took 112.159607ms for postStartSetup
I0906 18:30:10.341018 8404 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-663433
I0906 18:30:10.357443 8404 profile.go:143] Saving config to /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/config.json ...
I0906 18:30:10.357745 8404 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0906 18:30:10.357795 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:10.373935 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:10.461097 8404 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0906 18:30:10.465620 8404 start.go:128] duration metric: took 10.948098934s to createHost
I0906 18:30:10.465642 8404 start.go:83] releasing machines lock for "addons-663433", held for 10.948230816s
I0906 18:30:10.465718 8404 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-663433
I0906 18:30:10.482684 8404 ssh_runner.go:195] Run: cat /version.json
I0906 18:30:10.482735 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:10.482979 8404 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0906 18:30:10.483042 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:10.500966 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:10.504127 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:10.710402 8404 ssh_runner.go:195] Run: systemctl --version
I0906 18:30:10.714696 8404 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0906 18:30:10.718718 8404 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0906 18:30:10.744153 8404 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0906 18:30:10.744228 8404 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0906 18:30:10.773689 8404 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0906 18:30:10.773723 8404 start.go:495] detecting cgroup driver to use...
I0906 18:30:10.773757 8404 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0906 18:30:10.773810 8404 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0906 18:30:10.786221 8404 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0906 18:30:10.797774 8404 docker.go:217] disabling cri-docker service (if available) ...
I0906 18:30:10.797840 8404 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0906 18:30:10.811675 8404 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0906 18:30:10.826323 8404 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0906 18:30:10.910041 8404 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0906 18:30:11.005951 8404 docker.go:233] disabling docker service ...
I0906 18:30:11.006061 8404 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0906 18:30:11.031089 8404 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0906 18:30:11.045419 8404 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0906 18:30:11.133441 8404 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0906 18:30:11.224611 8404 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0906 18:30:11.236294 8404 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0906 18:30:11.252197 8404 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0906 18:30:11.261451 8404 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0906 18:30:11.271358 8404 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0906 18:30:11.271439 8404 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0906 18:30:11.281530 8404 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0906 18:30:11.291488 8404 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0906 18:30:11.300969 8404 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0906 18:30:11.310450 8404 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0906 18:30:11.319783 8404 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0906 18:30:11.329315 8404 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0906 18:30:11.338831 8404 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0906 18:30:11.348475 8404 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0906 18:30:11.357017 8404 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0906 18:30:11.365475 8404 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0906 18:30:11.451877 8404 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0906 18:30:11.585107 8404 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0906 18:30:11.585243 8404 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0906 18:30:11.588851 8404 start.go:563] Will wait 60s for crictl version
I0906 18:30:11.588956 8404 ssh_runner.go:195] Run: which crictl
I0906 18:30:11.592164 8404 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0906 18:30:11.633305 8404 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.21
RuntimeApiVersion: v1
I0906 18:30:11.633449 8404 ssh_runner.go:195] Run: containerd --version
I0906 18:30:11.655037 8404 ssh_runner.go:195] Run: containerd --version
I0906 18:30:11.679260 8404 out.go:177] * Preparing Kubernetes v1.31.0 on containerd 1.7.21 ...
I0906 18:30:11.680930 8404 cli_runner.go:164] Run: docker network inspect addons-663433 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0906 18:30:11.704892 8404 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0906 18:30:11.708320 8404 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0906 18:30:11.718846 8404 kubeadm.go:883] updating cluster {Name:addons-663433 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-663433 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] D
NSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: Soc
ketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0906 18:30:11.718959 8404 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0906 18:30:11.719026 8404 ssh_runner.go:195] Run: sudo crictl images --output json
I0906 18:30:11.756137 8404 containerd.go:627] all images are preloaded for containerd runtime.
I0906 18:30:11.756157 8404 containerd.go:534] Images already preloaded, skipping extraction
I0906 18:30:11.756237 8404 ssh_runner.go:195] Run: sudo crictl images --output json
I0906 18:30:11.792226 8404 containerd.go:627] all images are preloaded for containerd runtime.
I0906 18:30:11.792245 8404 cache_images.go:84] Images are preloaded, skipping loading
I0906 18:30:11.792254 8404 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.0 containerd true true} ...
I0906 18:30:11.792356 8404 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-663433 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.0 ClusterName:addons-663433 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0906 18:30:11.792421 8404 ssh_runner.go:195] Run: sudo crictl info
I0906 18:30:11.832395 8404 cni.go:84] Creating CNI manager for ""
I0906 18:30:11.832414 8404 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0906 18:30:11.832446 8404 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0906 18:30:11.832469 8404 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-663433 NodeName:addons-663433 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0906 18:30:11.832601 8404 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-663433"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0906 18:30:11.832666 8404 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0
I0906 18:30:11.841640 8404 binaries.go:44] Found k8s binaries, skipping transfer
I0906 18:30:11.841719 8404 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0906 18:30:11.850504 8404 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0906 18:30:11.868794 8404 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0906 18:30:11.887036 8404 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0906 18:30:11.905102 8404 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0906 18:30:11.908352 8404 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0906 18:30:11.918969 8404 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0906 18:30:12.000581 8404 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0906 18:30:12.019851 8404 certs.go:68] Setting up /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433 for IP: 192.168.49.2
I0906 18:30:12.019927 8404 certs.go:194] generating shared ca certs ...
I0906 18:30:12.019959 8404 certs.go:226] acquiring lock for ca certs: {Name:mkecee9b61fe634f9c37a64b8e0f0f4431b3dfc1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 18:30:12.020163 8404 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19576-2243/.minikube/ca.key
I0906 18:30:12.141864 8404 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19576-2243/.minikube/ca.crt ...
I0906 18:30:12.141898 8404 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-2243/.minikube/ca.crt: {Name:mk9de33734b65cc7acaaacb6bd8a8ec6afb72442 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 18:30:12.142130 8404 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19576-2243/.minikube/ca.key ...
I0906 18:30:12.142146 8404 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-2243/.minikube/ca.key: {Name:mk0bc0615acb44a1f18193d015def0d75476785e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 18:30:12.142235 8404 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19576-2243/.minikube/proxy-client-ca.key
I0906 18:30:12.455645 8404 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19576-2243/.minikube/proxy-client-ca.crt ...
I0906 18:30:12.455674 8404 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-2243/.minikube/proxy-client-ca.crt: {Name:mk4dd3decc50b1db80fff0220c5d5c4fec7904e4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 18:30:12.455854 8404 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19576-2243/.minikube/proxy-client-ca.key ...
I0906 18:30:12.455868 8404 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-2243/.minikube/proxy-client-ca.key: {Name:mk5e62d01ac3507ef6d58d867b6df7b9d049011f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 18:30:12.455957 8404 certs.go:256] generating profile certs ...
I0906 18:30:12.456014 8404 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/client.key
I0906 18:30:12.456036 8404 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/client.crt with IP's: []
I0906 18:30:13.463080 8404 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/client.crt ...
I0906 18:30:13.463115 8404 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/client.crt: {Name:mkb0d20972088ea226fac2f9a798672aa7e81e90 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 18:30:13.463306 8404 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/client.key ...
I0906 18:30:13.463319 8404 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/client.key: {Name:mkccab469b7a9a7f636ea40ccaa6e7783aaf6e0e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 18:30:13.463404 8404 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/apiserver.key.5a5ebd75
I0906 18:30:13.463425 8404 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/apiserver.crt.5a5ebd75 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0906 18:30:13.934902 8404 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/apiserver.crt.5a5ebd75 ...
I0906 18:30:13.934938 8404 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/apiserver.crt.5a5ebd75: {Name:mk8cec109b80565cf177b527e72b35225e348e42 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 18:30:13.935124 8404 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/apiserver.key.5a5ebd75 ...
I0906 18:30:13.935140 8404 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/apiserver.key.5a5ebd75: {Name:mk7673ec75db71d7d80c529c3ca5323795b46339 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 18:30:13.935222 8404 certs.go:381] copying /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/apiserver.crt.5a5ebd75 -> /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/apiserver.crt
I0906 18:30:13.935298 8404 certs.go:385] copying /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/apiserver.key.5a5ebd75 -> /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/apiserver.key
I0906 18:30:13.935354 8404 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/proxy-client.key
I0906 18:30:13.935376 8404 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/proxy-client.crt with IP's: []
I0906 18:30:14.360548 8404 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/proxy-client.crt ...
I0906 18:30:14.360580 8404 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/proxy-client.crt: {Name:mkf06c8334f0ca2674ded8e276c885ba60ee374c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 18:30:14.360768 8404 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/proxy-client.key ...
I0906 18:30:14.360782 8404 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/proxy-client.key: {Name:mkd1415818505325f29f816ba22b10d5154c6c53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 18:30:14.360969 8404 certs.go:484] found cert: /home/jenkins/minikube-integration/19576-2243/.minikube/certs/ca-key.pem (1675 bytes)
I0906 18:30:14.361011 8404 certs.go:484] found cert: /home/jenkins/minikube-integration/19576-2243/.minikube/certs/ca.pem (1078 bytes)
I0906 18:30:14.361042 8404 certs.go:484] found cert: /home/jenkins/minikube-integration/19576-2243/.minikube/certs/cert.pem (1123 bytes)
I0906 18:30:14.361069 8404 certs.go:484] found cert: /home/jenkins/minikube-integration/19576-2243/.minikube/certs/key.pem (1675 bytes)
I0906 18:30:14.361673 8404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-2243/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0906 18:30:14.390685 8404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-2243/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0906 18:30:14.414870 8404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-2243/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0906 18:30:14.441123 8404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-2243/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0906 18:30:14.465130 8404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0906 18:30:14.489527 8404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0906 18:30:14.516513 8404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0906 18:30:14.541919 8404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-2243/.minikube/profiles/addons-663433/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0906 18:30:14.569959 8404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-2243/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0906 18:30:14.594863 8404 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0906 18:30:14.612857 8404 ssh_runner.go:195] Run: openssl version
I0906 18:30:14.618284 8404 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0906 18:30:14.627834 8404 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0906 18:30:14.631419 8404 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 6 18:30 /usr/share/ca-certificates/minikubeCA.pem
I0906 18:30:14.631484 8404 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0906 18:30:14.638344 8404 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0906 18:30:14.647884 8404 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0906 18:30:14.651028 8404 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0906 18:30:14.651074 8404 kubeadm.go:392] StartCluster: {Name:addons-663433 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-663433 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSD
omain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: Socket
VMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0906 18:30:14.651159 8404 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0906 18:30:14.651216 8404 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0906 18:30:14.687709 8404 cri.go:89] found id: ""
I0906 18:30:14.687779 8404 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0906 18:30:14.696983 8404 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0906 18:30:14.706395 8404 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0906 18:30:14.706503 8404 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0906 18:30:14.715324 8404 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0906 18:30:14.715344 8404 kubeadm.go:157] found existing configuration files:
I0906 18:30:14.715415 8404 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0906 18:30:14.724943 8404 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0906 18:30:14.725007 8404 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0906 18:30:14.733285 8404 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0906 18:30:14.742434 8404 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0906 18:30:14.742501 8404 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0906 18:30:14.751470 8404 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0906 18:30:14.760223 8404 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0906 18:30:14.760309 8404 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0906 18:30:14.769315 8404 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0906 18:30:14.778454 8404 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0906 18:30:14.778516 8404 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0906 18:30:14.786968 8404 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0906 18:30:14.828413 8404 kubeadm.go:310] W0906 18:30:14.827768 1025 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0906 18:30:14.829214 8404 kubeadm.go:310] W0906 18:30:14.828736 1025 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0906 18:30:14.851386 8404 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1068-aws\n", err: exit status 1
I0906 18:30:14.916928 8404 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0906 18:30:32.934333 8404 kubeadm.go:310] [init] Using Kubernetes version: v1.31.0
I0906 18:30:32.934394 8404 kubeadm.go:310] [preflight] Running pre-flight checks
I0906 18:30:32.934482 8404 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0906 18:30:32.934540 8404 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1068-aws[0m
I0906 18:30:32.934576 8404 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0906 18:30:32.934625 8404 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0906 18:30:32.934676 8404 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0906 18:30:32.934734 8404 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0906 18:30:32.934786 8404 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0906 18:30:32.934837 8404 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0906 18:30:32.934889 8404 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0906 18:30:32.934937 8404 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0906 18:30:32.934986 8404 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0906 18:30:32.935036 8404 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0906 18:30:32.935108 8404 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0906 18:30:32.935206 8404 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0906 18:30:32.935296 8404 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0906 18:30:32.935359 8404 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0906 18:30:32.937653 8404 out.go:235] - Generating certificates and keys ...
I0906 18:30:32.937746 8404 kubeadm.go:310] [certs] Using existing ca certificate authority
I0906 18:30:32.937819 8404 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0906 18:30:32.937909 8404 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0906 18:30:32.937970 8404 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0906 18:30:32.938040 8404 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0906 18:30:32.938106 8404 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0906 18:30:32.938163 8404 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0906 18:30:32.938291 8404 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-663433 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0906 18:30:32.938366 8404 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0906 18:30:32.938490 8404 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-663433 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0906 18:30:32.938586 8404 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0906 18:30:32.938677 8404 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0906 18:30:32.938732 8404 kubeadm.go:310] [certs] Generating "sa" key and public key
I0906 18:30:32.938806 8404 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0906 18:30:32.938856 8404 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0906 18:30:32.938911 8404 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0906 18:30:32.938977 8404 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0906 18:30:32.939059 8404 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0906 18:30:32.939118 8404 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0906 18:30:32.939201 8404 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0906 18:30:32.939312 8404 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0906 18:30:32.942970 8404 out.go:235] - Booting up control plane ...
I0906 18:30:32.943103 8404 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0906 18:30:32.943202 8404 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0906 18:30:32.943281 8404 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0906 18:30:32.943393 8404 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0906 18:30:32.943487 8404 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0906 18:30:32.943532 8404 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0906 18:30:32.943670 8404 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0906 18:30:32.943784 8404 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0906 18:30:32.943849 8404 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.501617443s
I0906 18:30:32.943926 8404 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0906 18:30:32.943989 8404 kubeadm.go:310] [api-check] The API server is healthy after 6.501429354s
I0906 18:30:32.944102 8404 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0906 18:30:32.944235 8404 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0906 18:30:32.944298 8404 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0906 18:30:32.944544 8404 kubeadm.go:310] [mark-control-plane] Marking the node addons-663433 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0906 18:30:32.944608 8404 kubeadm.go:310] [bootstrap-token] Using token: vgvso8.qrt82sa195l4l3t2
I0906 18:30:32.946794 8404 out.go:235] - Configuring RBAC rules ...
I0906 18:30:32.946933 8404 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0906 18:30:32.947020 8404 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0906 18:30:32.947171 8404 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0906 18:30:32.947398 8404 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0906 18:30:32.947523 8404 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0906 18:30:32.947619 8404 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0906 18:30:32.947746 8404 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0906 18:30:32.947789 8404 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0906 18:30:32.947847 8404 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0906 18:30:32.947852 8404 kubeadm.go:310]
I0906 18:30:32.947931 8404 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0906 18:30:32.947950 8404 kubeadm.go:310]
I0906 18:30:32.948026 8404 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0906 18:30:32.948036 8404 kubeadm.go:310]
I0906 18:30:32.948062 8404 kubeadm.go:310] mkdir -p $HOME/.kube
I0906 18:30:32.948135 8404 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0906 18:30:32.948189 8404 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0906 18:30:32.948193 8404 kubeadm.go:310]
I0906 18:30:32.948257 8404 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0906 18:30:32.948272 8404 kubeadm.go:310]
I0906 18:30:32.948341 8404 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0906 18:30:32.948349 8404 kubeadm.go:310]
I0906 18:30:32.948407 8404 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0906 18:30:32.948505 8404 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0906 18:30:32.948587 8404 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0906 18:30:32.948615 8404 kubeadm.go:310]
I0906 18:30:32.948705 8404 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0906 18:30:32.948786 8404 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0906 18:30:32.948793 8404 kubeadm.go:310]
I0906 18:30:32.948883 8404 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token vgvso8.qrt82sa195l4l3t2 \
I0906 18:30:32.948986 8404 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:3e70934fcf4233cfe3d6812e6403cbdb3820fe68f517883d6e328191b36dbf1b \
I0906 18:30:32.949013 8404 kubeadm.go:310] --control-plane
I0906 18:30:32.949020 8404 kubeadm.go:310]
I0906 18:30:32.949103 8404 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0906 18:30:32.949114 8404 kubeadm.go:310]
I0906 18:30:32.949199 8404 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token vgvso8.qrt82sa195l4l3t2 \
I0906 18:30:32.949315 8404 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:3e70934fcf4233cfe3d6812e6403cbdb3820fe68f517883d6e328191b36dbf1b
I0906 18:30:32.949327 8404 cni.go:84] Creating CNI manager for ""
I0906 18:30:32.949334 8404 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0906 18:30:32.951296 8404 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0906 18:30:32.953665 8404 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0906 18:30:32.957600 8404 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.0/kubectl ...
I0906 18:30:32.957624 8404 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0906 18:30:32.976321 8404 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0906 18:30:33.274191 8404 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0906 18:30:33.274321 8404 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0906 18:30:33.274416 8404 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-663433 minikube.k8s.io/updated_at=2024_09_06T18_30_33_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=e6b6435971a63e36b5096cd544634422129cef13 minikube.k8s.io/name=addons-663433 minikube.k8s.io/primary=true
I0906 18:30:33.435452 8404 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0906 18:30:33.435512 8404 ops.go:34] apiserver oom_adj: -16
I0906 18:30:33.936550 8404 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0906 18:30:34.435599 8404 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0906 18:30:34.936389 8404 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0906 18:30:35.435687 8404 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0906 18:30:35.935855 8404 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0906 18:30:36.436131 8404 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0906 18:30:36.935729 8404 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0906 18:30:37.436331 8404 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0906 18:30:37.936111 8404 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0906 18:30:38.080340 8404 kubeadm.go:1113] duration metric: took 4.806060876s to wait for elevateKubeSystemPrivileges
I0906 18:30:38.080367 8404 kubeadm.go:394] duration metric: took 23.429296531s to StartCluster
I0906 18:30:38.080383 8404 settings.go:142] acquiring lock: {Name:mk987d84b6291c2a933905b01eee0e827729a585 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 18:30:38.080582 8404 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19576-2243/kubeconfig
I0906 18:30:38.081018 8404 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-2243/kubeconfig: {Name:mkdfa45d714bcc81f89171296a3ba179305fec36 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 18:30:38.081219 8404 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0906 18:30:38.081246 8404 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0906 18:30:38.081624 8404 config.go:182] Loaded profile config "addons-663433": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0906 18:30:38.081686 8404 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0906 18:30:38.081773 8404 addons.go:69] Setting yakd=true in profile "addons-663433"
I0906 18:30:38.081803 8404 addons.go:234] Setting addon yakd=true in "addons-663433"
I0906 18:30:38.081834 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.082457 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.082945 8404 addons.go:69] Setting metrics-server=true in profile "addons-663433"
I0906 18:30:38.082981 8404 addons.go:234] Setting addon metrics-server=true in "addons-663433"
I0906 18:30:38.083019 8404 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-663433"
I0906 18:30:38.083044 8404 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-663433"
I0906 18:30:38.083074 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.083496 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.083626 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.084128 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.084972 8404 addons.go:69] Setting registry=true in profile "addons-663433"
I0906 18:30:38.085024 8404 addons.go:234] Setting addon registry=true in "addons-663433"
I0906 18:30:38.085060 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.085539 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.086032 8404 addons.go:69] Setting storage-provisioner=true in profile "addons-663433"
I0906 18:30:38.086064 8404 addons.go:234] Setting addon storage-provisioner=true in "addons-663433"
I0906 18:30:38.086124 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.086650 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.092873 8404 addons.go:69] Setting cloud-spanner=true in profile "addons-663433"
I0906 18:30:38.092921 8404 addons.go:234] Setting addon cloud-spanner=true in "addons-663433"
I0906 18:30:38.092961 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.093418 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.093593 8404 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-663433"
I0906 18:30:38.093620 8404 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-663433"
I0906 18:30:38.093898 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.104940 8404 addons.go:69] Setting volcano=true in profile "addons-663433"
I0906 18:30:38.104994 8404 addons.go:234] Setting addon volcano=true in "addons-663433"
I0906 18:30:38.105032 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.105526 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.108666 8404 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-663433"
I0906 18:30:38.117189 8404 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-663433"
I0906 18:30:38.117294 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.117884 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.112310 8404 addons.go:69] Setting default-storageclass=true in profile "addons-663433"
I0906 18:30:38.121670 8404 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-663433"
I0906 18:30:38.112358 8404 addons.go:69] Setting gcp-auth=true in profile "addons-663433"
I0906 18:30:38.112383 8404 addons.go:69] Setting ingress=true in profile "addons-663433"
I0906 18:30:38.112392 8404 addons.go:69] Setting ingress-dns=true in profile "addons-663433"
I0906 18:30:38.112397 8404 addons.go:69] Setting inspektor-gadget=true in profile "addons-663433"
I0906 18:30:38.112408 8404 out.go:177] * Verifying Kubernetes components...
I0906 18:30:38.136949 8404 addons.go:69] Setting volumesnapshots=true in profile "addons-663433"
I0906 18:30:38.136990 8404 addons.go:234] Setting addon volumesnapshots=true in "addons-663433"
I0906 18:30:38.137027 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.137722 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.148570 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.160722 8404 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0906 18:30:38.181262 8404 addons.go:234] Setting addon ingress-dns=true in "addons-663433"
I0906 18:30:38.181376 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.181983 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.187457 8404 addons.go:234] Setting addon inspektor-gadget=true in "addons-663433"
I0906 18:30:38.187569 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.195741 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.211820 8404 mustload.go:65] Loading cluster: addons-663433
I0906 18:30:38.212081 8404 config.go:182] Loaded profile config "addons-663433": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0906 18:30:38.212391 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.250028 8404 addons.go:234] Setting addon ingress=true in "addons-663433"
I0906 18:30:38.250137 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.250593 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.274405 8404 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0906 18:30:38.276659 8404 out.go:177] - Using image docker.io/registry:2.8.3
I0906 18:30:38.278342 8404 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0906 18:30:38.278497 8404 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0906 18:30:38.290531 8404 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0906 18:30:38.295028 8404 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0906 18:30:38.295088 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0906 18:30:38.295169 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:38.300674 8404 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0906 18:30:38.300738 8404 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0906 18:30:38.300891 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:38.304309 8404 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0906 18:30:38.304331 8404 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0906 18:30:38.304397 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:38.305436 8404 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0906 18:30:38.309003 8404 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0906 18:30:38.311051 8404 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0906 18:30:38.314156 8404 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0906 18:30:38.314181 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0906 18:30:38.314249 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:38.340646 8404 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0906 18:30:38.340668 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0906 18:30:38.340726 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:38.342688 8404 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0906 18:30:38.344655 8404 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0906 18:30:38.344677 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0906 18:30:38.344745 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:38.376952 8404 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0906 18:30:38.379573 8404 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0906 18:30:38.382075 8404 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0906 18:30:38.385942 8404 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0906 18:30:38.388506 8404 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0906 18:30:38.388977 8404 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0906 18:30:38.388999 8404 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0906 18:30:38.389179 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:38.391464 8404 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-663433"
I0906 18:30:38.391554 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.392203 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.399662 8404 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0906 18:30:38.399683 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0906 18:30:38.399800 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:38.405777 8404 addons.go:234] Setting addon default-storageclass=true in "addons-663433"
I0906 18:30:38.405820 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.406443 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:38.438094 8404 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0906 18:30:38.443347 8404 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0906 18:30:38.446600 8404 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0906 18:30:38.454349 8404 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0906 18:30:38.454378 8404 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0906 18:30:38.454445 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:38.463804 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:38.463818 8404 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0906 18:30:38.465900 8404 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0906 18:30:38.475945 8404 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0906 18:30:38.475969 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0906 18:30:38.476032 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:38.476711 8404 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0906 18:30:38.479023 8404 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0906 18:30:38.492968 8404 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0906 18:30:38.492993 8404 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0906 18:30:38.493098 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:38.519735 8404 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0906 18:30:38.524600 8404 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0906 18:30:38.526726 8404 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0906 18:30:38.531864 8404 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0906 18:30:38.531885 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0906 18:30:38.531949 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:38.549912 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:38.568127 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:38.572625 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:38.614194 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:38.639441 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:38.649241 8404 out.go:177] - Using image docker.io/busybox:stable
I0906 18:30:38.652375 8404 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0906 18:30:38.654242 8404 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0906 18:30:38.654264 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0906 18:30:38.655919 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:38.664900 8404 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0906 18:30:38.664921 8404 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0906 18:30:38.664979 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:38.680037 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:38.680410 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:38.680899 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:38.684396 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:38.695704 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:38.753419 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:38.753523 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:38.774932 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:38.775317 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:38.816222 8404 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0906 18:30:38.816316 8404 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0906 18:30:39.229872 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0906 18:30:39.233612 8404 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0906 18:30:39.233640 8404 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0906 18:30:39.249134 8404 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0906 18:30:39.249166 8404 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0906 18:30:39.313857 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0906 18:30:39.368597 8404 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0906 18:30:39.368636 8404 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0906 18:30:39.372757 8404 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0906 18:30:39.372777 8404 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0906 18:30:39.464994 8404 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0906 18:30:39.465017 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0906 18:30:39.474175 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0906 18:30:39.476259 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0906 18:30:39.491763 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0906 18:30:39.502154 8404 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0906 18:30:39.502228 8404 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0906 18:30:39.517650 8404 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0906 18:30:39.517698 8404 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0906 18:30:39.551196 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0906 18:30:39.591699 8404 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0906 18:30:39.591725 8404 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0906 18:30:39.659518 8404 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0906 18:30:39.659549 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0906 18:30:39.664956 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0906 18:30:39.672046 8404 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0906 18:30:39.672071 8404 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0906 18:30:39.686095 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0906 18:30:39.691743 8404 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0906 18:30:39.691769 8404 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0906 18:30:39.754638 8404 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0906 18:30:39.754665 8404 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0906 18:30:39.816608 8404 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0906 18:30:39.816635 8404 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0906 18:30:39.819233 8404 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0906 18:30:39.819265 8404 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0906 18:30:39.939589 8404 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0906 18:30:39.939631 8404 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0906 18:30:39.942624 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0906 18:30:39.975025 8404 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0906 18:30:39.975060 8404 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0906 18:30:40.038717 8404 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0906 18:30:40.038746 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0906 18:30:40.208895 8404 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0906 18:30:40.208922 8404 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0906 18:30:40.252678 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0906 18:30:40.349902 8404 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0906 18:30:40.349945 8404 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0906 18:30:40.409976 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0906 18:30:40.532477 8404 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0906 18:30:40.532515 8404 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0906 18:30:40.543418 8404 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0906 18:30:40.543445 8404 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0906 18:30:40.802917 8404 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0906 18:30:40.802943 8404 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0906 18:30:40.826811 8404 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0906 18:30:40.826834 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0906 18:30:40.888264 8404 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0906 18:30:40.888305 8404 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0906 18:30:41.072728 8404 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0906 18:30:41.072752 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0906 18:30:41.167645 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0906 18:30:41.231265 8404 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0906 18:30:41.231291 8404 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0906 18:30:41.244820 8404 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.428480073s)
I0906 18:30:41.244871 8404 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.428626412s)
I0906 18:30:41.244883 8404 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0906 18:30:41.245037 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.015133256s)
I0906 18:30:41.246439 8404 node_ready.go:35] waiting up to 6m0s for node "addons-663433" to be "Ready" ...
I0906 18:30:41.255325 8404 node_ready.go:49] node "addons-663433" has status "Ready":"True"
I0906 18:30:41.255354 8404 node_ready.go:38] duration metric: took 8.884593ms for node "addons-663433" to be "Ready" ...
I0906 18:30:41.255365 8404 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0906 18:30:41.291918 8404 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-hmcbm" in "kube-system" namespace to be "Ready" ...
I0906 18:30:41.527358 8404 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0906 18:30:41.527383 8404 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0906 18:30:41.602614 8404 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0906 18:30:41.602639 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0906 18:30:41.750895 8404 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-663433" context rescaled to 1 replicas
I0906 18:30:41.847378 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0906 18:30:42.028633 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (2.714730759s)
I0906 18:30:42.120577 8404 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0906 18:30:42.120613 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0906 18:30:42.481649 8404 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0906 18:30:42.481674 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0906 18:30:42.822318 8404 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0906 18:30:42.822344 8404 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0906 18:30:43.119424 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0906 18:30:43.313497 8404 pod_ready.go:103] pod "coredns-6f6b679f8f-hmcbm" in "kube-system" namespace has status "Ready":"False"
I0906 18:30:45.684191 8404 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0906 18:30:45.684268 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:45.715288 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:45.904022 8404 pod_ready.go:103] pod "coredns-6f6b679f8f-hmcbm" in "kube-system" namespace has status "Ready":"False"
I0906 18:30:46.230835 8404 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0906 18:30:46.249202 8404 addons.go:234] Setting addon gcp-auth=true in "addons-663433"
I0906 18:30:46.249253 8404 host.go:66] Checking if "addons-663433" exists ...
I0906 18:30:46.249701 8404 cli_runner.go:164] Run: docker container inspect addons-663433 --format={{.State.Status}}
I0906 18:30:46.273897 8404 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0906 18:30:46.273963 8404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-663433
I0906 18:30:46.302619 8404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19576-2243/.minikube/machines/addons-663433/id_rsa Username:docker}
I0906 18:30:48.384026 8404 pod_ready.go:103] pod "coredns-6f6b679f8f-hmcbm" in "kube-system" namespace has status "Ready":"False"
I0906 18:30:49.039199 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (9.564979366s)
I0906 18:30:49.039327 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (9.563005384s)
I0906 18:30:49.039462 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (9.547628693s)
I0906 18:30:49.039495 8404 addons.go:475] Verifying addon ingress=true in "addons-663433"
I0906 18:30:49.039854 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (9.488624462s)
I0906 18:30:49.039949 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (9.374971541s)
I0906 18:30:49.040027 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (9.353896694s)
I0906 18:30:49.040222 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (9.097572637s)
I0906 18:30:49.040246 8404 addons.go:475] Verifying addon registry=true in "addons-663433"
I0906 18:30:49.040411 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.787701652s)
I0906 18:30:49.040439 8404 addons.go:475] Verifying addon metrics-server=true in "addons-663433"
I0906 18:30:49.040483 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (8.630483096s)
I0906 18:30:49.040848 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.873166298s)
W0906 18:30:49.041306 8404 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0906 18:30:49.041332 8404 retry.go:31] will retry after 302.498734ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0906 18:30:49.040911 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (7.193506433s)
I0906 18:30:49.041713 8404 out.go:177] * Verifying ingress addon...
I0906 18:30:49.043059 8404 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-663433 service yakd-dashboard -n yakd-dashboard
I0906 18:30:49.043098 8404 out.go:177] * Verifying registry addon...
I0906 18:30:49.045186 8404 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0906 18:30:49.048005 8404 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0906 18:30:49.103273 8404 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0906 18:30:49.103300 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:49.104547 8404 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0906 18:30:49.104569 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:49.344677 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0906 18:30:49.556023 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:49.556931 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:49.809346 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.689812074s)
I0906 18:30:49.809385 8404 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-663433"
I0906 18:30:49.809647 8404 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.535726057s)
I0906 18:30:49.812123 8404 out.go:177] * Verifying csi-hostpath-driver addon...
I0906 18:30:49.812161 8404 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0906 18:30:49.818771 8404 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0906 18:30:49.819486 8404 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0906 18:30:49.821338 8404 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0906 18:30:49.821394 8404 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0906 18:30:49.828382 8404 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0906 18:30:49.828524 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:49.879702 8404 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0906 18:30:49.879744 8404 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0906 18:30:49.949442 8404 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0906 18:30:49.949466 8404 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0906 18:30:50.021150 8404 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0906 18:30:50.061667 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:50.063359 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:50.326578 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:50.549786 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:50.552979 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:50.798505 8404 pod_ready.go:103] pod "coredns-6f6b679f8f-hmcbm" in "kube-system" namespace has status "Ready":"False"
I0906 18:30:50.824927 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:50.853017 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.508241892s)
I0906 18:30:51.053081 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:51.071552 8404 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.050352752s)
I0906 18:30:51.074810 8404 addons.go:475] Verifying addon gcp-auth=true in "addons-663433"
I0906 18:30:51.077404 8404 out.go:177] * Verifying gcp-auth addon...
I0906 18:30:51.080984 8404 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0906 18:30:51.152548 8404 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0906 18:30:51.153982 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:51.326056 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:51.550423 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:51.552534 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:51.825147 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:52.057053 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:52.061730 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:52.325427 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:52.550130 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:52.553486 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:52.800333 8404 pod_ready.go:103] pod "coredns-6f6b679f8f-hmcbm" in "kube-system" namespace has status "Ready":"False"
I0906 18:30:52.826185 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:53.049862 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:53.052416 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:53.326152 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:53.552489 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:53.560053 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:53.824385 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:54.053401 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:54.057204 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:54.328054 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:54.551981 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:54.553806 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:54.825003 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:55.092062 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:55.092616 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:55.299250 8404 pod_ready.go:103] pod "coredns-6f6b679f8f-hmcbm" in "kube-system" namespace has status "Ready":"False"
I0906 18:30:55.328673 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:55.556227 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:55.558128 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:55.824162 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:56.050018 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:56.051792 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:56.326448 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:56.552506 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:56.553965 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:56.824058 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:57.052210 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:57.055618 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:57.326409 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:57.550781 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:57.552732 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:57.798294 8404 pod_ready.go:103] pod "coredns-6f6b679f8f-hmcbm" in "kube-system" namespace has status "Ready":"False"
I0906 18:30:57.825612 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:58.051799 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:58.054585 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:58.324790 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:58.550288 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:58.552455 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:58.824163 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:59.050302 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:59.052059 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:59.324001 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:30:59.555727 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:30:59.557634 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:30:59.798403 8404 pod_ready.go:103] pod "coredns-6f6b679f8f-hmcbm" in "kube-system" namespace has status "Ready":"False"
I0906 18:30:59.825775 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:00.061835 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:00.065006 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:00.381057 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:00.549980 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:00.554155 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:00.825472 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:01.051262 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:01.053813 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:01.325525 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:01.553627 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:01.558169 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:01.800184 8404 pod_ready.go:103] pod "coredns-6f6b679f8f-hmcbm" in "kube-system" namespace has status "Ready":"False"
I0906 18:31:01.826051 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:02.056278 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:02.057549 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:02.325433 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:02.550601 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:02.553803 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:02.824910 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:03.051261 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:03.054671 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:03.324502 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:03.549098 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:03.552521 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:03.824497 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:04.050392 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:04.052621 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:04.299097 8404 pod_ready.go:103] pod "coredns-6f6b679f8f-hmcbm" in "kube-system" namespace has status "Ready":"False"
I0906 18:31:04.324824 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:04.552472 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:04.554536 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:04.828581 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:05.055373 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:05.064706 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:05.323935 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:05.549084 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:05.552725 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:05.799319 8404 pod_ready.go:93] pod "coredns-6f6b679f8f-hmcbm" in "kube-system" namespace has status "Ready":"True"
I0906 18:31:05.799389 8404 pod_ready.go:82] duration metric: took 24.507435854s for pod "coredns-6f6b679f8f-hmcbm" in "kube-system" namespace to be "Ready" ...
I0906 18:31:05.799417 8404 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-pbkgn" in "kube-system" namespace to be "Ready" ...
I0906 18:31:05.801826 8404 pod_ready.go:98] error getting pod "coredns-6f6b679f8f-pbkgn" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-pbkgn" not found
I0906 18:31:05.801854 8404 pod_ready.go:82] duration metric: took 2.409873ms for pod "coredns-6f6b679f8f-pbkgn" in "kube-system" namespace to be "Ready" ...
E0906 18:31:05.801894 8404 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-6f6b679f8f-pbkgn" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-pbkgn" not found
I0906 18:31:05.801908 8404 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-663433" in "kube-system" namespace to be "Ready" ...
I0906 18:31:05.807831 8404 pod_ready.go:93] pod "etcd-addons-663433" in "kube-system" namespace has status "Ready":"True"
I0906 18:31:05.807859 8404 pod_ready.go:82] duration metric: took 5.941124ms for pod "etcd-addons-663433" in "kube-system" namespace to be "Ready" ...
I0906 18:31:05.807874 8404 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-663433" in "kube-system" namespace to be "Ready" ...
I0906 18:31:05.814621 8404 pod_ready.go:93] pod "kube-apiserver-addons-663433" in "kube-system" namespace has status "Ready":"True"
I0906 18:31:05.814657 8404 pod_ready.go:82] duration metric: took 6.748388ms for pod "kube-apiserver-addons-663433" in "kube-system" namespace to be "Ready" ...
I0906 18:31:05.814688 8404 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-663433" in "kube-system" namespace to be "Ready" ...
I0906 18:31:05.821751 8404 pod_ready.go:93] pod "kube-controller-manager-addons-663433" in "kube-system" namespace has status "Ready":"True"
I0906 18:31:05.821782 8404 pod_ready.go:82] duration metric: took 7.077361ms for pod "kube-controller-manager-addons-663433" in "kube-system" namespace to be "Ready" ...
I0906 18:31:05.821795 8404 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-sxwfw" in "kube-system" namespace to be "Ready" ...
I0906 18:31:05.830224 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:05.996867 8404 pod_ready.go:93] pod "kube-proxy-sxwfw" in "kube-system" namespace has status "Ready":"True"
I0906 18:31:05.996893 8404 pod_ready.go:82] duration metric: took 175.073895ms for pod "kube-proxy-sxwfw" in "kube-system" namespace to be "Ready" ...
I0906 18:31:05.996905 8404 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-663433" in "kube-system" namespace to be "Ready" ...
I0906 18:31:06.058611 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:06.060796 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:06.335375 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:06.396566 8404 pod_ready.go:93] pod "kube-scheduler-addons-663433" in "kube-system" namespace has status "Ready":"True"
I0906 18:31:06.396592 8404 pod_ready.go:82] duration metric: took 399.679146ms for pod "kube-scheduler-addons-663433" in "kube-system" namespace to be "Ready" ...
I0906 18:31:06.396602 8404 pod_ready.go:39] duration metric: took 25.14122442s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0906 18:31:06.396617 8404 api_server.go:52] waiting for apiserver process to appear ...
I0906 18:31:06.396680 8404 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0906 18:31:06.410853 8404 api_server.go:72] duration metric: took 28.329580077s to wait for apiserver process to appear ...
I0906 18:31:06.410881 8404 api_server.go:88] waiting for apiserver healthz status ...
I0906 18:31:06.410901 8404 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0906 18:31:06.419049 8404 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0906 18:31:06.420007 8404 api_server.go:141] control plane version: v1.31.0
I0906 18:31:06.420032 8404 api_server.go:131] duration metric: took 9.143821ms to wait for apiserver health ...
I0906 18:31:06.420041 8404 system_pods.go:43] waiting for kube-system pods to appear ...
I0906 18:31:06.549385 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:06.551544 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:06.603769 8404 system_pods.go:59] 18 kube-system pods found
I0906 18:31:06.603857 8404 system_pods.go:61] "coredns-6f6b679f8f-hmcbm" [26228436-d79a-4076-b250-e182190de691] Running
I0906 18:31:06.603875 8404 system_pods.go:61] "csi-hostpath-attacher-0" [e5715893-2855-4a31-99a5-f1cca7249f48] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0906 18:31:06.603884 8404 system_pods.go:61] "csi-hostpath-resizer-0" [46dc9d17-db0a-44aa-b242-574a62883d93] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0906 18:31:06.603896 8404 system_pods.go:61] "csi-hostpathplugin-zbfgn" [bcdaf2c1-3b51-4a7d-bfcf-eacbe2574810] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0906 18:31:06.603902 8404 system_pods.go:61] "etcd-addons-663433" [6c759c3f-ce71-4631-803a-baefbe9b1f01] Running
I0906 18:31:06.603915 8404 system_pods.go:61] "kindnet-fhj4d" [51b5e270-e337-466e-a560-38ad5a66d052] Running
I0906 18:31:06.603919 8404 system_pods.go:61] "kube-apiserver-addons-663433" [2fe8bc4c-4e9c-43d0-ab0f-bdd29a815e65] Running
I0906 18:31:06.603923 8404 system_pods.go:61] "kube-controller-manager-addons-663433" [d0a7b1e4-017f-41a6-8327-16c1ad00c1af] Running
I0906 18:31:06.603927 8404 system_pods.go:61] "kube-ingress-dns-minikube" [c692d8a4-0702-4e97-8ec4-9d89209895d9] Running
I0906 18:31:06.603931 8404 system_pods.go:61] "kube-proxy-sxwfw" [3f9bf514-e2a1-4e2d-950b-f7c589abfeb9] Running
I0906 18:31:06.603935 8404 system_pods.go:61] "kube-scheduler-addons-663433" [bd451a12-9231-4fe5-b3a6-e0d9d0867e9d] Running
I0906 18:31:06.603942 8404 system_pods.go:61] "metrics-server-84c5f94fbc-8t4sb" [7f4455d9-98c4-4e73-a397-db01404c289b] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0906 18:31:06.603953 8404 system_pods.go:61] "nvidia-device-plugin-daemonset-2qpzm" [7d6ff840-2efe-49b7-a74d-10e6df066685] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0906 18:31:06.603959 8404 system_pods.go:61] "registry-6fb4cdfc84-f8b5k" [26e1baf1-1b46-42bf-a4e7-b02a3ee2ca41] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0906 18:31:06.603970 8404 system_pods.go:61] "registry-proxy-mhbhh" [9fe29033-57ef-4d7d-917e-044ec00706a3] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0906 18:31:06.603976 8404 system_pods.go:61] "snapshot-controller-56fcc65765-n54gm" [1810833e-9a32-4693-b262-b9ea28499187] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0906 18:31:06.603985 8404 system_pods.go:61] "snapshot-controller-56fcc65765-vtq6w" [b82e242a-6437-4df5-97bb-e56e5fbca8d2] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0906 18:31:06.603990 8404 system_pods.go:61] "storage-provisioner" [3a6515a1-2d21-444d-a495-9e965ae45660] Running
I0906 18:31:06.603998 8404 system_pods.go:74] duration metric: took 183.951885ms to wait for pod list to return data ...
I0906 18:31:06.604008 8404 default_sa.go:34] waiting for default service account to be created ...
I0906 18:31:06.796128 8404 default_sa.go:45] found service account: "default"
I0906 18:31:06.796153 8404 default_sa.go:55] duration metric: took 192.138678ms for default service account to be created ...
I0906 18:31:06.796164 8404 system_pods.go:116] waiting for k8s-apps to be running ...
I0906 18:31:06.824838 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:07.002852 8404 system_pods.go:86] 18 kube-system pods found
I0906 18:31:07.002892 8404 system_pods.go:89] "coredns-6f6b679f8f-hmcbm" [26228436-d79a-4076-b250-e182190de691] Running
I0906 18:31:07.002903 8404 system_pods.go:89] "csi-hostpath-attacher-0" [e5715893-2855-4a31-99a5-f1cca7249f48] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0906 18:31:07.002910 8404 system_pods.go:89] "csi-hostpath-resizer-0" [46dc9d17-db0a-44aa-b242-574a62883d93] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0906 18:31:07.002919 8404 system_pods.go:89] "csi-hostpathplugin-zbfgn" [bcdaf2c1-3b51-4a7d-bfcf-eacbe2574810] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0906 18:31:07.002950 8404 system_pods.go:89] "etcd-addons-663433" [6c759c3f-ce71-4631-803a-baefbe9b1f01] Running
I0906 18:31:07.002962 8404 system_pods.go:89] "kindnet-fhj4d" [51b5e270-e337-466e-a560-38ad5a66d052] Running
I0906 18:31:07.002967 8404 system_pods.go:89] "kube-apiserver-addons-663433" [2fe8bc4c-4e9c-43d0-ab0f-bdd29a815e65] Running
I0906 18:31:07.002972 8404 system_pods.go:89] "kube-controller-manager-addons-663433" [d0a7b1e4-017f-41a6-8327-16c1ad00c1af] Running
I0906 18:31:07.002980 8404 system_pods.go:89] "kube-ingress-dns-minikube" [c692d8a4-0702-4e97-8ec4-9d89209895d9] Running
I0906 18:31:07.002984 8404 system_pods.go:89] "kube-proxy-sxwfw" [3f9bf514-e2a1-4e2d-950b-f7c589abfeb9] Running
I0906 18:31:07.002991 8404 system_pods.go:89] "kube-scheduler-addons-663433" [bd451a12-9231-4fe5-b3a6-e0d9d0867e9d] Running
I0906 18:31:07.002999 8404 system_pods.go:89] "metrics-server-84c5f94fbc-8t4sb" [7f4455d9-98c4-4e73-a397-db01404c289b] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0906 18:31:07.003003 8404 system_pods.go:89] "nvidia-device-plugin-daemonset-2qpzm" [7d6ff840-2efe-49b7-a74d-10e6df066685] Running
I0906 18:31:07.003026 8404 system_pods.go:89] "registry-6fb4cdfc84-f8b5k" [26e1baf1-1b46-42bf-a4e7-b02a3ee2ca41] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0906 18:31:07.003039 8404 system_pods.go:89] "registry-proxy-mhbhh" [9fe29033-57ef-4d7d-917e-044ec00706a3] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0906 18:31:07.003047 8404 system_pods.go:89] "snapshot-controller-56fcc65765-n54gm" [1810833e-9a32-4693-b262-b9ea28499187] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0906 18:31:07.003057 8404 system_pods.go:89] "snapshot-controller-56fcc65765-vtq6w" [b82e242a-6437-4df5-97bb-e56e5fbca8d2] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0906 18:31:07.003065 8404 system_pods.go:89] "storage-provisioner" [3a6515a1-2d21-444d-a495-9e965ae45660] Running
I0906 18:31:07.003076 8404 system_pods.go:126] duration metric: took 206.905916ms to wait for k8s-apps to be running ...
I0906 18:31:07.003084 8404 system_svc.go:44] waiting for kubelet service to be running ....
I0906 18:31:07.003158 8404 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0906 18:31:07.036961 8404 system_svc.go:56] duration metric: took 33.866977ms WaitForService to wait for kubelet
I0906 18:31:07.036996 8404 kubeadm.go:582] duration metric: took 28.95572667s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0906 18:31:07.037019 8404 node_conditions.go:102] verifying NodePressure condition ...
I0906 18:31:07.052778 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:07.054932 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:07.203257 8404 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0906 18:31:07.203353 8404 node_conditions.go:123] node cpu capacity is 2
I0906 18:31:07.203380 8404 node_conditions.go:105] duration metric: took 166.354883ms to run NodePressure ...
I0906 18:31:07.203409 8404 start.go:241] waiting for startup goroutines ...
I0906 18:31:07.324354 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:07.549674 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:07.551346 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:07.827073 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:08.053728 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:08.056368 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:08.324474 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:08.550038 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:08.552091 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:08.824873 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:09.054851 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:09.056222 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:09.324831 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:09.551599 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:09.552957 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:09.824495 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:10.109403 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:10.116948 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:10.324899 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:10.552515 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:10.553171 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:10.825191 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:11.050574 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:11.053942 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:11.324983 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:11.554041 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:11.563893 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:11.825014 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:12.054015 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:12.057163 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:12.325639 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:12.550696 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:12.554211 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:12.825550 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:13.049778 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:13.052835 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:13.325675 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:13.550455 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:13.553910 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:13.824873 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:14.049809 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:14.053077 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:14.323773 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:14.553512 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:14.555846 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:14.825034 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:15.076482 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:15.113006 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:15.324851 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:15.549687 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:15.551180 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:15.828860 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:16.053116 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:16.059827 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:16.325473 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:16.549901 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:16.551448 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:16.826831 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:17.051853 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:17.053165 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:17.326797 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:17.551227 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:17.552776 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:17.829418 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:18.052603 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:18.053915 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:18.325133 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:18.550346 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:18.552606 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0906 18:31:18.824354 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:19.050150 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:19.051928 8404 kapi.go:107] duration metric: took 30.003923855s to wait for kubernetes.io/minikube-addons=registry ...
I0906 18:31:19.324644 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:19.552048 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:19.833395 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:20.051794 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:20.327177 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:20.552100 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:20.829775 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:21.053151 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:21.324665 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:21.549754 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:21.824761 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:22.051264 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:22.324160 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:22.550316 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:22.824679 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:23.049547 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:23.326163 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:23.550638 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:23.825020 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:24.051421 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:24.325185 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:24.549706 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:24.826421 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:25.053788 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:25.324481 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:25.549615 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:25.826525 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:26.050316 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:26.326483 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:26.550835 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:26.830834 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:27.053259 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:27.323671 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:27.549992 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:27.832508 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:28.050210 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:28.326658 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:28.550625 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:28.829289 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:29.050341 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:29.324105 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:29.550088 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:29.827482 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:30.061370 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:30.325490 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:30.549730 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:30.824015 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:31.050463 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:31.326024 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:31.550060 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:31.825690 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:32.050389 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:32.323878 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:32.549738 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:32.826173 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:33.052034 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:33.324738 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:33.549709 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:33.824862 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:34.053464 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:34.325488 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:34.550777 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:34.824261 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:35.053029 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:35.325619 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:35.550159 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:35.824343 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:36.049846 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:36.325025 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:36.550420 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:36.825262 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:37.050882 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:37.324393 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:37.550393 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:37.825237 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:38.055992 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:38.324799 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:38.553960 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:38.826408 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:39.050777 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:39.324225 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:39.549871 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:39.825381 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:40.060160 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:40.325195 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:40.550411 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:40.826481 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:41.051208 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:41.324297 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:41.552243 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:41.824859 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0906 18:31:42.052500 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:42.325081 8404 kapi.go:107] duration metric: took 52.505594245s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0906 18:31:42.549522 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:43.051025 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:43.549748 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:44.050838 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:44.549606 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:45.062566 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:45.549400 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:46.049158 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:46.549363 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:47.050393 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:47.549464 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:48.060808 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:48.549957 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:49.050566 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:49.549160 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:50.074320 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:50.550063 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:51.051842 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:51.549571 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:52.051599 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:52.552988 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:53.049817 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:53.549824 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:54.060184 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:54.552310 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:55.076070 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:55.553919 8404 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0906 18:31:56.059399 8404 kapi.go:107] duration metric: took 1m7.014192786s to wait for app.kubernetes.io/name=ingress-nginx ...
I0906 18:32:14.105646 8404 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0906 18:32:14.105667 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:14.584553 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:15.089135 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:15.585958 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:16.084593 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:16.584157 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:17.084870 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:17.585625 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:18.085445 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:18.584008 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:19.084599 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:19.584519 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:20.089944 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:20.584059 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:21.085320 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:21.585674 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:22.085632 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:22.588663 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:23.084694 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:23.585223 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:24.085715 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:24.585322 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:25.084150 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:25.585293 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:26.085134 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:26.584227 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:27.084960 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:27.585014 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:28.085627 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:28.584561 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:29.084080 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:29.585007 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:30.085742 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:30.584179 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:31.084822 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:31.585618 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:32.084714 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:32.584015 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:33.085424 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:33.585471 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:34.084883 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:34.584660 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:35.084771 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:35.584582 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:36.084681 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:36.584167 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:37.085329 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:37.585116 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:38.085545 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:38.584089 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:39.084525 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:39.585346 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:40.090378 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:40.584046 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:41.084721 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:41.586873 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:42.085517 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:42.584937 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:43.085136 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:43.585291 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:44.084918 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:44.584634 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:45.109751 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:45.584357 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:46.084680 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:46.584172 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:47.084673 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:47.584769 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:48.084977 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:48.584420 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:49.085024 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:49.584977 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:50.084788 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:50.584376 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:51.085575 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:51.586669 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:52.085958 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:52.584882 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:53.084546 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:53.584961 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:54.084969 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:54.585030 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:55.090747 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:55.585012 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:56.085116 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:56.584324 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:57.084980 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:57.586397 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:58.084526 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:58.584271 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:59.084376 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:32:59.585435 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:00.085826 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:00.584563 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:01.085466 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:01.586200 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:02.085025 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:02.584929 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:03.085099 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:03.584603 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:04.085028 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:04.585059 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:05.085300 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:05.585189 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:06.084873 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:06.584224 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:07.084758 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:07.585629 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:08.085253 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:08.585293 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:09.085022 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:09.584648 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:10.108153 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:10.584861 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:11.084191 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:11.592270 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:12.085986 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:12.585168 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:13.085161 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:13.585202 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:14.084904 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:14.584712 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:15.089873 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:15.584267 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:16.084866 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:16.584333 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:17.084459 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:17.584824 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:18.086754 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:18.584565 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:19.084527 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:19.584529 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:20.090601 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:20.584210 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:21.085066 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:21.587011 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:22.085254 8404 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0906 18:33:22.584526 8404 kapi.go:107] duration metric: took 2m31.503541357s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0906 18:33:22.586544 8404 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-663433 cluster.
I0906 18:33:22.588513 8404 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0906 18:33:22.590327 8404 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0906 18:33:22.592051 8404 out.go:177] * Enabled addons: default-storageclass, ingress-dns, volcano, nvidia-device-plugin, storage-provisioner, cloud-spanner, metrics-server, inspektor-gadget, yakd, storage-provisioner-rancher, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
I0906 18:33:22.593861 8404 addons.go:510] duration metric: took 2m44.512180223s for enable addons: enabled=[default-storageclass ingress-dns volcano nvidia-device-plugin storage-provisioner cloud-spanner metrics-server inspektor-gadget yakd storage-provisioner-rancher volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
I0906 18:33:22.593906 8404 start.go:246] waiting for cluster config update ...
I0906 18:33:22.593926 8404 start.go:255] writing updated cluster config ...
I0906 18:33:22.594195 8404 ssh_runner.go:195] Run: rm -f paused
I0906 18:33:22.925411 8404 start.go:600] kubectl: 1.31.0, cluster: 1.31.0 (minor skew: 0)
I0906 18:33:22.927341 8404 out.go:177] * Done! kubectl is now configured to use "addons-663433" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
ab9291d384a4b 4f725bf50aaa5 2 minutes ago Exited gadget 5 d258cd187df4e gadget-c7f72
3097820fe6b83 6ef582f3ec844 3 minutes ago Running gcp-auth 0 298335b8ec820 gcp-auth-89d5ffd79-cjd9f
0133a153386b7 8b46b1cd48760 4 minutes ago Running admission 0 91d5dd23a2535 volcano-admission-77d7d48b68-mx4tr
f4c93440b9201 289a818c8d9c5 4 minutes ago Running controller 0 41ac83e513747 ingress-nginx-controller-bc57996ff-bqhdx
db03e541c3f5f ee6d597e62dc8 4 minutes ago Running csi-snapshotter 0 4f842b8c1f0eb csi-hostpathplugin-zbfgn
1b157df9469e9 420193b27261a 5 minutes ago Exited patch 2 96c5c8063fd6f ingress-nginx-admission-patch-r8p5w
5daa66bbf18dc 642ded511e141 5 minutes ago Running csi-provisioner 0 4f842b8c1f0eb csi-hostpathplugin-zbfgn
f75f44130714e 922312104da8a 5 minutes ago Running liveness-probe 0 4f842b8c1f0eb csi-hostpathplugin-zbfgn
4786de8b4e3b6 08f6b2990811a 5 minutes ago Running hostpath 0 4f842b8c1f0eb csi-hostpathplugin-zbfgn
a47579427037d 0107d56dbc0be 5 minutes ago Running node-driver-registrar 0 4f842b8c1f0eb csi-hostpathplugin-zbfgn
2a7d703250114 d9c7ad4c226bf 5 minutes ago Running volcano-scheduler 0 8fdb012f962db volcano-scheduler-576bc46687-2mczk
48eabf3e5235e 487fa743e1e22 5 minutes ago Running csi-resizer 0 de9ad3b00e743 csi-hostpath-resizer-0
07e860558d363 420193b27261a 5 minutes ago Exited create 0 b204cc628264a ingress-nginx-admission-create-bdsm6
6123e3953c93b 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 4f842b8c1f0eb csi-hostpathplugin-zbfgn
701a5dc65b9c5 1505f556b3a7b 5 minutes ago Running volcano-controllers 0 d67abb8d8562e volcano-controllers-56675bb4d5-47pmz
0baaf922d53eb 9a80d518f102c 5 minutes ago Running csi-attacher 0 94307f73e062b csi-hostpath-attacher-0
a59c0c7172a50 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 6141cd4201887 snapshot-controller-56fcc65765-n54gm
854d2e1a64994 5548a49bb60ba 5 minutes ago Running metrics-server 0 e2b6db26c48a4 metrics-server-84c5f94fbc-8t4sb
6f671b5555f3e 6fed88f43b276 5 minutes ago Running registry 0 af476ed3c85a5 registry-6fb4cdfc84-f8b5k
b4b0f39ddfc1c 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 1a260994f6660 snapshot-controller-56fcc65765-vtq6w
4afa5373ec1b1 7ce2150c8929b 5 minutes ago Running local-path-provisioner 0 d196b7daa02f7 local-path-provisioner-86d989889c-9pj4d
0c8a94c4eb1ff 77bdba588b953 5 minutes ago Running yakd 0 e1328928ab20b yakd-dashboard-67d98fc6b-ggxs9
7f22e8fbc2c1d 3410e1561990a 5 minutes ago Running registry-proxy 0 5ac1412013378 registry-proxy-mhbhh
46acb4bb2bd31 a9bac31a5be8d 5 minutes ago Running nvidia-device-plugin-ctr 0 5554cd545a859 nvidia-device-plugin-daemonset-2qpzm
a116951bd9df9 2437cf7621777 5 minutes ago Running coredns 0 d1fd71ac9c8cd coredns-6f6b679f8f-hmcbm
9a0e8a08c24ae 8be4bcf8ec607 5 minutes ago Running cloud-spanner-emulator 0 9e48d922173f6 cloud-spanner-emulator-769b77f747-snbcd
5f223276a9bd8 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 efc080cdaad07 kube-ingress-dns-minikube
3aa94d7e74a8a ba04bb24b9575 5 minutes ago Running storage-provisioner 0 7eb90679c04f1 storage-provisioner
f05250959fc29 6a23fa8fd2b78 6 minutes ago Running kindnet-cni 0 9a9930b92b8a1 kindnet-fhj4d
76a7321f00453 71d55d66fd4ee 6 minutes ago Running kube-proxy 0 a9b4c1e18c1a5 kube-proxy-sxwfw
1e5db3a1ca12e cd0f0ae0ec9e0 6 minutes ago Running kube-apiserver 0 0869f23964f46 kube-apiserver-addons-663433
ba192ab2d9de5 fcb0683e6bdbd 6 minutes ago Running kube-controller-manager 0 30ffa9a3825f7 kube-controller-manager-addons-663433
fe0ad024cb706 27e3830e14027 6 minutes ago Running etcd 0 6b1d6b5937fa0 etcd-addons-663433
aedd1bd565597 fbbbd428abb4d 6 minutes ago Running kube-scheduler 0 a7451f32a1c44 kube-scheduler-addons-663433
==> containerd <==
Sep 06 18:33:32 addons-663433 containerd[816]: time="2024-09-06T18:33:32.400349351Z" level=info msg="RemovePodSandbox \"52e9d29f0e84d814a5c6f10eaa45037b3be0df1f2efcd514c88003e9f7eaa6ef\" returns successfully"
Sep 06 18:34:28 addons-663433 containerd[816]: time="2024-09-06T18:34:28.320156584Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\""
Sep 06 18:34:28 addons-663433 containerd[816]: time="2024-09-06T18:34:28.438006944Z" level=info msg="ImageUpdate event name:\"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Sep 06 18:34:28 addons-663433 containerd[816]: time="2024-09-06T18:34:28.439582862Z" level=info msg="stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec: active requests=0, bytes read=89"
Sep 06 18:34:28 addons-663433 containerd[816]: time="2024-09-06T18:34:28.443224588Z" level=info msg="Pulled image \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" with image id \"sha256:4f725bf50aaa5c697fbb84c107e9c7a3766f0f85f514ffce712d03ee5f62e8dd\", repo tag \"\", repo digest \"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\", size \"72524105\" in 123.014325ms"
Sep 06 18:34:28 addons-663433 containerd[816]: time="2024-09-06T18:34:28.443396957Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" returns image reference \"sha256:4f725bf50aaa5c697fbb84c107e9c7a3766f0f85f514ffce712d03ee5f62e8dd\""
Sep 06 18:34:28 addons-663433 containerd[816]: time="2024-09-06T18:34:28.445948117Z" level=info msg="CreateContainer within sandbox \"d258cd187df4e64126e7089f6a286d63db730987430a6229ec3c329425adc4c1\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Sep 06 18:34:28 addons-663433 containerd[816]: time="2024-09-06T18:34:28.468006815Z" level=info msg="CreateContainer within sandbox \"d258cd187df4e64126e7089f6a286d63db730987430a6229ec3c329425adc4c1\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"ab9291d384a4bf12ce5b77c0e45c05002fd947f6d0a8c7f9ccb90b431d18756e\""
Sep 06 18:34:28 addons-663433 containerd[816]: time="2024-09-06T18:34:28.472105625Z" level=info msg="StartContainer for \"ab9291d384a4bf12ce5b77c0e45c05002fd947f6d0a8c7f9ccb90b431d18756e\""
Sep 06 18:34:28 addons-663433 containerd[816]: time="2024-09-06T18:34:28.533130513Z" level=info msg="StartContainer for \"ab9291d384a4bf12ce5b77c0e45c05002fd947f6d0a8c7f9ccb90b431d18756e\" returns successfully"
Sep 06 18:34:30 addons-663433 containerd[816]: time="2024-09-06T18:34:30.145772566Z" level=info msg="shim disconnected" id=ab9291d384a4bf12ce5b77c0e45c05002fd947f6d0a8c7f9ccb90b431d18756e namespace=k8s.io
Sep 06 18:34:30 addons-663433 containerd[816]: time="2024-09-06T18:34:30.145876864Z" level=warning msg="cleaning up after shim disconnected" id=ab9291d384a4bf12ce5b77c0e45c05002fd947f6d0a8c7f9ccb90b431d18756e namespace=k8s.io
Sep 06 18:34:30 addons-663433 containerd[816]: time="2024-09-06T18:34:30.145914633Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Sep 06 18:34:30 addons-663433 containerd[816]: time="2024-09-06T18:34:30.511526407Z" level=info msg="RemoveContainer for \"593af3a4cbcb7fb5793287b04e0a6b083980b6d2ba7acdf71b651b9efb83f701\""
Sep 06 18:34:30 addons-663433 containerd[816]: time="2024-09-06T18:34:30.520333551Z" level=info msg="RemoveContainer for \"593af3a4cbcb7fb5793287b04e0a6b083980b6d2ba7acdf71b651b9efb83f701\" returns successfully"
Sep 06 18:34:32 addons-663433 containerd[816]: time="2024-09-06T18:34:32.404021956Z" level=info msg="RemoveContainer for \"43b6664371501538a078964eca44fa852662ddaba667042ed84373d3a99dbdd1\""
Sep 06 18:34:32 addons-663433 containerd[816]: time="2024-09-06T18:34:32.411092497Z" level=info msg="RemoveContainer for \"43b6664371501538a078964eca44fa852662ddaba667042ed84373d3a99dbdd1\" returns successfully"
Sep 06 18:34:32 addons-663433 containerd[816]: time="2024-09-06T18:34:32.413222717Z" level=info msg="StopPodSandbox for \"7107e87afa54724938d7e5724491693f8d0a306e4cdaee398de2a745ab384315\""
Sep 06 18:34:32 addons-663433 containerd[816]: time="2024-09-06T18:34:32.420763701Z" level=info msg="TearDown network for sandbox \"7107e87afa54724938d7e5724491693f8d0a306e4cdaee398de2a745ab384315\" successfully"
Sep 06 18:34:32 addons-663433 containerd[816]: time="2024-09-06T18:34:32.420802586Z" level=info msg="StopPodSandbox for \"7107e87afa54724938d7e5724491693f8d0a306e4cdaee398de2a745ab384315\" returns successfully"
Sep 06 18:34:32 addons-663433 containerd[816]: time="2024-09-06T18:34:32.421310412Z" level=info msg="RemovePodSandbox for \"7107e87afa54724938d7e5724491693f8d0a306e4cdaee398de2a745ab384315\""
Sep 06 18:34:32 addons-663433 containerd[816]: time="2024-09-06T18:34:32.421351447Z" level=info msg="Forcibly stopping sandbox \"7107e87afa54724938d7e5724491693f8d0a306e4cdaee398de2a745ab384315\""
Sep 06 18:34:32 addons-663433 containerd[816]: time="2024-09-06T18:34:32.429064644Z" level=info msg="TearDown network for sandbox \"7107e87afa54724938d7e5724491693f8d0a306e4cdaee398de2a745ab384315\" successfully"
Sep 06 18:34:32 addons-663433 containerd[816]: time="2024-09-06T18:34:32.435161274Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"7107e87afa54724938d7e5724491693f8d0a306e4cdaee398de2a745ab384315\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Sep 06 18:34:32 addons-663433 containerd[816]: time="2024-09-06T18:34:32.435287250Z" level=info msg="RemovePodSandbox \"7107e87afa54724938d7e5724491693f8d0a306e4cdaee398de2a745ab384315\" returns successfully"
==> coredns [a116951bd9df9c5e19aff93150eb70c0c6a213e6882bd1beece75d800860f6b4] <==
[INFO] 10.244.0.3:45114 - 18266 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000032624s
[INFO] 10.244.0.3:44880 - 5604 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001487834s
[INFO] 10.244.0.3:44880 - 31206 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001028217s
[INFO] 10.244.0.3:53805 - 39976 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000052743s
[INFO] 10.244.0.3:53805 - 42542 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000038614s
[INFO] 10.244.0.3:56962 - 18517 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000106274s
[INFO] 10.244.0.3:56962 - 5462 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000171589s
[INFO] 10.244.0.3:53168 - 6740 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.00006382s
[INFO] 10.244.0.3:53168 - 21078 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000079985s
[INFO] 10.244.0.3:34050 - 20053 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000050216s
[INFO] 10.244.0.3:34050 - 23891 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000032657s
[INFO] 10.244.0.3:34630 - 60705 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001450951s
[INFO] 10.244.0.3:34630 - 57891 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001473368s
[INFO] 10.244.0.3:33501 - 62153 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000041633s
[INFO] 10.244.0.3:33501 - 60619 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000196015s
[INFO] 10.244.0.24:60121 - 25747 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000348552s
[INFO] 10.244.0.24:56521 - 47365 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.001058991s
[INFO] 10.244.0.24:53384 - 4655 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000142985s
[INFO] 10.244.0.24:48549 - 10937 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000118255s
[INFO] 10.244.0.24:46153 - 40634 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000109615s
[INFO] 10.244.0.24:54153 - 54733 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000124007s
[INFO] 10.244.0.24:45997 - 14352 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002173311s
[INFO] 10.244.0.24:32954 - 12156 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002062704s
[INFO] 10.244.0.24:50700 - 45915 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001670507s
[INFO] 10.244.0.24:60224 - 18726 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 572 0.001768602s
==> describe nodes <==
Name: addons-663433
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-663433
kubernetes.io/os=linux
minikube.k8s.io/commit=e6b6435971a63e36b5096cd544634422129cef13
minikube.k8s.io/name=addons-663433
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_06T18_30_33_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-663433
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-663433"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 06 Sep 2024 18:30:30 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-663433
AcquireTime: <unset>
RenewTime: Fri, 06 Sep 2024 18:36:39 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 06 Sep 2024 18:33:36 +0000 Fri, 06 Sep 2024 18:30:26 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 06 Sep 2024 18:33:36 +0000 Fri, 06 Sep 2024 18:30:26 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 06 Sep 2024 18:33:36 +0000 Fri, 06 Sep 2024 18:30:26 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 06 Sep 2024 18:33:36 +0000 Fri, 06 Sep 2024 18:30:30 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-663433
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
System Info:
Machine ID: d9eb6d5bed9c49b8a61742cb4f2cc58a
System UUID: 120b3255-efd9-4064-a9ac-5e7f560d0e42
Boot ID: 6d654be1-742f-4cf7-8c76-51d1d9beb0a5
Kernel Version: 5.15.0-1068-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.21
Kubelet Version: v1.31.0
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-769b77f747-snbcd 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
gadget gadget-c7f72 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
gcp-auth gcp-auth-89d5ffd79-cjd9f 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m27s
ingress-nginx ingress-nginx-controller-bc57996ff-bqhdx 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m55s
kube-system coredns-6f6b679f8f-hmcbm 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m4s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpathplugin-zbfgn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system etcd-addons-663433 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m9s
kube-system kindnet-fhj4d 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m4s
kube-system kube-apiserver-addons-663433 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m9s
kube-system kube-controller-manager-addons-663433 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m9s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
kube-system kube-proxy-sxwfw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m4s
kube-system kube-scheduler-addons-663433 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m9s
kube-system metrics-server-84c5f94fbc-8t4sb 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 5m57s
kube-system nvidia-device-plugin-daemonset-2qpzm 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
kube-system registry-6fb4cdfc84-f8b5k 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system registry-proxy-mhbhh 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system snapshot-controller-56fcc65765-n54gm 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
kube-system snapshot-controller-56fcc65765-vtq6w 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
local-path-storage local-path-provisioner-86d989889c-9pj4d 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
volcano-system volcano-admission-77d7d48b68-mx4tr 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
volcano-system volcano-controllers-56675bb4d5-47pmz 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
volcano-system volcano-scheduler-576bc46687-2mczk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
yakd-dashboard yakd-dashboard-67d98fc6b-ggxs9 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m58s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m2s kube-proxy
Normal NodeHasSufficientMemory 6m17s (x8 over 6m17s) kubelet Node addons-663433 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m17s (x7 over 6m17s) kubelet Node addons-663433 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m17s (x7 over 6m17s) kubelet Node addons-663433 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m17s kubelet Updated Node Allocatable limit across pods
Normal Starting 6m9s kubelet Starting kubelet.
Warning CgroupV1 6m9s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m9s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m9s kubelet Node addons-663433 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m9s kubelet Node addons-663433 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m9s kubelet Node addons-663433 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m5s node-controller Node addons-663433 event: Registered Node addons-663433 in Controller
==> dmesg <==
[Sep 6 18:17] ACPI: SRAT not present
[ +0.000000] ACPI: SRAT not present
[ +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
[ +0.014989] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ +0.469544] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.754529] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
[ +6.376876] kauditd_printk_skb: 36 callbacks suppressed
==> etcd [fe0ad024cb7061b7ad57ba8197d48ad65bb848db9d154d37f3830b431b602939] <==
{"level":"info","ts":"2024-09-06T18:30:25.691205Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-09-06T18:30:25.700960Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-09-06T18:30:25.701185Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-09-06T18:30:25.700718Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-06T18:30:25.702409Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-06T18:30:26.448475Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-09-06T18:30:26.448699Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-09-06T18:30:26.448799Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-09-06T18:30:26.448905Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-09-06T18:30:26.448979Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-06T18:30:26.449071Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-09-06T18:30:26.449156Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-06T18:30:26.452570Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-06T18:30:26.456673Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-663433 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-06T18:30:26.456951Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-06T18:30:26.458067Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-06T18:30:26.459262Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-09-06T18:30:26.460475Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-06T18:30:26.460936Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-06T18:30:26.461084Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-09-06T18:30:26.460546Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-06T18:30:26.464712Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-06T18:30:26.464888Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-06T18:30:26.465766Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-06T18:30:26.469549Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
==> gcp-auth [3097820fe6b839752bd2c90b441e2bf982d77528da78783b9e17e154db05612d] <==
2024/09/06 18:33:21 GCP Auth Webhook started!
2024/09/06 18:33:39 Ready to marshal response ...
2024/09/06 18:33:39 Ready to write response ...
2024/09/06 18:33:40 Ready to marshal response ...
2024/09/06 18:33:40 Ready to write response ...
==> kernel <==
18:36:41 up 19 min, 0 users, load average: 1.01, 0.95, 0.57
Linux addons-663433 5.15.0-1068-aws #74~20.04.1-Ubuntu SMP Tue Aug 6 19:45:17 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [f05250959fc293eeb332b4699e53ccbb173edb7c17f70eecbcd54a9699aefa19] <==
I0906 18:34:41.221804 1 main.go:299] handling current node
I0906 18:34:51.224612 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0906 18:34:51.224675 1 main.go:299] handling current node
I0906 18:35:01.230217 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0906 18:35:01.230253 1 main.go:299] handling current node
I0906 18:35:11.227972 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0906 18:35:11.228019 1 main.go:299] handling current node
I0906 18:35:21.228153 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0906 18:35:21.228196 1 main.go:299] handling current node
I0906 18:35:31.228129 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0906 18:35:31.228392 1 main.go:299] handling current node
I0906 18:35:41.220949 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0906 18:35:41.220996 1 main.go:299] handling current node
I0906 18:35:51.223288 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0906 18:35:51.223420 1 main.go:299] handling current node
I0906 18:36:01.221013 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0906 18:36:01.221051 1 main.go:299] handling current node
I0906 18:36:11.222900 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0906 18:36:11.222940 1 main.go:299] handling current node
I0906 18:36:21.228509 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0906 18:36:21.228542 1 main.go:299] handling current node
I0906 18:36:31.229524 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0906 18:36:31.229560 1 main.go:299] handling current node
I0906 18:36:41.220926 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0906 18:36:41.220967 1 main.go:299] handling current node
==> kube-apiserver [1e5db3a1ca12eb0732d9b566d032f0a3d9477d70bfcb7e779ad4b563e3b3943d] <==
W0906 18:31:51.049679 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.100.63.23:443: connect: connection refused
W0906 18:31:52.101067 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.100.63.23:443: connect: connection refused
W0906 18:31:53.184915 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.100.63.23:443: connect: connection refused
W0906 18:31:54.079015 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.186.38:443: connect: connection refused
E0906 18:31:54.079056 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.186.38:443: connect: connection refused" logger="UnhandledError"
W0906 18:31:54.080914 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.100.63.23:443: connect: connection refused
W0906 18:31:54.100746 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.186.38:443: connect: connection refused
E0906 18:31:54.100785 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.186.38:443: connect: connection refused" logger="UnhandledError"
W0906 18:31:54.102506 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.100.63.23:443: connect: connection refused
W0906 18:31:54.219320 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.100.63.23:443: connect: connection refused
W0906 18:31:55.274519 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.100.63.23:443: connect: connection refused
W0906 18:31:56.354037 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.100.63.23:443: connect: connection refused
W0906 18:31:57.454921 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.100.63.23:443: connect: connection refused
W0906 18:31:58.516723 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.100.63.23:443: connect: connection refused
W0906 18:31:59.534124 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.100.63.23:443: connect: connection refused
W0906 18:32:00.636348 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.100.63.23:443: connect: connection refused
W0906 18:32:01.723696 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.100.63.23:443: connect: connection refused
W0906 18:32:14.038026 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.186.38:443: connect: connection refused
E0906 18:32:14.038291 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.186.38:443: connect: connection refused" logger="UnhandledError"
W0906 18:32:54.092186 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.186.38:443: connect: connection refused
E0906 18:32:54.092231 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.186.38:443: connect: connection refused" logger="UnhandledError"
W0906 18:32:54.111958 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.186.38:443: connect: connection refused
E0906 18:32:54.112001 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.186.38:443: connect: connection refused" logger="UnhandledError"
I0906 18:33:39.474508 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0906 18:33:39.523434 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [ba192ab2d9de552586ee6afee81104e1637d6b4262d54250a6eff72e7a21ad36] <==
I0906 18:32:54.121105 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0906 18:32:54.125364 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0906 18:32:54.136304 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0906 18:32:54.136740 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0906 18:32:54.151853 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0906 18:32:54.156732 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0906 18:32:54.165359 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0906 18:32:55.177701 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0906 18:32:55.193655 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0906 18:32:56.292742 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0906 18:32:56.308347 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0906 18:32:57.299482 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0906 18:32:57.308844 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0906 18:32:57.316282 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0906 18:32:57.322657 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0906 18:32:57.332924 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0906 18:32:57.336052 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0906 18:33:22.325375 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="13.79161ms"
I0906 18:33:22.325974 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="43.866µs"
I0906 18:33:27.042634 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0906 18:33:27.046907 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0906 18:33:27.097568 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0906 18:33:27.098703 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0906 18:33:36.078089 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-663433"
I0906 18:33:39.195260 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
==> kube-proxy [76a7321f004530d3c73faa560da1ddd982a157def797898a5b06c3a582c83780] <==
I0906 18:30:39.077340 1 server_linux.go:66] "Using iptables proxy"
I0906 18:30:39.218810 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0906 18:30:39.218877 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0906 18:30:39.266357 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0906 18:30:39.266410 1 server_linux.go:169] "Using iptables Proxier"
I0906 18:30:39.269292 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0906 18:30:39.269943 1 server.go:483] "Version info" version="v1.31.0"
I0906 18:30:39.269971 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0906 18:30:39.286053 1 config.go:197] "Starting service config controller"
I0906 18:30:39.286089 1 shared_informer.go:313] Waiting for caches to sync for service config
I0906 18:30:39.286165 1 config.go:104] "Starting endpoint slice config controller"
I0906 18:30:39.286176 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0906 18:30:39.288249 1 config.go:326] "Starting node config controller"
I0906 18:30:39.288268 1 shared_informer.go:313] Waiting for caches to sync for node config
I0906 18:30:39.388559 1 shared_informer.go:320] Caches are synced for service config
I0906 18:30:39.388628 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0906 18:30:39.388678 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [aedd1bd565597b0c8c8bfb6760ba0b5fa5f7460ae23ab80814169ab51116b39d] <==
E0906 18:30:30.610462 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0906 18:30:30.609510 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0906 18:30:30.610691 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0906 18:30:30.609548 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0906 18:30:30.610900 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
E0906 18:30:30.611065 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0906 18:30:30.611557 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0906 18:30:30.611703 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0906 18:30:30.611861 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0906 18:30:30.611954 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0906 18:30:30.612128 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0906 18:30:30.612220 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0906 18:30:30.612400 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0906 18:30:30.612554 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0906 18:30:30.612862 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0906 18:30:30.613175 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0906 18:30:30.613040 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
W0906 18:30:30.613136 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0906 18:30:30.613528 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
E0906 18:30:30.613627 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0906 18:30:30.613863 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0906 18:30:30.614004 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0906 18:30:30.615336 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0906 18:30:30.615610 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
I0906 18:30:32.206785 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 06 18:34:32 addons-663433 kubelet[1507]: E0906 18:34:32.517591 1507 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-c7f72_gadget(b9684e75-d070-484a-88cc-d6beddb698b3)\"" pod="gadget/gadget-c7f72" podUID="b9684e75-d070-484a-88cc-d6beddb698b3"
Sep 06 18:34:39 addons-663433 kubelet[1507]: I0906 18:34:39.318743 1507 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-mhbhh" secret="" err="secret \"gcp-auth\" not found"
Sep 06 18:34:46 addons-663433 kubelet[1507]: I0906 18:34:46.318486 1507 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-2qpzm" secret="" err="secret \"gcp-auth\" not found"
Sep 06 18:34:47 addons-663433 kubelet[1507]: I0906 18:34:47.318944 1507 scope.go:117] "RemoveContainer" containerID="ab9291d384a4bf12ce5b77c0e45c05002fd947f6d0a8c7f9ccb90b431d18756e"
Sep 06 18:34:47 addons-663433 kubelet[1507]: E0906 18:34:47.319144 1507 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-c7f72_gadget(b9684e75-d070-484a-88cc-d6beddb698b3)\"" pod="gadget/gadget-c7f72" podUID="b9684e75-d070-484a-88cc-d6beddb698b3"
Sep 06 18:34:59 addons-663433 kubelet[1507]: I0906 18:34:59.318637 1507 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-6fb4cdfc84-f8b5k" secret="" err="secret \"gcp-auth\" not found"
Sep 06 18:35:01 addons-663433 kubelet[1507]: I0906 18:35:01.319219 1507 scope.go:117] "RemoveContainer" containerID="ab9291d384a4bf12ce5b77c0e45c05002fd947f6d0a8c7f9ccb90b431d18756e"
Sep 06 18:35:01 addons-663433 kubelet[1507]: E0906 18:35:01.319849 1507 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-c7f72_gadget(b9684e75-d070-484a-88cc-d6beddb698b3)\"" pod="gadget/gadget-c7f72" podUID="b9684e75-d070-484a-88cc-d6beddb698b3"
Sep 06 18:35:13 addons-663433 kubelet[1507]: I0906 18:35:13.318965 1507 scope.go:117] "RemoveContainer" containerID="ab9291d384a4bf12ce5b77c0e45c05002fd947f6d0a8c7f9ccb90b431d18756e"
Sep 06 18:35:13 addons-663433 kubelet[1507]: E0906 18:35:13.319193 1507 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-c7f72_gadget(b9684e75-d070-484a-88cc-d6beddb698b3)\"" pod="gadget/gadget-c7f72" podUID="b9684e75-d070-484a-88cc-d6beddb698b3"
Sep 06 18:35:26 addons-663433 kubelet[1507]: I0906 18:35:26.318883 1507 scope.go:117] "RemoveContainer" containerID="ab9291d384a4bf12ce5b77c0e45c05002fd947f6d0a8c7f9ccb90b431d18756e"
Sep 06 18:35:26 addons-663433 kubelet[1507]: E0906 18:35:26.319050 1507 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-c7f72_gadget(b9684e75-d070-484a-88cc-d6beddb698b3)\"" pod="gadget/gadget-c7f72" podUID="b9684e75-d070-484a-88cc-d6beddb698b3"
Sep 06 18:35:41 addons-663433 kubelet[1507]: I0906 18:35:41.318644 1507 scope.go:117] "RemoveContainer" containerID="ab9291d384a4bf12ce5b77c0e45c05002fd947f6d0a8c7f9ccb90b431d18756e"
Sep 06 18:35:41 addons-663433 kubelet[1507]: E0906 18:35:41.319339 1507 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-c7f72_gadget(b9684e75-d070-484a-88cc-d6beddb698b3)\"" pod="gadget/gadget-c7f72" podUID="b9684e75-d070-484a-88cc-d6beddb698b3"
Sep 06 18:35:47 addons-663433 kubelet[1507]: I0906 18:35:47.318906 1507 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-2qpzm" secret="" err="secret \"gcp-auth\" not found"
Sep 06 18:35:56 addons-663433 kubelet[1507]: I0906 18:35:56.319148 1507 scope.go:117] "RemoveContainer" containerID="ab9291d384a4bf12ce5b77c0e45c05002fd947f6d0a8c7f9ccb90b431d18756e"
Sep 06 18:35:56 addons-663433 kubelet[1507]: E0906 18:35:56.319331 1507 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-c7f72_gadget(b9684e75-d070-484a-88cc-d6beddb698b3)\"" pod="gadget/gadget-c7f72" podUID="b9684e75-d070-484a-88cc-d6beddb698b3"
Sep 06 18:36:02 addons-663433 kubelet[1507]: I0906 18:36:02.319755 1507 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-mhbhh" secret="" err="secret \"gcp-auth\" not found"
Sep 06 18:36:08 addons-663433 kubelet[1507]: I0906 18:36:08.320649 1507 scope.go:117] "RemoveContainer" containerID="ab9291d384a4bf12ce5b77c0e45c05002fd947f6d0a8c7f9ccb90b431d18756e"
Sep 06 18:36:08 addons-663433 kubelet[1507]: E0906 18:36:08.320862 1507 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-c7f72_gadget(b9684e75-d070-484a-88cc-d6beddb698b3)\"" pod="gadget/gadget-c7f72" podUID="b9684e75-d070-484a-88cc-d6beddb698b3"
Sep 06 18:36:20 addons-663433 kubelet[1507]: I0906 18:36:20.319500 1507 scope.go:117] "RemoveContainer" containerID="ab9291d384a4bf12ce5b77c0e45c05002fd947f6d0a8c7f9ccb90b431d18756e"
Sep 06 18:36:20 addons-663433 kubelet[1507]: E0906 18:36:20.319691 1507 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-c7f72_gadget(b9684e75-d070-484a-88cc-d6beddb698b3)\"" pod="gadget/gadget-c7f72" podUID="b9684e75-d070-484a-88cc-d6beddb698b3"
Sep 06 18:36:25 addons-663433 kubelet[1507]: I0906 18:36:25.318511 1507 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-6fb4cdfc84-f8b5k" secret="" err="secret \"gcp-auth\" not found"
Sep 06 18:36:34 addons-663433 kubelet[1507]: I0906 18:36:34.319205 1507 scope.go:117] "RemoveContainer" containerID="ab9291d384a4bf12ce5b77c0e45c05002fd947f6d0a8c7f9ccb90b431d18756e"
Sep 06 18:36:34 addons-663433 kubelet[1507]: E0906 18:36:34.319413 1507 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-c7f72_gadget(b9684e75-d070-484a-88cc-d6beddb698b3)\"" pod="gadget/gadget-c7f72" podUID="b9684e75-d070-484a-88cc-d6beddb698b3"
==> storage-provisioner [3aa94d7e74a8a3a9fb838c1947cc61330c121af9c99aefddca62c396012892a5] <==
I0906 18:30:44.360705 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0906 18:30:44.410552 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0906 18:30:44.410631 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0906 18:30:44.431751 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0906 18:30:44.431922 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-663433_eebfc44c-567f-43de-b03a-d6b2547cd2ef!
I0906 18:30:44.439682 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"62b99d9c-3ac5-45c4-ba24-30209dff6c89", APIVersion:"v1", ResourceVersion:"589", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-663433_eebfc44c-567f-43de-b03a-d6b2547cd2ef became leader
I0906 18:30:44.534716 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-663433_eebfc44c-567f-43de-b03a-d6b2547cd2ef!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-663433 -n addons-663433
helpers_test.go:261: (dbg) Run: kubectl --context addons-663433 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-bdsm6 ingress-nginx-admission-patch-r8p5w test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-663433 describe pod ingress-nginx-admission-create-bdsm6 ingress-nginx-admission-patch-r8p5w test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-663433 describe pod ingress-nginx-admission-create-bdsm6 ingress-nginx-admission-patch-r8p5w test-job-nginx-0: exit status 1 (95.840682ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-bdsm6" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-r8p5w" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-663433 describe pod ingress-nginx-admission-create-bdsm6 ingress-nginx-admission-patch-r8p5w test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (200.09s)