W1025 10:53:43.162] ************************************************************************** bootstrap.py is deprecated! test-infra oncall does not support any job still using bootstrap.py. Please migrate your job to podutils! https://github.com/kubernetes/test-infra/blob/master/prow/pod-utilities.md ************************************************************************** I1025 10:53:43.162] Args: --job=ci-kubernetes-charts-gce --service-account=/etc/service-account/service-account.json --upload=gs://kubernetes-jenkins/logs --timeout=200 --repo=github.com/helm/charts --root=/go/src --service-account=/etc/service-account/service-account.json --scenario=kubernetes_e2e -- --charts --check-leaked-resources --extract=ci/latest --gcp-node-image=gci --gcp-zone=us-central1-f --provider=gce --test=false --timeout=180m I1025 10:53:43.162] Bootstrap ci-kubernetes-charts-gce... I1025 10:53:43.165] Builder: 4d4b7881-16b0-11eb-b256-6ee25ea2e440 I1025 10:53:43.165] Image: gcr.io/k8s-testimages/kubekins-e2e:v20201021-a62ce8a-master I1025 10:53:43.165] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-kubernetes-charts-gce/1320317526055325696 I1025 10:53:43.166] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1025 10:53:43.942] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I1025 10:53:44.092] process 34 exited with code 0 after 0.0m I1025 10:53:44.092] Call: gcloud config get-value account I1025 10:53:44.866] process 47 exited with code 0 after 0.0m I1025 10:53:44.866] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I1025 10:53:44.867] Root: /go/src I1025 10:53:44.867] cd to /go/src I1025 10:53:44.867] Checkout: /go/src/github.com/helm/charts master to /go/src/github.com/helm/charts I1025 10:53:44.867] Call: git init github.com/helm/charts I1025 10:53:44.874] Initialized empty Git repository in /go/src/github.com/helm/charts/.git/ I1025 10:53:44.875] process 60 exited with code 0 after 0.0m I1025 10:53:44.875] Call: git config --local user.name 'K8S Bootstrap' I1025 10:53:44.880] process 61 exited with code 0 after 0.0m I1025 10:53:44.880] Call: git config --local user.email k8s_bootstrap@localhost I1025 10:53:44.884] process 62 exited with code 0 after 0.0m I1025 10:53:44.885] Call: git fetch --quiet --tags https://github.com/helm/charts master I1025 10:53:49.045] process 63 exited with code 0 after 0.1m I1025 10:53:49.045] Call: git checkout -B test FETCH_HEAD W1025 10:53:49.698] Switched to a new branch 'test' I1025 10:53:49.703] process 74 exited with code 0 after 0.0m I1025 10:53:49.704] Call: git show -s --format=format:%ct HEAD I1025 10:53:49.709] process 75 exited with code 0 after 0.0m I1025 10:53:49.710] Configure environment... I1025 10:53:49.710] Call: git show -s --format=format:%ct HEAD I1025 10:53:49.716] process 76 exited with code 0 after 0.0m I1025 10:53:49.717] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1025 10:53:50.545] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I1025 10:53:50.840] process 77 exited with code 0 after 0.0m I1025 10:53:50.840] Call: gcloud config get-value account I1025 10:53:51.704] process 90 exited with code 0 after 0.0m I1025 10:53:51.705] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I1025 10:53:51.706] Start 1320317526055325696 at unknown... I1025 10:53:51.709] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_gbZuHP gs://kubernetes-jenkins/logs/ci-kubernetes-charts-gce/1320317526055325696/started.json I1025 10:53:53.862] process 103 exited with code 0 after 0.0m I1025 10:53:53.863] Call: /workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py --charts --check-leaked-resources --extract=ci/latest --gcp-node-image=gci --gcp-zone=us-central1-f --provider=gce --test=false --timeout=180m W1025 10:53:53.924] starts with local mode W1025 10:53:53.924] Environment: W1025 10:53:53.924] ARTIFACTS=/workspace/_artifacts W1025 10:53:53.925] AWS_SSH_PRIVATE_KEY_FILE=/root/.ssh/kube_aws_rsa W1025 10:53:53.925] AWS_SSH_PUBLIC_KEY_FILE=/root/.ssh/kube_aws_rsa.pub W1025 10:53:53.925] BAZEL_REMOTE_CACHE_ENABLED=false W1025 10:53:53.925] BAZEL_VERSION=2.2.0 W1025 10:53:53.925] BOOTSTRAP_MIGRATION=yes W1025 10:53:53.925] BOSKOS_METRICS_PORT=tcp://10.63.252.110:9090 W1025 10:53:53.926] BOSKOS_METRICS_PORT_9090_TCP=tcp://10.63.252.110:9090 W1025 10:53:53.926] BOSKOS_METRICS_PORT_9090_TCP_ADDR=10.63.252.110 W1025 10:53:53.926] BOSKOS_METRICS_PORT_9090_TCP_PORT=9090 W1025 10:53:53.926] BOSKOS_METRICS_PORT_9090_TCP_PROTO=tcp W1025 10:53:53.926] BOSKOS_METRICS_SERVICE_HOST=10.63.252.110 W1025 10:53:53.926] BOSKOS_METRICS_SERVICE_PORT=9090 W1025 10:53:53.927] BOSKOS_METRICS_SERVICE_PORT_METRICS=9090 W1025 10:53:53.927] BOSKOS_PORT=tcp://10.63.250.132:80 W1025 10:53:53.927] BOSKOS_PORT_80_TCP=tcp://10.63.250.132:80 W1025 10:53:53.927] BOSKOS_PORT_80_TCP_ADDR=10.63.250.132 W1025 10:53:53.927] BOSKOS_PORT_80_TCP_PORT=80 W1025 10:53:53.928] BOSKOS_PORT_80_TCP_PROTO=tcp W1025 10:53:53.928] BOSKOS_SERVICE_HOST=10.63.250.132 W1025 10:53:53.928] BOSKOS_SERVICE_PORT=80 W1025 10:53:53.928] BOSKOS_SERVICE_PORT_DEFAULT=80 W1025 10:53:53.928] BUILD_ID=1320317526055325696 W1025 10:53:53.928] BUILD_NUMBER=1320317526055325696 W1025 10:53:53.928] CI=true W1025 10:53:53.929] CLOUDSDK_COMPONENT_MANAGER_DISABLE_UPDATE_CHECK=true W1025 10:53:53.929] CLOUDSDK_CONFIG=/go/src/github.com/helm/charts/.config/gcloud W1025 10:53:53.929] CLOUDSDK_CORE_DISABLE_PROMPTS=1 W1025 10:53:53.929] CLOUDSDK_EXPERIMENTAL_FAST_COMPONENT_UPDATE=false W1025 10:53:53.930] DOCKER_IN_DOCKER_ENABLED=false W1025 10:53:53.930] DOCKER_IN_DOCKER_IPV6_ENABLED=false W1025 10:53:53.930] E2E_GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json W1025 10:53:53.931] GCS_ARTIFACTS_DIR=gs://kubernetes-jenkins/logs/ci-kubernetes-charts-gce/1320317526055325696/artifacts W1025 10:53:53.931] GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json W1025 10:53:53.931] GOOGLE_APPLICATION_CREDENTIALS_DEPRECATED=Migrate to workload identity, contact sig-testing W1025 10:53:53.932] GOPATH=/go W1025 10:53:53.932] GOPROXY=https://proxy.golang.org W1025 10:53:53.932] GO_TARBALL=go1.15.2.linux-amd64.tar.gz W1025 10:53:53.932] HOME=/workspace W1025 10:53:53.932] HOSTNAME=4d4b7881-16b0-11eb-b256-6ee25ea2e440 W1025 10:53:53.932] IMAGE=gcr.io/k8s-testimages/kubekins-e2e:v20201021-a62ce8a-master W1025 10:53:53.933] INSTANCE_PREFIX=bootstrap-e2e W1025 10:53:53.933] JENKINS_GCE_SSH_PRIVATE_KEY_FILE=/workspace/.ssh/google_compute_engine W1025 10:53:53.933] JENKINS_GCE_SSH_PUBLIC_KEY_FILE=/workspace/.ssh/google_compute_engine.pub W1025 10:53:53.933] JOB_NAME=ci-kubernetes-charts-gce W1025 10:53:53.933] JOB_SPEC={"type":"periodic","job":"ci-kubernetes-charts-gce","buildid":"1320317526055325696","prowjobid":"4d4b7881-16b0-11eb-b256-6ee25ea2e440"} W1025 10:53:53.934] JOB_TYPE=periodic W1025 10:53:53.934] KUBERNETES_PORT=tcp://10.63.240.1:443 W1025 10:53:53.934] KUBERNETES_PORT_443_TCP=tcp://10.63.240.1:443 W1025 10:53:53.934] KUBERNETES_PORT_443_TCP_ADDR=10.63.240.1 W1025 10:53:53.935] KUBERNETES_PORT_443_TCP_PORT=443 W1025 10:53:53.935] KUBERNETES_PORT_443_TCP_PROTO=tcp W1025 10:53:53.935] KUBERNETES_SERVICE_HOST=10.63.240.1 W1025 10:53:53.935] KUBERNETES_SERVICE_PORT=443 W1025 10:53:53.935] KUBERNETES_SERVICE_PORT_HTTPS=443 W1025 10:53:53.935] KUBETEST_IN_DOCKER=true W1025 10:53:53.936] KUBETEST_MANUAL_DUMP=y W1025 10:53:53.936] KUBE_AWS_INSTANCE_PREFIX=bootstrap-e2e W1025 10:53:53.936] KUBE_GCE_INSTANCE_PREFIX=bootstrap-e2e W1025 10:53:53.936] LOG_DUMP_SCRIPT_PATH=/workspace/log-dump.sh W1025 10:53:53.936] NODE_NAME=4d4b7881-16b0-11eb-b256-6ee25ea2e440 W1025 10:53:53.936] PATH=/go/bin:/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/workspace:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin W1025 10:53:53.937] PROW_JOB_ID=4d4b7881-16b0-11eb-b256-6ee25ea2e440 W1025 10:53:53.937] PWD=/workspace W1025 10:53:53.937] SHLVL=2 W1025 10:53:53.937] SOURCE_DATE_EPOCH=1603361254 W1025 10:53:53.937] TERM=xterm W1025 10:53:53.937] USER=prow W1025 10:53:53.937] WORKSPACE=/workspace W1025 10:53:53.938] _=./test-infra/jenkins/bootstrap.py W1025 10:53:53.938] Run: ('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--provider=gce', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--charts', '--check-leaked-resources', '--extract=ci/latest', '--gcp-node-image=gci', '--gcp-zone=us-central1-f', '--timeout=180m') W1025 10:53:53.956] 2020/10/25 10:53:53 Warning: Couldn't find directory src/sigs.k8s.io/cloud-provider-azure under any of GOPATH /go, defaulting to /go/src/k8s.io/cloud-provider-azure W1025 10:53:53.960] 2020/10/25 10:53:53 extract_k8s.go:112: Matched extraction strategy: ^ci/(.+)$ W1025 10:53:53.961] 2020/10/25 10:53:53 main.go:329: Limiting testing to 3h0m0s W1025 10:53:53.961] 2020/10/25 10:53:53 process.go:153: Running: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1025 10:53:54.728] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] W1025 10:53:54.877] 2020/10/25 10:53:54 process.go:155: Step 'gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json' finished in 916.921111ms W1025 10:53:54.878] 2020/10/25 10:53:54 main.go:728: --gcp-project is missing, trying to fetch a project from boskos. W1025 10:53:54.878] (for local runs please set --gcp-project to your dev project) W1025 10:53:54.878] 2020/10/25 10:53:54 main.go:740: provider gce, will acquire project type gce-project from boskos W1025 10:53:54.888] 2020/10/25 10:53:54 process.go:153: Running: gcloud config set project k8s-jkns-gce-soak-1-2 W1025 10:53:55.469] Updated property [core/project]. W1025 10:53:55.810] 2020/10/25 10:53:55 process.go:155: Step 'gcloud config set project k8s-jkns-gce-soak-1-2' finished in 921.955859ms W1025 10:53:55.811] 2020/10/25 10:53:55 main.go:779: Checking existing of GCP ssh keys... W1025 10:53:55.811] 2020/10/25 10:53:55 main.go:789: Checking presence of public key in k8s-jkns-gce-soak-1-2 W1025 10:53:55.812] 2020/10/25 10:53:55 process.go:153: Running: gcloud compute --project=k8s-jkns-gce-soak-1-2 project-info describe W1025 10:53:57.381] 2020/10/25 10:53:57 process.go:155: Step 'gcloud compute --project=k8s-jkns-gce-soak-1-2 project-info describe' finished in 1.570759799s W1025 10:53:57.469] 2020/10/25 10:53:57 extract_k8s.go:295: U=https://storage.googleapis.com/kubernetes-release-dev/ci R=v1.20.0-alpha.3.114+5935fcd704fe89 get-kube.sh W1025 10:53:57.470] 2020/10/25 10:53:57 process.go:153: Running: /workspace/get-kube.sh I1025 10:53:57.570] Downloading kubernetes release v1.20.0-alpha.3.114+5935fcd704fe89 I1025 10:53:57.571] from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.20.0-alpha.3.114+5935fcd704fe89/kubernetes.tar.gz I1025 10:53:57.571] to /go/src/github.com/helm/charts/kubernetes.tar.gz W1025 10:53:58.906] Copying gs://kubernetes-release-dev/ci/v1.20.0-alpha.3.114+5935fcd704fe89/kubernetes.tar.gz... W1025 10:53:59.029] / [0 files][ 0.0 B/487.6 KiB] / [1 files][487.6 KiB/487.6 KiB] W1025 10:53:59.030] Operation completed over 1 objects/487.6 KiB. I1025 10:53:59.350] Unpacking kubernetes release v1.20.0-alpha.3.114+5935fcd704fe89 I1025 10:53:59.426] Kubernetes release: v1.20.0-alpha.3.114+5935fcd704fe89 I1025 10:53:59.426] Server: linux/amd64 (to override, set KUBERNETES_SERVER_ARCH) I1025 10:53:59.427] Client: linux/amd64 (autodetected) (to override, set KUBERNETES_CLIENT_OS and/or KUBERNETES_CLIENT_ARCH) I1025 10:53:59.427] I1025 10:53:59.427] Will download kubernetes-server-linux-amd64.tar.gz from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.20.0-alpha.3.114+5935fcd704fe89 I1025 10:53:59.428] Will download and extract kubernetes-client-linux-amd64.tar.gz from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.20.0-alpha.3.114+5935fcd704fe89 I1025 10:53:59.428] Will download and extract kubernetes-test tarball(s) from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.20.0-alpha.3.114+5935fcd704fe89 W1025 10:54:00.956] Copying gs://kubernetes-release-dev/ci/v1.20.0-alpha.3.114+5935fcd704fe89/kubernetes-server-linux-amd64.tar.gz... W1025 10:54:00.960] / [0 files][ 0.0 B/502.2 MiB] ==> NOTE: You are downloading one or more large file(s), which would W1025 10:54:00.961] run significantly faster if you enabled sliced object downloads. This W1025 10:54:00.961] feature is enabled by default but requires that compiled crcmod be W1025 10:54:00.961] installed (see "gsutil help crcmod"). W1025 10:54:00.961] W1025 10:54:08.443] - - [0 files][ 74.8 MiB/502.2 MiB] \ | | [0 files][185.6 MiB/502.2 MiB] / / [0 files][279.2 MiB/502.2 MiB] - \ \ [0 files][374.3 MiB/502.2 MiB] | / / [0 files][463.3 MiB/502.2 MiB] / [1 files][502.2 MiB/502.2 MiB] - W1025 10:54:08.443] Operation completed over 1 objects/502.2 MiB. I1025 10:54:08.751] I1025 10:54:09.954] md5sum(kubernetes-server-linux-amd64.tar.gz)=b24185e1c269b81eaf8535934156c994 I1025 10:54:12.144] sha512sum(kubernetes-server-linux-amd64.tar.gz)=3dbaafa5dbddeaa308d3423091c8adf4cf022affd7893e8a5f6f1cd6c3bd5969d470511692cf93a79f60d374bd8d66cd1d265088c567f8ca8ca5709be161b5b2 I1025 10:54:12.144] W1025 10:54:13.507] Copying gs://kubernetes-release-dev/ci/v1.20.0-alpha.3.114+5935fcd704fe89/kubernetes-client-linux-amd64.tar.gz... W1025 10:54:13.981] / [0 files][ 0.0 B/ 22.7 MiB] / [1 files][ 22.7 MiB/ 22.7 MiB] W1025 10:54:13.982] Operation completed over 1 objects/22.7 MiB. I1025 10:54:14.263] I1025 10:54:14.324] md5sum(kubernetes-client-linux-amd64.tar.gz)=b3589af481f4436a1ebee67513b0d8de I1025 10:54:14.422] sha512sum(kubernetes-client-linux-amd64.tar.gz)=04aeb4a4f990505689861d66b1be085f64e6b9a6ccefd7d85f36cc9f8e3900a3fe3b6e64d524f928008727f5a65472a09613e7b635e75cc82a118a9213ca7d0b I1025 10:54:14.422] I1025 10:54:14.423] Extracting /go/src/github.com/helm/charts/kubernetes/client/kubernetes-client-linux-amd64.tar.gz into /go/src/github.com/helm/charts/kubernetes/platforms/linux/amd64 I1025 10:54:14.979] Add '/go/src/github.com/helm/charts/kubernetes/client/bin' to your PATH to use newly-installed binaries. W1025 10:54:16.480] Copying gs://kubernetes-release-dev/ci/v1.20.0-alpha.3.114+5935fcd704fe89/kubernetes-test-portable.tar.gz... W1025 10:54:16.580] / [0 files][ 0.0 B/219.8 KiB] / [1 files][219.8 KiB/219.8 KiB] W1025 10:54:16.581] Operation completed over 1 objects/219.8 KiB. I1025 10:54:16.888] I1025 10:54:16.894] md5sum(kubernetes-test-portable.tar.gz)=a167870eac14644a1d7fda4e717936da I1025 10:54:16.901] sha512sum(kubernetes-test-portable.tar.gz)=3d2a03914c52b8c35cf313b2317ccd71d22b4af5e5c4f079cfb7d205d332dbd1d449a5a8f326881f04be459846af3c67f5f9b6f18e58d6a6bada6438f4b1f2a4 I1025 10:54:16.901] I1025 10:54:16.901] Extracting kubernetes-test-portable.tar.gz into /go/src/github.com/helm/charts/kubernetes W1025 10:54:18.167] Copying gs://kubernetes-release-dev/ci/v1.20.0-alpha.3.114+5935fcd704fe89/kubernetes-test-linux-amd64.tar.gz... W1025 10:54:18.170] / [0 files][ 0.0 B/351.2 MiB] ==> NOTE: You are downloading one or more large file(s), which would W1025 10:54:18.170] run significantly faster if you enabled sliced object downloads. This W1025 10:54:18.170] feature is enabled by default but requires that compiled crcmod be W1025 10:54:18.170] installed (see "gsutil help crcmod"). W1025 10:54:18.171] W1025 10:54:23.557] - - [0 files][ 91.8 MiB/351.2 MiB] \ | | [0 files][188.5 MiB/351.2 MiB] / / [0 files][284.4 MiB/351.2 MiB] - \ \ [1 files][351.2 MiB/351.2 MiB] | W1025 10:54:23.557] Operation completed over 1 objects/351.2 MiB. I1025 10:54:23.860] I1025 10:54:24.734] md5sum(kubernetes-test-linux-amd64.tar.gz)=a95b81bc19c80260af1f11d7dbcecfb4 I1025 10:54:26.215] sha512sum(kubernetes-test-linux-amd64.tar.gz)=52bfb16bf072c239489323d095c49c539d38b511273578e03a6a79197e8c4ed1c8e2bdaa3545c72580b10104a94a765c00412c6a8d206dadec0b89b8378a429f I1025 10:54:26.215] I1025 10:54:26.216] Extracting /go/src/github.com/helm/charts/kubernetes/test/kubernetes-test-linux-amd64.tar.gz into /go/src/github.com/helm/charts/kubernetes/platforms/linux/amd64 W1025 10:54:35.673] 2020/10/25 10:54:35 process.go:155: Step '/workspace/get-kube.sh' finished in 38.203708472s W1025 10:54:35.674] 2020/10/25 10:54:35 process.go:153: Running: ./hack/e2e-internal/e2e-down.sh W1025 10:54:35.751] Project: k8s-jkns-gce-soak-1-2 W1025 10:54:35.751] Network Project: k8s-jkns-gce-soak-1-2 W1025 10:54:35.751] Zone: us-central1-f I1025 10:54:35.851] Shutting down test cluster in background. I1025 10:54:38.192] Bringing down cluster using provider: gce W1025 10:54:38.293] ... calling verify-prereqs W1025 10:54:38.930] ... calling verify-kube-binaries W1025 10:54:39.101] ... calling kube-down W1025 10:54:39.101] Project: k8s-jkns-gce-soak-1-2 W1025 10:54:39.102] Network Project: k8s-jkns-gce-soak-1-2 W1025 10:54:39.102] Zone: us-central1-f I1025 10:54:41.521] Bringing down cluster W1025 10:54:41.621] INSTANCE_GROUPS= W1025 10:54:41.622] NODE_NAMES= I1025 10:55:10.241] Deleting firewall rules remaining in network bootstrap-e2e: W1025 10:55:13.704] W1025 10:55:13.703941 1869 loader.go:223] Config not found: /workspace/.kube/config W1025 10:55:13.872] W1025 10:55:13.872367 1921 loader.go:223] Config not found: /workspace/.kube/config W1025 10:55:13.873] W1025 10:55:13.872667 1921 loader.go:223] Config not found: /workspace/.kube/config I1025 10:55:13.973] Property "clusters.k8s-jkns-gce-soak-1-2_bootstrap-e2e" unset. I1025 10:55:14.039] Property "users.k8s-jkns-gce-soak-1-2_bootstrap-e2e" unset. W1025 10:55:14.140] W1025 10:55:14.039340 1972 loader.go:223] Config not found: /workspace/.kube/config W1025 10:55:14.140] W1025 10:55:14.039555 1972 loader.go:223] Config not found: /workspace/.kube/config W1025 10:55:14.198] W1025 10:55:14.198162 2024 loader.go:223] Config not found: /workspace/.kube/config W1025 10:55:14.198] W1025 10:55:14.198362 2024 loader.go:223] Config not found: /workspace/.kube/config I1025 10:55:14.299] Property "users.k8s-jkns-gce-soak-1-2_bootstrap-e2e-basic-auth" unset. I1025 10:55:14.372] Property "contexts.k8s-jkns-gce-soak-1-2_bootstrap-e2e" unset. I1025 10:55:14.375] Cleared config for k8s-jkns-gce-soak-1-2_bootstrap-e2e from /workspace/.kube/config I1025 10:55:14.375] Done W1025 10:55:14.476] W1025 10:55:14.372010 2075 loader.go:223] Config not found: /workspace/.kube/config W1025 10:55:14.476] W1025 10:55:14.372192 2075 loader.go:223] Config not found: /workspace/.kube/config W1025 10:55:14.477] 2020/10/25 10:55:14 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 38.70374643s W1025 10:55:14.477] 2020/10/25 10:55:14 e2e.go:456: Listing resources... W1025 10:55:14.477] 2020/10/25 10:55:14 process.go:153: Running: ./cluster/gce/list-resources.sh W1025 10:55:15.368] Listed 0 items. W1025 10:55:16.462] Listed 0 items. W1025 10:55:18.237] Listed 0 items. W1025 10:55:19.409] Listed 0 items. W1025 10:55:20.585] Listed 0 items. W1025 10:55:23.049] W1025 10:55:23.049] To show all fields of the firewall, please show in JSON format: --format=json W1025 10:55:23.050] To show all fields in table format, please see the examples in --help. W1025 10:55:23.050] W1025 10:55:24.216] Listed 0 items. W1025 10:55:25.396] Listed 0 items. W1025 10:55:26.408] 2020/10/25 10:55:26 process.go:155: Step './cluster/gce/list-resources.sh' finished in 12.03094189s W1025 10:55:26.408] 2020/10/25 10:55:26 process.go:153: Running: ./hack/e2e-internal/e2e-up.sh W1025 10:55:26.473] Project: k8s-jkns-gce-soak-1-2 W1025 10:55:26.474] Network Project: k8s-jkns-gce-soak-1-2 W1025 10:55:26.474] Zone: us-central1-f W1025 10:55:26.534] ... Starting cluster in us-central1-f using provider gce W1025 10:55:26.534] ... calling verify-prereqs W1025 10:55:27.205] ... calling verify-kube-binaries W1025 10:55:27.366] ... calling verify-release-tars W1025 10:55:27.379] ... calling kube-up W1025 10:55:27.386] Project: k8s-jkns-gce-soak-1-2 W1025 10:55:27.387] Network Project: k8s-jkns-gce-soak-1-2 W1025 10:55:27.387] Zone: us-central1-f I1025 10:55:30.944] +++ Staging tars to Google Storage: gs://kubernetes-staging-eb51bcb47d/bootstrap-e2e-devel I1025 10:55:34.675] +++ kubernetes-server-linux-amd64.tar.gz uploaded earlier, cloud and local file md5 match (md5 = b24185e1c269b81eaf8535934156c994) I1025 10:55:37.080] +++ kubernetes-manifests.tar.gz uploaded earlier, cloud and local file md5 match (md5 = 187f02ed9a45facb840f69dbe9bcd905) I1025 10:55:38.146] Creating new auto network: bootstrap-e2e W1025 10:56:28.570] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/networks/bootstrap-e2e]. I1025 10:56:28.785] NAME SUBNET_MODE BGP_ROUTING_MODE IPV4_RANGE GATEWAY_IPV4 I1025 10:56:28.786] bootstrap-e2e AUTO REGIONAL W1025 10:56:28.886] W1025 10:56:28.887] Instances on this network will not be reachable until firewall rules W1025 10:56:28.887] are created. As an example, you can allow all internal traffic between W1025 10:56:28.887] instances as well as SSH, RDP, and ICMP by running: W1025 10:56:28.887] W1025 10:56:28.888] $ gcloud compute firewall-rules create --network bootstrap-e2e --allow tcp,udp,icmp --source-ranges W1025 10:56:28.888] $ gcloud compute firewall-rules create --network bootstrap-e2e --allow tcp:22,tcp:3389,icmp W1025 10:56:28.888] I1025 10:56:34.303] IP aliases are disabled. I1025 10:56:36.059] Found subnet for region us-central1 in network bootstrap-e2e: bootstrap-e2e I1025 10:56:36.065] Starting master and configuring firewalls I1025 10:56:36.066] Configuring firewall for apiserver konnectivity server W1025 10:56:36.291] Creating firewall... W1025 10:56:36.292] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-default-internal-master]. I1025 10:56:36.512] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1025 10:56:36.513] bootstrap-e2e-default-internal-master bootstrap-e2e INGRESS 1000 tcp:1-2379,tcp:2382-65535,udp:1-65535,icmp False W1025 10:56:36.613] done. W1025 10:56:38.540] Creating firewall... W1025 10:56:38.541] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-default-internal-node]. I1025 10:56:38.746] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1025 10:56:38.746] bootstrap-e2e-default-internal-node bootstrap-e2e INGRESS 1000 tcp:1-65535,udp:1-65535,icmp False W1025 10:56:38.847] done. W1025 10:56:39.336] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/zones/us-central1-f/disks/bootstrap-e2e-master-pd]. I1025 10:56:39.527] NAME ZONE SIZE_GB TYPE STATUS I1025 10:56:39.527] bootstrap-e2e-master-pd us-central1-f 20 pd-ssd READY W1025 10:56:39.628] W1025 10:56:39.629] New disks are unformatted. You must format and mount a disk before it W1025 10:56:39.629] can be used. You can find instructions on how to do this at: W1025 10:56:39.635] W1025 10:56:39.635] https://cloud.google.com/compute/docs/disks/add-persistent-disk#formatting W1025 10:56:39.636] W1025 10:56:41.045] Creating firewall... W1025 10:56:41.046] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-default-ssh]. I1025 10:56:41.286] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1025 10:56:41.288] bootstrap-e2e-default-ssh bootstrap-e2e INGRESS 1000 tcp:22 False W1025 10:56:41.388] done. W1025 10:56:43.274] Creating firewall... W1025 10:56:43.275] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-master-https]. I1025 10:56:43.671] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1025 10:56:43.672] bootstrap-e2e-master-https bootstrap-e2e INGRESS 1000 tcp:443 False W1025 10:56:43.772] done. W1025 10:56:44.889] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/regions/us-central1/addresses/bootstrap-e2e-master-ip]. W1025 10:56:47.301] Creating firewall... W1025 10:56:47.301] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-master-etcd]. I1025 10:56:47.525] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1025 10:56:47.525] bootstrap-e2e-master-etcd bootstrap-e2e INGRESS 1000 tcp:2380,tcp:2381 False W1025 10:56:47.626] done. I1025 10:56:48.408] Generating certs for alternate-names: IP:34.67.222.248,IP:10.0.0.1,DNS:kubernetes,DNS:kubernetes.default,DNS:kubernetes.default.svc,DNS:kubernetes.default.svc.cluster.local,DNS:bootstrap-e2e-master W1025 10:56:50.602] 2020/10/25 10:56:50 [INFO] generating a new CA key and certificate from CSR W1025 10:56:50.603] 2020/10/25 10:56:50 [INFO] generate received request W1025 10:56:50.603] 2020/10/25 10:56:50 [INFO] received CSR W1025 10:56:50.603] 2020/10/25 10:56:50 [INFO] generating key: ecdsa-256 W1025 10:56:50.626] 2020/10/25 10:56:50 [INFO] encoded CSR W1025 10:56:50.627] 2020/10/25 10:56:50 [INFO] signed certificate with serial number 665835573461662279018329878045150687859181741191 W1025 10:56:50.639] 2020/10/25 10:56:50 [INFO] generate received request W1025 10:56:50.640] 2020/10/25 10:56:50 [INFO] received CSR W1025 10:56:50.640] 2020/10/25 10:56:50 [INFO] generating key: ecdsa-256 W1025 10:56:50.667] 2020/10/25 10:56:50 [INFO] encoded CSR W1025 10:56:50.669] 2020/10/25 10:56:50 [INFO] signed certificate with serial number 44944215714911775551924360179295860419201378384 W1025 10:56:50.713] 2020/10/25 10:56:50 [INFO] generate received request W1025 10:56:50.713] 2020/10/25 10:56:50 [INFO] received CSR W1025 10:56:50.713] 2020/10/25 10:56:50 [INFO] generating key: ecdsa-256 W1025 10:56:50.741] 2020/10/25 10:56:50 [INFO] encoded CSR W1025 10:56:50.743] 2020/10/25 10:56:50 [INFO] signed certificate with serial number 627415279341499800006350150855096655112664056661 W1025 10:56:50.764] 2020/10/25 10:56:50 [INFO] generate received request W1025 10:56:50.764] 2020/10/25 10:56:50 [INFO] received CSR W1025 10:56:50.765] 2020/10/25 10:56:50 [INFO] generating key: ecdsa-256 W1025 10:56:50.792] 2020/10/25 10:56:50 [INFO] encoded CSR W1025 10:56:50.793] 2020/10/25 10:56:50 [INFO] signed certificate with serial number 125247129701796722252413374510298093844768023028 W1025 10:56:50.794] 2020/10/25 10:56:50 [WARNING] This certificate lacks a "hosts" field. This makes it unsuitable for W1025 10:56:50.794] websites. For more information see the Baseline Requirements for the Issuance and Management W1025 10:56:50.794] of Publicly-Trusted Certificates, v.1.1.6, from the CA/Browser Forum (https://cabforum.org); W1025 10:56:50.794] specifically, section 10.2.3 ("Information Requirements"). I1025 10:56:50.895] Generate peer certificates... I1025 10:56:50.895] Generate server certificates... I1025 10:56:50.895] Generate client certificates... W1025 10:56:55.979] Creating firewall... W1025 10:56:55.980] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-minion-all]. I1025 10:56:56.164] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1025 10:56:56.165] bootstrap-e2e-minion-all bootstrap-e2e INGRESS 1000 tcp,udp,icmp,esp,ah,sctp False W1025 10:56:56.265] done. W1025 10:57:03.446] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance. W1025 10:57:03.447] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/zones/us-central1-f/instances/bootstrap-e2e-master]. W1025 10:57:03.447] WARNING: Some requests generated warnings: W1025 10:57:03.448] - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details. W1025 10:57:03.448] - The resource 'projects/cos-cloud/global/images/cos-85-13310-1041-9' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-85-13310-1041-14'. W1025 10:57:03.448] W1025 10:57:03.448] NAME ZONE MACHINE_TYPE PREEMPTIBLE INTERNAL_IP EXTERNAL_IP STATUS W1025 10:57:03.449] bootstrap-e2e-master us-central1-f n1-standard-1 10.128.0.2 34.67.222.248 RUNNING I1025 10:57:03.549] Creating nodes. W1025 10:57:06.690] /go/src/github.com/helm/charts/kubernetes/cluster/../cluster/../cluster/gce/util.sh: line 1537: WINDOWS_CONTAINER_RUNTIME_ENDPOINT: unbound variable I1025 10:57:06.828] Using subnet bootstrap-e2e W1025 10:57:08.192] Attempt 1 to create bootstrap-e2e-minion-template W1025 10:57:08.947] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance. W1025 10:57:10.718] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/instanceTemplates/bootstrap-e2e-minion-template]. W1025 10:57:10.928] NAME MACHINE_TYPE PREEMPTIBLE CREATION_TIMESTAMP W1025 10:57:10.928] bootstrap-e2e-minion-template n1-standard-2 2020-10-25T03:57:09.622-07:00 I1025 10:57:11.191] Using subnet bootstrap-e2e W1025 10:57:12.598] Attempt 1 to create bootstrap-e2e-windows-node-template W1025 10:57:13.368] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance. W1025 10:57:15.297] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/instanceTemplates/bootstrap-e2e-windows-node-template]. W1025 10:57:15.610] NAME MACHINE_TYPE PREEMPTIBLE CREATION_TIMESTAMP W1025 10:57:15.610] bootstrap-e2e-windows-node-template n1-standard-2 2020-10-25T03:57:13.976-07:00 W1025 10:57:25.432] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/zones/us-central1-f/instanceGroupManagers/bootstrap-e2e-minion-group]. I1025 10:57:25.839] NAME LOCATION SCOPE BASE_INSTANCE_NAME SIZE TARGET_SIZE INSTANCE_TEMPLATE AUTOSCALED I1025 10:57:25.839] bootstrap-e2e-minion-group us-central1-f zone bootstrap-e2e-minion-group 0 3 bootstrap-e2e-minion-template no I1025 10:57:48.119] Waiting for group to become stable, current operations: creating: 3 I1025 10:57:48.119] Waiting for group to become stable, current operations: creating: 1 I1025 10:57:48.119] Group is stable W1025 10:57:52.656] INSTANCE_GROUPS=bootstrap-e2e-minion-group W1025 10:57:52.657] NODE_NAMES=bootstrap-e2e-minion-group-1pnm bootstrap-e2e-minion-group-hklh bootstrap-e2e-minion-group-kr3b W1025 10:57:52.657] Trying to find master named 'bootstrap-e2e-master' W1025 10:57:52.657] Looking for address 'bootstrap-e2e-master-ip' W1025 10:57:53.767] Using master: bootstrap-e2e-master (external IP: 34.67.222.248; internal IP: (not set)) I1025 10:57:53.868] Waiting up to 300 seconds for cluster initialization. I1025 10:57:53.868] I1025 10:57:53.868] This will continually check to see if the API for kubernetes is reachable. I1025 10:57:53.868] This may time out if there was some uncaught error during start up. I1025 10:57:53.868] I1025 10:58:59.654] .................Kubernetes cluster created. I1025 10:58:59.908] Cluster "k8s-jkns-gce-soak-1-2_bootstrap-e2e" set. I1025 10:59:00.176] User "k8s-jkns-gce-soak-1-2_bootstrap-e2e" set. I1025 10:59:00.450] Context "k8s-jkns-gce-soak-1-2_bootstrap-e2e" created. I1025 10:59:00.709] Switched to context "k8s-jkns-gce-soak-1-2_bootstrap-e2e". I1025 10:59:00.976] User "k8s-jkns-gce-soak-1-2_bootstrap-e2e-basic-auth" set. I1025 10:59:00.981] Wrote config for k8s-jkns-gce-soak-1-2_bootstrap-e2e to /workspace/.kube/config W1025 10:59:09.810] Updated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/zones/us-central1-f/instances/bootstrap-e2e-master]. I1025 10:59:10.401] I1025 10:59:10.402] Kubernetes cluster is running. The master is running at: I1025 10:59:10.402] I1025 10:59:10.403]  https://34.67.222.248 I1025 10:59:10.403] I1025 10:59:10.403] The user name and password to use is located in /workspace/.kube/config. I1025 10:59:10.404] W1025 10:59:10.504] ... calling validate-cluster W1025 10:59:10.552] Project: k8s-jkns-gce-soak-1-2 W1025 10:59:10.553] Network Project: k8s-jkns-gce-soak-1-2 W1025 10:59:10.553] Zone: us-central1-f I1025 10:59:10.653] Validating gce cluster, MULTIZONE= W1025 10:59:14.471] No resources found I1025 10:59:14.572] Waiting for 4 ready nodes. 0 ready nodes, 0 registered. Retrying. I1025 10:59:30.048] Waiting for 4 ready nodes. 0 ready nodes, 1 registered. Retrying. I1025 10:59:45.356] Waiting for 4 ready nodes. 1 ready nodes, 4 registered. Retrying. I1025 11:00:00.764] Found 4 node(s). I1025 11:00:01.140] NAME STATUS ROLES AGE VERSION I1025 11:00:01.140] bootstrap-e2e-master Ready,SchedulingDisabled 34s v1.20.0-alpha.3.114+5935fcd704fe89 I1025 11:00:01.141] bootstrap-e2e-minion-group-1pnm Ready 21s v1.20.0-alpha.3.114+5935fcd704fe89 I1025 11:00:01.141] bootstrap-e2e-minion-group-hklh Ready 20s v1.20.0-alpha.3.114+5935fcd704fe89 I1025 11:00:01.141] bootstrap-e2e-minion-group-kr3b Ready 30s v1.20.0-alpha.3.114+5935fcd704fe89 W1025 11:00:01.807] Warning: v1 ComponentStatus is deprecated in v1.19+ I1025 11:00:01.909] Validate output: I1025 11:00:02.420] NAME STATUS MESSAGE ERROR I1025 11:00:02.421] etcd-1 Healthy {"health":"true"} I1025 11:00:02.421] scheduler Healthy ok I1025 11:00:02.421] controller-manager Healthy ok I1025 11:00:02.421] etcd-0 Healthy {"health":"true"} I1025 11:00:02.435] Cluster validation succeeded W1025 11:00:02.539] Warning: v1 ComponentStatus is deprecated in v1.19+ W1025 11:00:02.539] Done, listing cluster services: W1025 11:00:02.539] I1025 11:00:02.825] Kubernetes control plane is running at https://34.67.222.248 I1025 11:00:02.825] GLBCDefaultBackend is running at https://34.67.222.248/api/v1/namespaces/kube-system/services/default-http-backend:http/proxy I1025 11:00:02.826] CoreDNS is running at https://34.67.222.248/api/v1/namespaces/kube-system/services/kube-dns:dns/proxy I1025 11:00:02.826] Metrics-server is running at https://34.67.222.248/api/v1/namespaces/kube-system/services/https:metrics-server:/proxy I1025 11:00:02.826] I1025 11:00:02.826] To further debug and diagnose cluster problems, use 'kubectl cluster-info dump'. I1025 11:00:02.832] I1025 11:00:11.081] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1025 11:00:11.081] bootstrap-e2e-minion-http-alt bootstrap-e2e INGRESS 1000 tcp:80,tcp:8080 False I1025 11:00:12.777] allowed: I1025 11:00:12.777] - IPProtocol: tcp I1025 11:00:12.778] ports: I1025 11:00:12.778] - '80' I1025 11:00:12.778] - IPProtocol: tcp I1025 11:00:12.778] ports: I1025 11:00:12.778] - '8080' I1025 11:00:12.778] creationTimestamp: '2020-10-25T04:00:04.817-07:00' I1025 11:00:12.778] description: '' I1025 11:00:12.778] direction: INGRESS I1025 11:00:12.778] disabled: false I1025 11:00:12.779] id: '4840983144728945755' I1025 11:00:12.779] kind: compute#firewall I1025 11:00:12.779] logConfig: I1025 11:00:12.779] enable: false I1025 11:00:12.779] name: bootstrap-e2e-minion-http-alt I1025 11:00:12.779] network: https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/networks/bootstrap-e2e I1025 11:00:12.779] priority: 1000 I1025 11:00:12.779] selfLink: https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-minion-http-alt I1025 11:00:12.780] sourceRanges: I1025 11:00:12.780] - 0.0.0.0/0 I1025 11:00:12.780] targetTags: I1025 11:00:12.780] - bootstrap-e2e-minion I1025 11:00:18.188] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1025 11:00:18.189] bootstrap-e2e-minion-nodeports bootstrap-e2e INGRESS 1000 tcp:30000-32767,udp:30000-32767 False I1025 11:00:19.795] allowed: I1025 11:00:19.795] - IPProtocol: tcp I1025 11:00:19.796] ports: I1025 11:00:19.796] - 30000-32767 I1025 11:00:19.796] - IPProtocol: udp I1025 11:00:19.796] ports: I1025 11:00:19.796] - 30000-32767 I1025 11:00:19.796] creationTimestamp: '2020-10-25T04:00:14.369-07:00' I1025 11:00:19.796] description: '' I1025 11:00:19.796] direction: INGRESS I1025 11:00:19.796] disabled: false I1025 11:00:19.796] id: '7141859273372918865' I1025 11:00:19.797] kind: compute#firewall I1025 11:00:19.797] logConfig: I1025 11:00:19.797] enable: false I1025 11:00:19.797] name: bootstrap-e2e-minion-nodeports I1025 11:00:19.797] network: https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/networks/bootstrap-e2e I1025 11:00:19.797] priority: 1000 I1025 11:00:19.797] selfLink: https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-minion-nodeports I1025 11:00:19.798] sourceRanges: I1025 11:00:19.798] - 0.0.0.0/0 I1025 11:00:19.798] targetTags: I1025 11:00:19.798] - bootstrap-e2e-minion W1025 11:00:20.082] 2020/10/25 11:00:20 process.go:155: Step './hack/e2e-internal/e2e-up.sh' finished in 4m53.673847112s W1025 11:00:20.082] 2020/10/25 11:00:20 process.go:153: Running: ./cluster/kubectl.sh --match-server-version=false version W1025 11:00:20.399] 2020/10/25 11:00:20 process.go:155: Step './cluster/kubectl.sh --match-server-version=false version' finished in 316.88756ms W1025 11:00:20.400] 2020/10/25 11:00:20 process.go:153: Running: ./cluster/kubectl.sh --match-server-version=false get nodes -oyaml W1025 11:00:20.756] 2020/10/25 11:00:20 process.go:155: Step './cluster/kubectl.sh --match-server-version=false get nodes -oyaml' finished in 357.237827ms W1025 11:00:20.757] 2020/10/25 11:00:20 e2e.go:456: Listing resources... W1025 11:00:20.757] 2020/10/25 11:00:20 process.go:153: Running: ./cluster/gce/list-resources.sh W1025 11:00:32.303] W1025 11:00:32.303] To show all fields of the firewall, please show in JSON format: --format=json W1025 11:00:32.303] To show all fields in table format, please see the examples in --help. W1025 11:00:32.303] W1025 11:00:33.629] Listed 0 items. W1025 11:00:35.103] Listed 0 items. W1025 11:00:36.411] 2020/10/25 11:00:36 process.go:155: Step './cluster/gce/list-resources.sh' finished in 15.654485891s W1025 11:00:36.411] 2020/10/25 11:00:36 util.go:56: Warning: Couldn't find directory src/k8s.io/charts under any of GOPATH /go, defaulting to /go/src/k8s.io/charts W1025 11:00:36.412] 2020/10/25 11:00:36 process.go:153: Running: /go/src/k8s.io/charts/test/helm-test-e2e.sh W1025 11:00:36.412] 2020/10/25 11:00:36 process.go:155: Step '/go/src/k8s.io/charts/test/helm-test-e2e.sh' finished in 530.524µs W1025 11:00:36.413] 2020/10/25 11:00:36 e2e.go:544: Dumping logs locally to: /workspace/_artifacts W1025 11:00:36.413] 2020/10/25 11:00:36 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts I1025 11:00:36.513] Checking for custom logdump instances, if any I1025 11:00:36.514] Sourcing kube-util.sh I1025 11:00:36.520] Detecting project I1025 11:00:36.521] Project: k8s-jkns-gce-soak-1-2 I1025 11:00:36.521] Network Project: k8s-jkns-gce-soak-1-2 I1025 11:00:36.521] Zone: us-central1-f I1025 11:00:36.538] Dumping logs from master locally to '/workspace/_artifacts' W1025 11:00:36.639] Trying to find master named 'bootstrap-e2e-master' W1025 11:00:36.639] Looking for address 'bootstrap-e2e-master-ip' W1025 11:00:37.958] Using master: bootstrap-e2e-master (external IP: 34.67.222.248; internal IP: (not set)) I1025 11:01:15.059] Changing logfiles to be world-readable for download I1025 11:01:19.231] Copying 'kube-apiserver.log kube-apiserver-audit.log kube-scheduler.log kube-controller-manager.log etcd.log etcd-events.log glbc.log cluster-autoscaler.log kube-addon-manager.log konnectivity-server.log fluentd.log kubelet.cov startupscript.log' from bootstrap-e2e-master W1025 11:01:20.726] W1025 11:01:20.726] Specify --start=57034 in the next get-serial-port-output invocation to get only the new output starting from here. W1025 11:01:22.910] scp: /var/log/cluster-autoscaler.log*: No such file or directory W1025 11:01:22.913] scp: /var/log/konnectivity-server.log*: No such file or directory W1025 11:01:22.914] scp: /var/log/fluentd.log*: No such file or directory W1025 11:01:22.915] scp: /var/log/kubelet.cov*: No such file or directory W1025 11:01:22.916] scp: /var/log/startupscript.log*: No such file or directory W1025 11:01:22.923] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. I1025 11:01:23.200] Dumping logs from nodes locally to '/workspace/_artifacts' I1025 11:01:23.201] Detecting nodes in the cluster I1025 11:02:03.613] Changing logfiles to be world-readable for download I1025 11:02:03.743] Changing logfiles to be world-readable for download I1025 11:02:03.850] Changing logfiles to be world-readable for download I1025 11:02:07.321] Copying 'kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov startupscript.log' from bootstrap-e2e-minion-group-hklh I1025 11:02:07.774] Copying 'kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov startupscript.log' from bootstrap-e2e-minion-group-kr3b I1025 11:02:07.883] Copying 'kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov startupscript.log' from bootstrap-e2e-minion-group-1pnm W1025 11:02:09.046] W1025 11:02:09.047] Specify --start=67434 in the next get-serial-port-output invocation to get only the new output starting from here. W1025 11:02:09.381] W1025 11:02:09.382] Specify --start=67919 in the next get-serial-port-output invocation to get only the new output starting from here. W1025 11:02:09.385] W1025 11:02:09.386] Specify --start=67454 in the next get-serial-port-output invocation to get only the new output starting from here. W1025 11:02:11.164] scp: /var/log/fluentd.log*: No such file or directory W1025 11:02:11.164] scp: /var/log/node-problem-detector.log*: No such file or directory W1025 11:02:11.164] scp: /var/log/kubelet.cov*: No such file or directory W1025 11:02:11.164] scp: /var/log/startupscript.log*: No such file or directory W1025 11:02:11.169] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W1025 11:02:11.837] scp: /var/log/fluentd.log*: No such file or directory W1025 11:02:11.837] scp: /var/log/node-problem-detector.log*: No such file or directory W1025 11:02:11.838] scp: /var/log/kubelet.cov*: No such file or directory W1025 11:02:11.847] scp: /var/log/startupscript.log*: No such file or directory W1025 11:02:11.858] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W1025 11:02:11.968] scp: /var/log/fluentd.log*: No such file or directory W1025 11:02:11.969] scp: /var/log/node-problem-detector.log*: No such file or directory W1025 11:02:11.969] scp: /var/log/kubelet.cov*: No such file or directory W1025 11:02:11.969] scp: /var/log/startupscript.log*: No such file or directory W1025 11:02:11.973] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W1025 11:02:17.371] INSTANCE_GROUPS=bootstrap-e2e-minion-group W1025 11:02:17.371] NODE_NAMES=bootstrap-e2e-minion-group-1pnm bootstrap-e2e-minion-group-hklh bootstrap-e2e-minion-group-kr3b I1025 11:02:18.705] Failures for bootstrap-e2e-minion-group (if any): W1025 11:02:21.979] 2020/10/25 11:02:21 process.go:155: Step './cluster/log-dump/log-dump.sh /workspace/_artifacts' finished in 1m45.566908053s W1025 11:02:21.979] 2020/10/25 11:02:21 e2e.go:456: Listing resources... W1025 11:02:21.980] 2020/10/25 11:02:21 process.go:153: Running: ./cluster/gce/list-resources.sh W1025 11:02:33.941] W1025 11:02:33.942] To show all fields of the firewall, please show in JSON format: --format=json W1025 11:02:33.942] To show all fields in table format, please see the examples in --help. W1025 11:02:33.942] W1025 11:02:35.527] Listed 0 items. W1025 11:02:37.686] Listed 0 items. W1025 11:02:39.161] 2020/10/25 11:02:39 process.go:155: Step './cluster/gce/list-resources.sh' finished in 17.181881144s W1025 11:02:39.162] 2020/10/25 11:02:39 process.go:153: Running: ./hack/e2e-internal/e2e-down.sh W1025 11:02:39.263] Project: k8s-jkns-gce-soak-1-2 W1025 11:02:39.263] Network Project: k8s-jkns-gce-soak-1-2 W1025 11:02:39.263] Zone: us-central1-f I1025 11:02:39.364] Shutting down test cluster in background. W1025 11:02:46.249] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-minion-http-alt]. W1025 11:02:48.185] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-minion-nodeports]. I1025 11:02:48.500] Bringing down cluster using provider: gce W1025 11:02:48.600] ... calling verify-prereqs W1025 11:02:49.267] ... calling verify-kube-binaries W1025 11:02:49.447] ... calling kube-down W1025 11:02:49.448] Project: k8s-jkns-gce-soak-1-2 W1025 11:02:49.448] Network Project: k8s-jkns-gce-soak-1-2 W1025 11:02:49.448] Zone: us-central1-f W1025 11:02:54.161] INSTANCE_GROUPS=bootstrap-e2e-minion-group W1025 11:02:54.162] NODE_NAMES=bootstrap-e2e-minion-group-1pnm bootstrap-e2e-minion-group-hklh bootstrap-e2e-minion-group-kr3b I1025 11:02:54.262] Bringing down cluster W1025 11:05:10.504] Deleting Managed Instance Group... W1025 11:05:10.505] ...Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/zones/us-central1-f/instanceGroupManagers/bootstrap-e2e-minion-group]. W1025 11:05:10.510] done. W1025 11:05:14.970] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/instanceTemplates/bootstrap-e2e-minion-template]. W1025 11:05:15.406] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/instanceTemplates/bootstrap-e2e-windows-node-template]. I1025 11:05:21.429] Successfully executed 'curl -s --cacert /etc/srv/kubernetes/pki/etcd-apiserver-ca.crt --cert /etc/srv/kubernetes/pki/etcd-apiserver-client.crt --key /etc/srv/kubernetes/pki/etcd-apiserver-client.key https://127.0.0.1:2379/v2/members/$(curl -s --cacert /etc/srv/kubernetes/pki/etcd-apiserver-ca.crt --cert /etc/srv/kubernetes/pki/etcd-apiserver-client.crt --key /etc/srv/kubernetes/pki/etcd-apiserver-client.key https://127.0.0.1:2379/v2/members -XGET | sed 's/{\"id/\n/g' | grep bootstrap-e2e-master\" | cut -f 3 -d \") -XDELETE -L 2>/dev/null' on bootstrap-e2e-master I1025 11:05:21.429] Removing etcd replica, name: bootstrap-e2e-master, port: 2379, result: 0 I1025 11:05:23.262] Successfully executed 'curl -s http://127.0.0.1:4002/v2/members/$(curl -s http://127.0.0.1:4002/v2/members -XGET | sed 's/{\"id/\n/g' | grep bootstrap-e2e-master\" | cut -f 3 -d \") -XDELETE -L 2>/dev/null' on bootstrap-e2e-master I1025 11:05:23.262] Removing etcd replica, name: bootstrap-e2e-master, port: 4002, result: 0 W1025 11:05:28.442] Updated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/zones/us-central1-f/instances/bootstrap-e2e-master]. W1025 11:07:21.517] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/zones/us-central1-f/instances/bootstrap-e2e-master]. W1025 11:07:32.130] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-master-https]. W1025 11:07:34.637] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-master-etcd]. W1025 11:07:38.292] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-minion-all]. W1025 11:07:44.481] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/regions/us-central1/addresses/bootstrap-e2e-master-ip]. I1025 11:07:52.523] Deleting routes bootstrap-e2e-9bd3c2b9-cdba-41da-8018-ed997a541543 W1025 11:07:59.514] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/routes/bootstrap-e2e-9bd3c2b9-cdba-41da-8018-ed997a541543]. W1025 11:08:10.017] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-default-internal-master]. W1025 11:08:13.171] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-default-internal-node]. W1025 11:08:15.448] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/firewalls/bootstrap-e2e-default-ssh]. I1025 11:08:16.931] Deleting firewall rules remaining in network bootstrap-e2e: W1025 11:09:05.204] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-soak-1-2/global/networks/bootstrap-e2e]. I1025 11:09:05.846] Property "current-context" unset. I1025 11:09:06.023] Property "clusters.k8s-jkns-gce-soak-1-2_bootstrap-e2e" unset. I1025 11:09:06.206] Property "users.k8s-jkns-gce-soak-1-2_bootstrap-e2e" unset. I1025 11:09:06.395] Property "users.k8s-jkns-gce-soak-1-2_bootstrap-e2e-basic-auth" unset. I1025 11:09:06.566] Property "contexts.k8s-jkns-gce-soak-1-2_bootstrap-e2e" unset. I1025 11:09:06.570] Cleared config for k8s-jkns-gce-soak-1-2_bootstrap-e2e from /workspace/.kube/config I1025 11:09:06.571] Done W1025 11:09:06.671] 2020/10/25 11:09:06 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 6m27.413140267s W1025 11:09:06.672] 2020/10/25 11:09:06 e2e.go:278: Sleeping for 30 seconds... W1025 11:09:36.575] 2020/10/25 11:09:36 e2e.go:456: Listing resources... W1025 11:09:36.575] 2020/10/25 11:09:36 process.go:153: Running: ./cluster/gce/list-resources.sh W1025 11:09:37.640] Listed 0 items. W1025 11:09:38.781] Listed 0 items. W1025 11:09:40.639] Listed 0 items. W1025 11:09:41.834] Listed 0 items. W1025 11:09:43.006] Listed 0 items. W1025 11:09:45.784] W1025 11:09:45.785] To show all fields of the firewall, please show in JSON format: --format=json W1025 11:09:45.785] To show all fields in table format, please see the examples in --help. W1025 11:09:45.786] W1025 11:09:48.560] Listed 0 items. W1025 11:09:51.348] Listed 0 items. W1025 11:09:53.848] 2020/10/25 11:09:53 process.go:155: Step './cluster/gce/list-resources.sh' finished in 17.272698387s W1025 11:09:53.850] 2020/10/25 11:09:53 process.go:153: Running: diff -sw -U0 -F^\[.*\]$ /workspace/_artifacts/gcp-resources-before.txt /workspace/_artifacts/gcp-resources-after.txt W1025 11:09:53.859] 2020/10/25 11:09:53 process.go:155: Step 'diff -sw -U0 -F^\[.*\]$ /workspace/_artifacts/gcp-resources-before.txt /workspace/_artifacts/gcp-resources-after.txt' finished in 8.754409ms W1025 11:09:53.864] 2020/10/25 11:09:53 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W1025 11:09:53.876] 2020/10/25 11:09:53 main.go:316: Something went wrong: encountered 1 errors: [error starting /go/src/k8s.io/charts/test/helm-test-e2e.sh: fork/exec /go/src/k8s.io/charts/test/helm-test-e2e.sh: no such file or directory] W1025 11:09:53.887] Traceback (most recent call last): W1025 11:09:53.888] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 720, in W1025 11:09:53.888] main(parse_args()) W1025 11:09:53.888] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 570, in main W1025 11:09:53.889] mode.start(runner_args) W1025 11:09:53.889] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 228, in start W1025 11:09:53.889] check_env(env, self.command, *args) W1025 11:09:53.890] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W1025 11:09:53.890] subprocess.check_call(cmd, env=env) W1025 11:09:53.890] File "/usr/lib/python2.7/subprocess.py", line 190, in check_call W1025 11:09:53.891] raise CalledProcessError(retcode, cmd) W1025 11:09:53.892] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--provider=gce', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--charts', '--check-leaked-resources', '--extract=ci/latest', '--gcp-node-image=gci', '--gcp-zone=us-central1-f', '--timeout=180m')' returned non-zero exit status 1 E1025 11:09:53.939] Command failed I1025 11:09:53.940] process 282 exited with code 1 after 16.0m E1025 11:09:53.941] FAIL: ci-kubernetes-charts-gce I1025 11:09:53.945] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1025 11:09:55.404] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I1025 11:09:55.603] process 10790 exited with code 0 after 0.0m I1025 11:09:55.604] Call: gcloud config get-value account I1025 11:09:56.904] process 10803 exited with code 0 after 0.0m I1025 11:09:56.906] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I1025 11:09:56.906] Upload result and artifacts... I1025 11:09:56.907] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-kubernetes-charts-gce/1320317526055325696 I1025 11:09:56.908] Call: gsutil ls gs://kubernetes-jenkins/logs/ci-kubernetes-charts-gce/1320317526055325696/artifacts W1025 11:09:59.416] CommandException: One or more URLs matched no objects. E1025 11:09:59.860] Command failed I1025 11:09:59.860] process 10816 exited with code 1 after 0.0m W1025 11:09:59.860] Remote dir gs://kubernetes-jenkins/logs/ci-kubernetes-charts-gce/1320317526055325696/artifacts not exist yet I1025 11:09:59.861] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/logs/ci-kubernetes-charts-gce/1320317526055325696/artifacts I1025 11:10:05.838] process 10959 exited with code 0 after 0.1m I1025 11:10:05.841] Call: git rev-parse HEAD I1025 11:10:05.863] process 11612 exited with code 0 after 0.0m I1025 11:10:05.864] Call: git rev-parse HEAD I1025 11:10:05.879] process 11613 exited with code 0 after 0.0m I1025 11:10:05.881] Call: gsutil stat gs://kubernetes-jenkins/logs/ci-kubernetes-charts-gce/jobResultsCache.json I1025 11:10:08.433] process 11614 exited with code 0 after 0.0m I1025 11:10:08.437] Call: gsutil -q cat 'gs://kubernetes-jenkins/logs/ci-kubernetes-charts-gce/jobResultsCache.json#1603620471808078' I1025 11:10:11.096] process 11757 exited with code 0 after 0.0m I1025 11:10:11.111] Call: gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1603620471808078 cp /tmp/gsutil_9J2Jdx gs://kubernetes-jenkins/logs/ci-kubernetes-charts-gce/jobResultsCache.json I1025 11:10:13.340] process 11902 exited with code 0 after 0.0m I1025 11:10:13.342] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_6XLPR7 gs://kubernetes-jenkins/logs/ci-kubernetes-charts-gce/1320317526055325696/finished.json I1025 11:10:15.920] process 12081 exited with code 0 after 0.0m I1025 11:10:15.926] Call: gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_2Y14py gs://kubernetes-jenkins/logs/ci-kubernetes-charts-gce/latest-build.txt I1025 11:10:18.139] process 12260 exited with code 0 after 0.0m