W1025 09:45:37.449] ************************************************************************** bootstrap.py is deprecated! test-infra oncall does not support any job still using bootstrap.py. Please migrate your job to podutils! https://github.com/kubernetes/test-infra/blob/master/prow/pod-utilities.md ************************************************************************** I1025 09:45:37.449] Args: --job=ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel --service-account=/etc/service-account/service-account.json --upload=gs://kubernetes-jenkins/logs --timeout=140 --bare --scenario=kubernetes_e2e -- --check-leaked-resources --check-version-skew=false --env=STORAGE_MEDIA_TYPE=application/vnd.kubernetes.protobuf --env=TEST_ETCD_VERSION=3.0.17 --extract=ci/k8s-stable1 --extract=ci/k8s-beta --gcp-node-image=gci --gcp-zone=us-west1-b --ginkgo-parallel --provider=gce --skew '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\] --kubectl-path=../../../../kubernetes_skew/cluster/kubectl.sh --minStartupPods=8' --timeout=120m '--upgrade_args=--ginkgo.focus=\[Feature:ClusterDowngrade\] --upgrade-target=ci/k8s-stable1 --upgrade-image=gci' I1025 09:45:37.449] Bootstrap ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel... I1025 09:45:37.451] Builder: cd4e134d-16a6-11eb-b256-6ee25ea2e440 I1025 09:45:37.451] Image: gcr.io/k8s-testimages/kubekins-e2e:v20201021-a62ce8a-master I1025 09:45:37.452] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320300412443561984 I1025 09:45:37.452] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1025 09:45:38.105] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I1025 09:45:38.241] process 34 exited with code 0 after 0.0m I1025 09:45:38.242] Call: gcloud config get-value account I1025 09:45:38.946] process 47 exited with code 0 after 0.0m I1025 09:45:38.947] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I1025 09:45:38.947] Root: /workspace I1025 09:45:38.947] cd to /workspace I1025 09:45:38.947] Configure environment... I1025 09:45:38.948] Call: git show -s --format=format:%ct HEAD W1025 09:45:38.953] fatal: not a git repository (or any of the parent directories): .git I1025 09:45:38.954] process 60 exited with code 128 after 0.0m W1025 09:45:38.954] Unable to print commit date for HEAD I1025 09:45:38.954] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1025 09:45:39.613] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I1025 09:45:39.788] process 61 exited with code 0 after 0.0m I1025 09:45:39.789] Call: gcloud config get-value account I1025 09:45:40.398] process 74 exited with code 0 after 0.0m I1025 09:45:40.399] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I1025 09:45:40.399] Start 1320300412443561984 at ... I1025 09:45:40.401] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_y34gnO gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320300412443561984/started.json I1025 09:45:41.960] process 87 exited with code 0 after 0.0m I1025 09:45:41.961] Call: /workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py --check-leaked-resources --check-version-skew=false --env=STORAGE_MEDIA_TYPE=application/vnd.kubernetes.protobuf --env=TEST_ETCD_VERSION=3.0.17 --extract=ci/k8s-stable1 --extract=ci/k8s-beta --gcp-node-image=gci --gcp-zone=us-west1-b --ginkgo-parallel --provider=gce --skew '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\] --kubectl-path=../../../../kubernetes_skew/cluster/kubectl.sh --minStartupPods=8' --timeout=120m '--upgrade_args=--ginkgo.focus=\[Feature:ClusterDowngrade\] --upgrade-target=ci/k8s-stable1 --upgrade-image=gci' W1025 09:45:42.010] starts with local mode W1025 09:45:42.010] Environment: W1025 09:45:42.010] ARTIFACTS=/workspace/_artifacts W1025 09:45:42.010] AWS_SSH_PRIVATE_KEY_FILE=/root/.ssh/kube_aws_rsa W1025 09:45:42.011] AWS_SSH_PUBLIC_KEY_FILE=/root/.ssh/kube_aws_rsa.pub W1025 09:45:42.011] BAZEL_REMOTE_CACHE_ENABLED=false W1025 09:45:42.011] BAZEL_VERSION=2.2.0 W1025 09:45:42.011] BOOTSTRAP_MIGRATION=yes W1025 09:45:42.011] BOSKOS_METRICS_PORT=tcp://10.63.252.110:9090 W1025 09:45:42.011] BOSKOS_METRICS_PORT_9090_TCP=tcp://10.63.252.110:9090 W1025 09:45:42.012] BOSKOS_METRICS_PORT_9090_TCP_ADDR=10.63.252.110 W1025 09:45:42.012] BOSKOS_METRICS_PORT_9090_TCP_PORT=9090 W1025 09:45:42.012] BOSKOS_METRICS_PORT_9090_TCP_PROTO=tcp W1025 09:45:42.012] BOSKOS_METRICS_SERVICE_HOST=10.63.252.110 W1025 09:45:42.012] BOSKOS_METRICS_SERVICE_PORT=9090 W1025 09:45:42.012] BOSKOS_METRICS_SERVICE_PORT_METRICS=9090 W1025 09:45:42.012] BOSKOS_PORT=tcp://10.63.250.132:80 W1025 09:45:42.012] BOSKOS_PORT_80_TCP=tcp://10.63.250.132:80 W1025 09:45:42.013] BOSKOS_PORT_80_TCP_ADDR=10.63.250.132 W1025 09:45:42.013] BOSKOS_PORT_80_TCP_PORT=80 W1025 09:45:42.013] BOSKOS_PORT_80_TCP_PROTO=tcp W1025 09:45:42.013] BOSKOS_SERVICE_HOST=10.63.250.132 W1025 09:45:42.013] BOSKOS_SERVICE_PORT=80 W1025 09:45:42.013] BOSKOS_SERVICE_PORT_DEFAULT=80 W1025 09:45:42.014] BUILD_ID=1320300412443561984 W1025 09:45:42.014] BUILD_NUMBER=1320300412443561984 W1025 09:45:42.014] CI=true W1025 09:45:42.014] CLOUDSDK_COMPONENT_MANAGER_DISABLE_UPDATE_CHECK=true W1025 09:45:42.014] CLOUDSDK_CONFIG=/workspace/.config/gcloud W1025 09:45:42.014] CLOUDSDK_CORE_DISABLE_PROMPTS=1 W1025 09:45:42.015] CLOUDSDK_EXPERIMENTAL_FAST_COMPONENT_UPDATE=false W1025 09:45:42.015] DOCKER_IN_DOCKER_ENABLED=false W1025 09:45:42.015] DOCKER_IN_DOCKER_IPV6_ENABLED=false W1025 09:45:42.015] E2E_GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json W1025 09:45:42.015] GCS_ARTIFACTS_DIR=gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320300412443561984/artifacts W1025 09:45:42.016] GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json W1025 09:45:42.016] GOOGLE_APPLICATION_CREDENTIALS_DEPRECATED=Migrate to workload identity, contact sig-testing W1025 09:45:42.016] GOPATH=/go W1025 09:45:42.016] GOPROXY=https://proxy.golang.org W1025 09:45:42.016] GO_TARBALL=go1.15.2.linux-amd64.tar.gz W1025 09:45:42.016] HOME=/workspace W1025 09:45:42.016] HOSTNAME=cd4e134d-16a6-11eb-b256-6ee25ea2e440 W1025 09:45:42.017] IMAGE=gcr.io/k8s-testimages/kubekins-e2e:v20201021-a62ce8a-master W1025 09:45:42.017] INSTANCE_PREFIX=bootstrap-e2e W1025 09:45:42.017] JENKINS_GCE_SSH_PRIVATE_KEY_FILE=/workspace/.ssh/google_compute_engine W1025 09:45:42.017] JENKINS_GCE_SSH_PUBLIC_KEY_FILE=/workspace/.ssh/google_compute_engine.pub W1025 09:45:42.017] JOB_NAME=ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel W1025 09:45:42.017] JOB_SPEC={"type":"periodic","job":"ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel","buildid":"1320300412443561984","prowjobid":"cd4e134d-16a6-11eb-b256-6ee25ea2e440"} W1025 09:45:42.018] JOB_TYPE=periodic W1025 09:45:42.018] KUBERNETES_PORT=tcp://10.63.240.1:443 W1025 09:45:42.018] KUBERNETES_PORT_443_TCP=tcp://10.63.240.1:443 W1025 09:45:42.018] KUBERNETES_PORT_443_TCP_ADDR=10.63.240.1 W1025 09:45:42.019] KUBERNETES_PORT_443_TCP_PORT=443 W1025 09:45:42.019] KUBERNETES_PORT_443_TCP_PROTO=tcp W1025 09:45:42.019] KUBERNETES_SERVICE_HOST=10.63.240.1 W1025 09:45:42.019] KUBERNETES_SERVICE_PORT=443 W1025 09:45:42.019] KUBERNETES_SERVICE_PORT_HTTPS=443 W1025 09:45:42.019] KUBETEST_IN_DOCKER=true W1025 09:45:42.019] KUBETEST_MANUAL_DUMP=y W1025 09:45:42.019] KUBE_AWS_INSTANCE_PREFIX=bootstrap-e2e W1025 09:45:42.020] KUBE_GCE_INSTANCE_PREFIX=bootstrap-e2e W1025 09:45:42.020] LOG_DUMP_SCRIPT_PATH=/workspace/log-dump.sh W1025 09:45:42.020] NODE_NAME=cd4e134d-16a6-11eb-b256-6ee25ea2e440 W1025 09:45:42.020] PATH=/go/bin:/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/workspace:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin W1025 09:45:42.020] PROW_JOB_ID=cd4e134d-16a6-11eb-b256-6ee25ea2e440 W1025 09:45:42.021] PWD=/workspace W1025 09:45:42.021] SHLVL=2 W1025 09:45:42.021] SOURCE_DATE_EPOCH= W1025 09:45:42.021] STORAGE_MEDIA_TYPE=application/vnd.kubernetes.protobuf W1025 09:45:42.021] TERM=xterm W1025 09:45:42.021] TEST_ETCD_VERSION=3.0.17 W1025 09:45:42.021] USER=prow W1025 09:45:42.021] WORKSPACE=/workspace W1025 09:45:42.022] _=./test-infra/jenkins/bootstrap.py W1025 09:45:42.022] Run: ('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--provider=gce', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--check-leaked-resources', '--check-version-skew=false', '--extract=ci/k8s-stable1', '--extract=ci/k8s-beta', '--gcp-node-image=gci', '--gcp-zone=us-west1-b', '--ginkgo-parallel', '--skew', '--test_args=--ginkgo.skip=\\[Slow\\]|\\[Serial\\]|\\[Disruptive\\]|\\[Flaky\\]|\\[Feature:.+\\] --kubectl-path=../../../../kubernetes_skew/cluster/kubectl.sh --minStartupPods=8', '--timeout=120m', '--upgrade_args=--ginkgo.focus=\\[Feature:ClusterDowngrade\\] --upgrade-target=ci/k8s-stable1 --upgrade-image=gci') W1025 09:45:42.046] 2020/10/25 09:45:42 Warning: Couldn't find directory src/sigs.k8s.io/cloud-provider-azure under any of GOPATH /go, defaulting to /go/src/k8s.io/cloud-provider-azure W1025 09:45:42.049] 2020/10/25 09:45:42 extract_k8s.go:112: Matched extraction strategy: ^ci/(.+)$ W1025 09:45:42.049] 2020/10/25 09:45:42 extract_k8s.go:112: Matched extraction strategy: ^ci/(.+)$ W1025 09:45:42.049] 2020/10/25 09:45:42 main.go:329: Limiting testing to 2h0m0s W1025 09:45:42.050] 2020/10/25 09:45:42 process.go:153: Running: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1025 09:45:42.702] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] W1025 09:45:42.807] 2020/10/25 09:45:42 process.go:155: Step 'gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json' finished in 757.89079ms W1025 09:45:42.807] 2020/10/25 09:45:42 main.go:728: --gcp-project is missing, trying to fetch a project from boskos. W1025 09:45:42.808] (for local runs please set --gcp-project to your dev project) W1025 09:45:42.808] 2020/10/25 09:45:42 main.go:740: provider gce, will acquire project type gce-project from boskos W1025 09:45:42.818] 2020/10/25 09:45:42 process.go:153: Running: gcloud config set project k8s-boskos-gce-project-03 W1025 09:45:43.297] Updated property [core/project]. W1025 09:45:43.629] 2020/10/25 09:45:43 process.go:155: Step 'gcloud config set project k8s-boskos-gce-project-03' finished in 810.693581ms W1025 09:45:43.630] 2020/10/25 09:45:43 main.go:779: Checking existing of GCP ssh keys... W1025 09:45:43.630] 2020/10/25 09:45:43 main.go:789: Checking presence of public key in k8s-boskos-gce-project-03 W1025 09:45:43.630] 2020/10/25 09:45:43 process.go:153: Running: gcloud compute --project=k8s-boskos-gce-project-03 project-info describe W1025 09:45:44.992] 2020/10/25 09:45:44 process.go:155: Step 'gcloud compute --project=k8s-boskos-gce-project-03 project-info describe' finished in 1.362775039s W1025 09:45:44.993] 2020/10/25 09:45:44 extract_k8s.go:143: rm kubernetes W1025 09:45:45.068] 2020/10/25 09:45:45 extract_k8s.go:295: U=https://storage.googleapis.com/kubernetes-release-dev/ci R=v1.18.11-rc.0.13+806617c8cf1f0d get-kube.sh W1025 09:45:45.068] 2020/10/25 09:45:45 process.go:153: Running: ./get-kube.sh I1025 09:45:45.169] Downloading kubernetes release v1.18.11-rc.0.13+806617c8cf1f0d I1025 09:45:45.169] from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.13+806617c8cf1f0d/kubernetes.tar.gz I1025 09:45:45.169] to /workspace/kubernetes.tar.gz W1025 09:45:46.195] Copying gs://kubernetes-release-dev/ci/v1.18.11-rc.0.13+806617c8cf1f0d/kubernetes.tar.gz... W1025 09:45:46.302] / [0 files][ 0.0 B/451.1 KiB] / [1 files][451.1 KiB/451.1 KiB] W1025 09:45:46.302] Operation completed over 1 objects/451.1 KiB. I1025 09:45:46.505] Unpacking kubernetes release v1.18.11-rc.0.13+806617c8cf1f0d I1025 09:45:46.547] Kubernetes release: v1.18.11-rc.0.13+806617c8cf1f0d I1025 09:45:46.548] Server: linux/amd64 (to override, set KUBERNETES_SERVER_ARCH) I1025 09:45:46.548] Client: linux/amd64 (autodetected) (to override, set KUBERNETES_CLIENT_OS and/or KUBERNETES_CLIENT_ARCH) I1025 09:45:46.548] I1025 09:45:46.548] Will download kubernetes-server-linux-amd64.tar.gz from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.13+806617c8cf1f0d I1025 09:45:46.548] Will download and extract kubernetes-client-linux-amd64.tar.gz from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.13+806617c8cf1f0d I1025 09:45:46.549] Will download and extract kubernetes-test tarball(s) from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.13+806617c8cf1f0d W1025 09:45:47.351] % Total % Received % Xferd Average Speed Time Time Time Current W1025 09:45:47.351] Dload Upload Total Spent Left Speed W1025 09:45:49.817] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 518M 0 66989 0 0 559k 0 0:15:50 --:--:-- 0:15:50 554k 42 518M 42 218M 0 0 197M 0 0:00:02 0:00:01 0:00:01 197M 83 518M 83 432M 0 0 205M 0 0:00:02 0:00:02 --:--:-- 205M 100 518M 100 518M 0 0 210M 0 0:00:02 0:00:02 --:--:-- 210M I1025 09:45:49.918] I1025 09:45:51.058] md5sum(kubernetes-server-linux-amd64.tar.gz)=ea57be0441c9a50baf1f36b189bab9f0 I1025 09:45:53.236] sha512sum(kubernetes-server-linux-amd64.tar.gz)=81035a42b39c6d2145ca78ec0e8087fe6e978bc374fcae6a94464fbc1ab7f2b869253ead5349ba964e41996281b57b073af1e1a9491d9efc05275db66bc2ca4b I1025 09:45:53.237] W1025 09:45:54.060] % Total % Received % Xferd Average Speed Time Time Time Current W1025 09:45:54.060] Dload Upload Total Spent Left Speed W1025 09:45:54.315] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 22.3M 100 22.3M 0 0 87.4M 0 --:--:-- --:--:-- --:--:-- 87.4M I1025 09:45:54.416] I1025 09:45:54.416] md5sum(kubernetes-client-linux-amd64.tar.gz)=af86cfc94e787d683b9356d7e9c885d5 I1025 09:45:54.468] sha512sum(kubernetes-client-linux-amd64.tar.gz)=18be55bbf2148dad831cb3e58fea87255c79750f60d4a234506e4598b891d1e916c6fc1527dd8b739239853bbbe97c6a8585779a96c13cabd08b88f6213d41c0 I1025 09:45:54.468] I1025 09:45:54.468] Extracting /workspace/kubernetes/client/kubernetes-client-linux-amd64.tar.gz into /workspace/kubernetes/platforms/linux/amd64 I1025 09:45:54.975] Add '/workspace/kubernetes/client/bin' to your PATH to use newly-installed binaries. W1025 09:45:55.772] % Total % Received % Xferd Average Speed Time Time Time Current W1025 09:45:55.773] Dload Upload Total Spent Left Speed W1025 09:45:55.791] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 210k 100 210k 0 0 10.8M 0 --:--:-- --:--:-- --:--:-- 11.4M I1025 09:45:55.892] I1025 09:45:55.892] md5sum(kubernetes-test-portable.tar.gz)=3d98bb3e68338fcbf277a8ed718967e5 I1025 09:45:55.893] sha512sum(kubernetes-test-portable.tar.gz)=4fae78f783044d1cb0800f74279c526ce2021e8c61289ad6b375329269eb6953f5dda3aa34b670a63e9095afa1405e34953c3462efca3da3d2a3c770e7807e1d I1025 09:45:55.893] I1025 09:45:55.893] Extracting kubernetes-test-portable.tar.gz into /workspace/kubernetes W1025 09:45:56.649] % Total % Received % Xferd Average Speed Time Time Time Current W1025 09:45:56.650] Dload Upload Total Spent Left Speed W1025 09:45:59.721] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 11 348M 11 40.7M 0 0 49.8M 0 0:00:07 --:--:-- 0:00:07 49.7M 27 348M 27 96.0M 0 0 51.5M 0 0:00:06 0:00:01 0:00:05 51.4M 83 348M 83 292M 0 0 104M 0 0:00:03 0:00:02 0:00:01 104M 100 348M 100 348M 0 0 113M 0 0:00:03 0:00:03 --:--:-- 113M I1025 09:45:59.822] I1025 09:46:00.538] md5sum(kubernetes-test-linux-amd64.tar.gz)=f3f18f8d3b34a0dadccefc7e8f86bf02 I1025 09:46:01.973] sha512sum(kubernetes-test-linux-amd64.tar.gz)=4b471afd909b8514842d27ee01caaef1ff1bf50f5f4a042fb831507cbec3366f2bd67681285b3af26ac5e1e5df78456b437111f3195fc191c6026778b92ed226 I1025 09:46:01.973] I1025 09:46:01.973] Extracting /workspace/kubernetes/test/kubernetes-test-linux-amd64.tar.gz into /workspace/kubernetes/platforms/linux/amd64 W1025 09:46:10.881] 2020/10/25 09:46:10 process.go:155: Step './get-kube.sh' finished in 25.812578298s W1025 09:46:10.927] 2020/10/25 09:46:10 extract_k8s.go:295: U=https://storage.googleapis.com/kubernetes-release-dev/ci R=v1.19.4-rc.0.22+9e8ad8ce9d8a30 get-kube.sh W1025 09:46:10.928] 2020/10/25 09:46:10 process.go:153: Running: ./get-kube.sh I1025 09:46:11.028] Found preexisting kubernetes.tar.gz, release v1.18.11-rc.0.13+806617c8cf1f0d I1025 09:46:11.028] Downloading kubernetes release v1.19.4-rc.0.22+9e8ad8ce9d8a30 I1025 09:46:11.029] from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.19.4-rc.0.22+9e8ad8ce9d8a30/kubernetes.tar.gz I1025 09:46:11.029] to /workspace/kubernetes.tar.gz W1025 09:46:12.157] Copying gs://kubernetes-release-dev/ci/v1.19.4-rc.0.22+9e8ad8ce9d8a30/kubernetes.tar.gz... W1025 09:46:12.380] / [0 files][ 0.0 B/480.8 KiB] / [1 files][480.8 KiB/480.8 KiB] W1025 09:46:12.380] Operation completed over 1 objects/480.8 KiB. I1025 09:46:12.569] Unpacking kubernetes release v1.19.4-rc.0.22+9e8ad8ce9d8a30 I1025 09:46:12.629] Kubernetes release: v1.19.4-rc.0.22+9e8ad8ce9d8a30 I1025 09:46:12.630] Server: linux/amd64 (to override, set KUBERNETES_SERVER_ARCH) I1025 09:46:12.630] Client: linux/amd64 (autodetected) (to override, set KUBERNETES_CLIENT_OS and/or KUBERNETES_CLIENT_ARCH) I1025 09:46:12.630] I1025 09:46:12.630] Will download kubernetes-server-linux-amd64.tar.gz from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.19.4-rc.0.22+9e8ad8ce9d8a30 I1025 09:46:12.631] Will download and extract kubernetes-client-linux-amd64.tar.gz from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.19.4-rc.0.22+9e8ad8ce9d8a30 I1025 09:46:12.631] Will download and extract kubernetes-test tarball(s) from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.19.4-rc.0.22+9e8ad8ce9d8a30 W1025 09:46:13.432] % Total % Received % Xferd Average Speed Time Time Time Current W1025 09:46:13.433] Dload Upload Total Spent Left Speed W1025 09:46:17.904] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 499M 0 65592 0 0 604k 0 0:14:05 --:--:-- 0:14:05 598k 5 499M 5 27.4M 0 0 26.9M 0 0:00:18 0:00:01 0:00:17 26.8M 33 499M 33 167M 0 0 82.8M 0 0:00:06 0:00:02 0:00:04 82.8M 53 499M 53 266M 0 0 88.0M 0 0:00:05 0:00:03 0:00:02 88.0M 87 499M 87 438M 0 0 109M 0 0:00:04 0:00:04 --:--:-- 109M 100 499M 100 499M 0 0 111M 0 0:00:04 0:00:04 --:--:-- 114M I1025 09:46:18.005] I1025 09:46:19.063] md5sum(kubernetes-server-linux-amd64.tar.gz)=2307538294fda2fd8d49a41593fcfc8a I1025 09:46:21.103] sha512sum(kubernetes-server-linux-amd64.tar.gz)=9749f4885819b524b7ee2e28c8acfe8a4825c849b18090cc89042e0bc8e858a08c1f73ca0b8a7ae7cfcc3198bf18511cbc7dbaa0e1df1c4cec727b7097dad9de I1025 09:46:21.103] W1025 09:46:22.416] % Total % Received % Xferd Average Speed Time Time Time Current W1025 09:46:22.416] Dload Upload Total Spent Left Speed W1025 09:46:22.665] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 22.6M 0 41030 0 0 417k 0 0:00:55 --:--:-- 0:00:55 413k 100 22.6M 100 22.6M 0 0 91.1M 0 --:--:-- --:--:-- --:--:-- 90.7M I1025 09:46:22.766] I1025 09:46:22.766] md5sum(kubernetes-client-linux-amd64.tar.gz)=5b6a62386f1f564e27ea14bbeea45934 I1025 09:46:22.823] sha512sum(kubernetes-client-linux-amd64.tar.gz)=43a7514ccb245dcc18337a34866f2fe626ba31fde0d75e8bb7bafb55c24404b7b0655a06cf508fbca22f5edcbb23ccbcef9e2094e233b1ba7db44f666efd539f I1025 09:46:22.823] I1025 09:46:22.824] Extracting /workspace/kubernetes/client/kubernetes-client-linux-amd64.tar.gz into /workspace/kubernetes/platforms/linux/amd64 I1025 09:46:23.331] Add '/workspace/kubernetes/client/bin' to your PATH to use newly-installed binaries. W1025 09:46:24.134] % Total % Received % Xferd Average Speed Time Time Time Current W1025 09:46:24.135] Dload Upload Total Spent Left Speed W1025 09:46:24.158] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 216k 100 216k 0 0 9404k 0 --:--:-- --:--:-- --:--:-- 9404k I1025 09:46:24.258] I1025 09:46:24.258] md5sum(kubernetes-test-portable.tar.gz)=961a2820987bdd7624fe6fba8bd9f339 I1025 09:46:24.259] sha512sum(kubernetes-test-portable.tar.gz)=4be812a378e9a6cafa61b76d48c6b235c3cb8b05f18c67959d0699a1e09ba8f93b64f83ece3a09b4cff1e8c3eed6350bad38714eee9e334e114c6b3f90dfd079 I1025 09:46:24.259] I1025 09:46:24.259] Extracting kubernetes-test-portable.tar.gz into /workspace/kubernetes W1025 09:46:24.956] % Total % Received % Xferd Average Speed Time Time Time Current W1025 09:46:24.956] Dload Upload Total Spent Left Speed W1025 09:46:27.996] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 9 349M 9 32.7M 0 0 65.9M 0 0:00:05 --:--:-- 0:00:05 65.8M 31 349M 31 111M 0 0 74.2M 0 0:00:04 0:00:01 0:00:03 74.2M 66 349M 66 231M 0 0 92.4M 0 0:00:03 0:00:02 0:00:01 92.4M 100 349M 100 349M 0 0 115M 0 0:00:03 0:00:03 --:--:-- 115M I1025 09:46:28.096] I1025 09:46:28.825] md5sum(kubernetes-test-linux-amd64.tar.gz)=a50131e1afb65351ad3650707cc24465 I1025 09:46:30.358] sha512sum(kubernetes-test-linux-amd64.tar.gz)=f65a1934503fe402b88c31777417cdf8a44d2352ad7ad3e9d83093d70e7b647b8366d986299aa77caa72a0f31715e592a01a78c54fd273c7586d533ac89cce00 I1025 09:46:30.359] I1025 09:46:30.359] Extracting /workspace/kubernetes/test/kubernetes-test-linux-amd64.tar.gz into /workspace/kubernetes/platforms/linux/amd64 W1025 09:46:38.967] 2020/10/25 09:46:38 process.go:155: Step './get-kube.sh' finished in 28.040411195s W1025 09:46:38.968] 2020/10/25 09:46:38 process.go:153: Running: ./hack/e2e-internal/e2e-down.sh W1025 09:46:39.050] Project: k8s-boskos-gce-project-03 W1025 09:46:39.051] Network Project: k8s-boskos-gce-project-03 W1025 09:46:39.051] Zone: us-west1-b I1025 09:46:39.151] Shutting down test cluster in background. I1025 09:46:41.140] Bringing down cluster using provider: gce W1025 09:46:41.241] ... calling verify-prereqs W1025 09:46:41.769] ... calling verify-kube-binaries W1025 09:46:41.958] ... calling kube-down W1025 09:46:41.958] Project: k8s-boskos-gce-project-03 W1025 09:46:41.958] Network Project: k8s-boskos-gce-project-03 W1025 09:46:41.959] Zone: us-west1-b W1025 09:46:44.148] INSTANCE_GROUPS= W1025 09:46:44.148] NODE_NAMES= I1025 09:46:44.248] Bringing down cluster I1025 09:47:08.185] Deleting firewall rules remaining in network bootstrap-e2e: W1025 09:47:10.286] W1025 09:47:10.286306 1500 loader.go:223] Config not found: /workspace/.kube/config W1025 09:47:10.448] W1025 09:47:10.447769 1552 loader.go:223] Config not found: /workspace/.kube/config W1025 09:47:10.448] W1025 09:47:10.448125 1552 loader.go:223] Config not found: /workspace/.kube/config I1025 09:47:10.549] Property "clusters.k8s-boskos-gce-project-03_bootstrap-e2e" unset. I1025 09:47:10.605] Property "users.k8s-boskos-gce-project-03_bootstrap-e2e" unset. W1025 09:47:10.706] W1025 09:47:10.605322 1603 loader.go:223] Config not found: /workspace/.kube/config W1025 09:47:10.706] W1025 09:47:10.605583 1603 loader.go:223] Config not found: /workspace/.kube/config W1025 09:47:10.761] W1025 09:47:10.761359 1654 loader.go:223] Config not found: /workspace/.kube/config W1025 09:47:10.762] W1025 09:47:10.761652 1654 loader.go:223] Config not found: /workspace/.kube/config I1025 09:47:10.862] Property "users.k8s-boskos-gce-project-03_bootstrap-e2e-basic-auth" unset. I1025 09:47:10.919] Property "contexts.k8s-boskos-gce-project-03_bootstrap-e2e" unset. I1025 09:47:10.923] Cleared config for k8s-boskos-gce-project-03_bootstrap-e2e from /workspace/.kube/config I1025 09:47:10.924] Done W1025 09:47:11.024] W1025 09:47:10.918706 1706 loader.go:223] Config not found: /workspace/.kube/config W1025 09:47:11.024] W1025 09:47:10.918912 1706 loader.go:223] Config not found: /workspace/.kube/config W1025 09:47:11.025] 2020/10/25 09:47:10 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 31.957962045s W1025 09:47:11.025] 2020/10/25 09:47:10 e2e.go:456: Listing resources... W1025 09:47:11.025] 2020/10/25 09:47:10 process.go:153: Running: ./cluster/gce/list-resources.sh W1025 09:47:12.032] Listed 0 items. W1025 09:47:13.068] Listed 0 items. W1025 09:47:15.286] Listed 0 items. W1025 09:47:16.340] Listed 0 items. W1025 09:47:17.462] Listed 0 items. W1025 09:47:19.627] W1025 09:47:19.628] To show all fields of the firewall, please show in JSON format: --format=json W1025 09:47:19.628] To show all fields in table format, please see the examples in --help. W1025 09:47:19.628] W1025 09:47:20.712] Listed 0 items. W1025 09:47:21.759] Listed 0 items. W1025 09:47:22.604] 2020/10/25 09:47:22 process.go:155: Step './cluster/gce/list-resources.sh' finished in 11.678136259s W1025 09:47:22.604] 2020/10/25 09:47:22 process.go:153: Running: ./hack/e2e-internal/e2e-up.sh W1025 09:47:22.663] Project: k8s-boskos-gce-project-03 W1025 09:47:22.663] Network Project: k8s-boskos-gce-project-03 W1025 09:47:22.663] Zone: us-west1-b W1025 09:47:22.717] ... Starting cluster in us-west1-b using provider gce W1025 09:47:22.717] ... calling verify-prereqs W1025 09:47:23.326] ... calling verify-kube-binaries W1025 09:47:23.471] ... calling verify-release-tars W1025 09:47:23.483] ... calling kube-up W1025 09:47:23.490] Project: k8s-boskos-gce-project-03 W1025 09:47:23.490] Network Project: k8s-boskos-gce-project-03 W1025 09:47:23.490] Zone: us-west1-b I1025 09:47:27.046] +++ Staging tars to Google Storage: gs://kubernetes-staging-aea1cae249/bootstrap-e2e-devel I1025 09:47:37.529] +++ kubernetes-server-linux-amd64.tar.gz uploaded (sha512 = 9749f4885819b524b7ee2e28c8acfe8a4825c849b18090cc89042e0bc8e858a08c1f73ca0b8a7ae7cfcc3198bf18511cbc7dbaa0e1df1c4cec727b7097dad9de) I1025 09:47:42.831] +++ kubernetes-manifests.tar.gz uploaded (sha512 = 017e1c19de8510c07757814e1c49bd8a5bc2d25150a19118b6d924f63b9fd468bde4b01f3048856d503e540abf3f828f364fb77d3117d388e9e99d4d58e32f0a) I1025 09:47:43.786] Creating new auto network: bootstrap-e2e W1025 09:48:31.724] Created [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/networks/bootstrap-e2e]. I1025 09:48:31.903] NAME SUBNET_MODE BGP_ROUTING_MODE IPV4_RANGE GATEWAY_IPV4 I1025 09:48:31.904] bootstrap-e2e AUTO REGIONAL W1025 09:48:32.004] W1025 09:48:32.004] Instances on this network will not be reachable until firewall rules W1025 09:48:32.004] are created. As an example, you can allow all internal traffic between W1025 09:48:32.004] instances as well as SSH, RDP, and ICMP by running: W1025 09:48:32.005] W1025 09:48:32.005] $ gcloud compute firewall-rules create --network bootstrap-e2e --allow tcp,udp,icmp --source-ranges W1025 09:48:32.005] $ gcloud compute firewall-rules create --network bootstrap-e2e --allow tcp:22,tcp:3389,icmp W1025 09:48:32.005] I1025 09:48:34.985] IP aliases are disabled. I1025 09:48:36.009] Found subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e I1025 09:48:36.014] Starting master and configuring firewalls I1025 09:48:36.014] Configuring firewall for apiserver konnectivity server W1025 09:48:38.260] Created [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/zones/us-west1-b/disks/bootstrap-e2e-master-pd]. I1025 09:48:38.391] NAME ZONE SIZE_GB TYPE STATUS I1025 09:48:38.391] bootstrap-e2e-master-pd us-west1-b 20 pd-ssd READY W1025 09:48:38.492] W1025 09:48:38.492] New disks are unformatted. You must format and mount a disk before it W1025 09:48:38.492] can be used. You can find instructions on how to do this at: W1025 09:48:38.492] W1025 09:48:38.493] https://cloud.google.com/compute/docs/disks/add-persistent-disk#formatting W1025 09:48:38.493] W1025 09:48:39.253] Creating firewall... W1025 09:48:39.254] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/firewalls/bootstrap-e2e-default-internal-master]. I1025 09:48:39.434] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1025 09:48:39.435] bootstrap-e2e-default-internal-master bootstrap-e2e INGRESS 1000 tcp:1-2379,tcp:2382-65535,udp:1-65535,icmp False W1025 09:48:39.535] done. W1025 09:48:41.893] Creating firewall... W1025 09:48:41.893] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/firewalls/bootstrap-e2e-default-ssh]. W1025 09:48:41.939] Created [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/regions/us-west1/addresses/bootstrap-e2e-master-ip]. W1025 09:48:41.957] Creating firewall... W1025 09:48:41.957] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/firewalls/bootstrap-e2e-master-https]. W1025 09:48:41.971] Creating firewall... W1025 09:48:41.971] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/firewalls/bootstrap-e2e-default-internal-node]. W1025 09:48:42.041] done. W1025 09:48:42.139] done. W1025 09:48:42.193] done. I1025 09:48:42.294] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1025 09:48:42.294] bootstrap-e2e-default-ssh bootstrap-e2e INGRESS 1000 tcp:22 False I1025 09:48:42.295] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1025 09:48:42.295] bootstrap-e2e-default-internal-node bootstrap-e2e INGRESS 1000 tcp:1-65535,udp:1-65535,icmp False I1025 09:48:42.295] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1025 09:48:42.295] bootstrap-e2e-master-https bootstrap-e2e INGRESS 1000 tcp:443 False I1025 09:48:44.397] Generating certs for alternate-names: IP:35.233.181.115,IP:10.0.0.1,DNS:kubernetes,DNS:kubernetes.default,DNS:kubernetes.default.svc,DNS:kubernetes.default.svc.cluster.local,DNS:bootstrap-e2e-master W1025 09:48:45.650] Creating firewall... W1025 09:48:45.650] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/firewalls/bootstrap-e2e-master-etcd]. I1025 09:48:45.846] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1025 09:48:45.847] bootstrap-e2e-master-etcd bootstrap-e2e INGRESS 1000 tcp:2380,tcp:2381 False W1025 09:48:45.947] done. W1025 09:48:46.235] 2020/10/25 09:48:46 [INFO] generating a new CA key and certificate from CSR W1025 09:48:46.235] 2020/10/25 09:48:46 [INFO] generate received request W1025 09:48:46.235] 2020/10/25 09:48:46 [INFO] received CSR W1025 09:48:46.235] 2020/10/25 09:48:46 [INFO] generating key: ecdsa-256 W1025 09:48:46.253] 2020/10/25 09:48:46 [INFO] encoded CSR W1025 09:48:46.254] 2020/10/25 09:48:46 [INFO] signed certificate with serial number 712355567304645262455980305907167649290138288982 W1025 09:48:46.264] 2020/10/25 09:48:46 [INFO] generate received request W1025 09:48:46.264] 2020/10/25 09:48:46 [INFO] received CSR W1025 09:48:46.264] 2020/10/25 09:48:46 [INFO] generating key: ecdsa-256 W1025 09:48:46.282] 2020/10/25 09:48:46 [INFO] encoded CSR W1025 09:48:46.282] 2020/10/25 09:48:46 [INFO] signed certificate with serial number 320825235389413109717541442099426968564778728031 W1025 09:48:46.315] 2020/10/25 09:48:46 [INFO] generate received request W1025 09:48:46.315] 2020/10/25 09:48:46 [INFO] received CSR W1025 09:48:46.316] 2020/10/25 09:48:46 [INFO] generating key: ecdsa-256 W1025 09:48:46.333] 2020/10/25 09:48:46 [INFO] encoded CSR W1025 09:48:46.334] 2020/10/25 09:48:46 [INFO] signed certificate with serial number 261244769131152645128723510704354932863210179689 W1025 09:48:46.349] 2020/10/25 09:48:46 [INFO] generate received request W1025 09:48:46.350] 2020/10/25 09:48:46 [INFO] received CSR W1025 09:48:46.350] 2020/10/25 09:48:46 [INFO] generating key: ecdsa-256 W1025 09:48:46.367] 2020/10/25 09:48:46 [INFO] encoded CSR W1025 09:48:46.368] 2020/10/25 09:48:46 [INFO] signed certificate with serial number 635499158727294244921246434665150050012635203468 W1025 09:48:46.368] 2020/10/25 09:48:46 [WARNING] This certificate lacks a "hosts" field. This makes it unsuitable for W1025 09:48:46.369] websites. For more information see the Baseline Requirements for the Issuance and Management W1025 09:48:46.369] of Publicly-Trusted Certificates, v.1.1.6, from the CA/Browser Forum (https://cabforum.org); W1025 09:48:46.369] specifically, section 10.2.3 ("Information Requirements"). I1025 09:48:46.469] Generate peer certificates... I1025 09:48:46.470] Generate server certificates... I1025 09:48:46.470] Generate client certificates... W1025 09:48:51.404] Creating firewall... W1025 09:48:51.404] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/firewalls/bootstrap-e2e-minion-all]. I1025 09:48:51.576] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1025 09:48:51.577] bootstrap-e2e-minion-all bootstrap-e2e INGRESS 1000 tcp,udp,icmp,esp,ah,sctp False W1025 09:48:51.677] done. W1025 09:48:56.440] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance. W1025 09:48:56.441] Created [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/zones/us-west1-b/instances/bootstrap-e2e-master]. W1025 09:48:56.441] WARNING: Some requests generated warnings: W1025 09:48:56.441] - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details. W1025 09:48:56.441] - The resource 'projects/cos-cloud/global/images/cos-81-12871-59-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-81-12871-69-0'. W1025 09:48:56.441] W1025 09:48:56.442] NAME ZONE MACHINE_TYPE PREEMPTIBLE INTERNAL_IP EXTERNAL_IP STATUS W1025 09:48:56.442] bootstrap-e2e-master us-west1-b n1-standard-1 10.138.0.2 35.233.181.115 RUNNING I1025 09:48:56.542] Creating nodes. W1025 09:48:59.118] /workspace/kubernetes/cluster/../cluster/../cluster/gce/util.sh: line 1526: WINDOWS_CONTAINER_RUNTIME_ENDPOINT: unbound variable I1025 09:48:59.227] Using subnet bootstrap-e2e W1025 09:49:00.183] Attempt 1 to create bootstrap-e2e-minion-template W1025 09:49:00.848] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance. W1025 09:49:02.545] Created [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/instanceTemplates/bootstrap-e2e-minion-template]. W1025 09:49:02.750] NAME MACHINE_TYPE PREEMPTIBLE CREATION_TIMESTAMP W1025 09:49:02.751] bootstrap-e2e-minion-template n1-standard-2 2020-10-25T02:49:01.507-07:00 I1025 09:49:02.894] Using subnet bootstrap-e2e W1025 09:49:03.814] Attempt 1 to create bootstrap-e2e-windows-node-template W1025 09:49:04.489] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance. W1025 09:49:05.931] Created [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/instanceTemplates/bootstrap-e2e-windows-node-template]. W1025 09:49:06.141] NAME MACHINE_TYPE PREEMPTIBLE CREATION_TIMESTAMP W1025 09:49:06.141] bootstrap-e2e-windows-node-template n1-standard-2 2020-10-25T02:49:04.987-07:00 W1025 09:49:17.013] Created [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/zones/us-west1-b/instanceGroupManagers/bootstrap-e2e-minion-group]. I1025 09:49:17.505] NAME LOCATION SCOPE BASE_INSTANCE_NAME SIZE TARGET_SIZE INSTANCE_TEMPLATE AUTOSCALED I1025 09:49:17.506] bootstrap-e2e-minion-group us-west1-b zone bootstrap-e2e-minion-group 0 3 bootstrap-e2e-minion-template no I1025 09:49:29.436] Waiting for group to become stable, current operations: creating: 3 I1025 09:49:29.436] Group is stable W1025 09:49:33.485] INSTANCE_GROUPS=bootstrap-e2e-minion-group W1025 09:49:33.485] NODE_NAMES=bootstrap-e2e-minion-group-7rch bootstrap-e2e-minion-group-gz7f bootstrap-e2e-minion-group-z24g W1025 09:49:33.485] Trying to find master named 'bootstrap-e2e-master' W1025 09:49:33.485] Looking for address 'bootstrap-e2e-master-ip' W1025 09:49:34.505] Using master: bootstrap-e2e-master (external IP: 35.233.181.115; internal IP: (not set)) I1025 09:49:34.606] Waiting up to 300 seconds for cluster initialization. I1025 09:49:34.606] I1025 09:49:34.606] This will continually check to see if the API for kubernetes is reachable. I1025 09:49:34.606] This may time out if there was some uncaught error during start up. I1025 09:49:34.607] I1025 09:54:35.966] ..................................................................................................Checking for custom logdump instances, if any I1025 09:54:35.972] Sourcing kube-util.sh I1025 09:54:36.033] Detecting project I1025 09:54:36.033] Project: k8s-boskos-gce-project-03 I1025 09:54:36.033] Network Project: k8s-boskos-gce-project-03 I1025 09:54:36.033] Zone: us-west1-b I1025 09:54:36.034] Dumping logs from master locally to '/workspace/_artifacts' W1025 09:54:36.134] Cluster failed to initialize within 300 seconds. W1025 09:54:36.135] Last output from querying API server follows: W1025 09:54:36.135] ----------------------------------------------------- W1025 09:54:36.135] * Expire in 0 ms for 6 (transfer 0x55e3ecb19f50) W1025 09:54:36.135] * Expire in 5000 ms for 8 (transfer 0x55e3ecb19f50) W1025 09:54:36.135] * Trying 35.233.181.115... W1025 09:54:36.136] * TCP_NODELAY set W1025 09:54:36.136] * Expire in 200 ms for 4 (transfer 0x55e3ecb19f50) W1025 09:54:36.136] * connect to 35.233.181.115 port 443 failed: Connection refused W1025 09:54:36.136] * Failed to connect to 35.233.181.115 port 443: Connection refused W1025 09:54:36.136] * Closing connection 0 W1025 09:54:36.136] curl: (7) Failed to connect to 35.233.181.115 port 443: Connection refused W1025 09:54:36.137] ----------------------------------------------------- W1025 09:54:36.137] 2020/10/25 09:54:35 process.go:155: Step './hack/e2e-internal/e2e-up.sh' finished in 7m13.359109819s W1025 09:54:36.137] 2020/10/25 09:54:35 e2e.go:544: Dumping logs locally to: /workspace/_artifacts W1025 09:54:36.137] 2020/10/25 09:54:35 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts W1025 09:54:36.138] Trying to find master named 'bootstrap-e2e-master' W1025 09:54:36.138] Looking for address 'bootstrap-e2e-master-ip' W1025 09:54:37.075] Using master: bootstrap-e2e-master (external IP: 35.233.181.115; internal IP: (not set)) I1025 09:55:15.715] Changing logfiles to be world-readable for download I1025 09:55:20.013] Copying 'kube-apiserver.log kube-apiserver-audit.log kube-scheduler.log kube-controller-manager.log etcd.log etcd-events.log glbc.log cluster-autoscaler.log kube-addon-manager.log konnectivity-server.log fluentd.log kubelet.cov startupscript.log' from bootstrap-e2e-master W1025 09:55:21.352] W1025 09:55:21.353] Specify --start=42840 in the next get-serial-port-output invocation to get only the new output starting from here. W1025 09:55:23.878] scp: /var/log/glbc.log*: No such file or directory W1025 09:55:23.879] scp: /var/log/cluster-autoscaler.log*: No such file or directory W1025 09:55:23.879] scp: /var/log/kube-addon-manager.log*: No such file or directory W1025 09:55:23.879] scp: /var/log/konnectivity-server.log*: No such file or directory W1025 09:55:23.879] scp: /var/log/fluentd.log*: No such file or directory W1025 09:55:23.879] scp: /var/log/kubelet.cov*: No such file or directory W1025 09:55:23.880] scp: /var/log/startupscript.log*: No such file or directory W1025 09:55:23.883] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. I1025 09:55:24.051] Dumping logs from nodes locally to '/workspace/_artifacts' I1025 09:55:24.051] Detecting nodes in the cluster I1025 09:56:07.859] Changing logfiles to be world-readable for download I1025 09:56:08.118] Changing logfiles to be world-readable for download I1025 09:56:08.329] Changing logfiles to be world-readable for download I1025 09:56:11.503] Copying 'kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov startupscript.log' from bootstrap-e2e-minion-group-7rch I1025 09:56:11.810] Copying 'kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov startupscript.log' from bootstrap-e2e-minion-group-z24g I1025 09:56:12.067] Copying 'kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov startupscript.log' from bootstrap-e2e-minion-group-gz7f W1025 09:56:12.731] W1025 09:56:12.731] Specify --start=43831 in the next get-serial-port-output invocation to get only the new output starting from here. W1025 09:56:12.962] W1025 09:56:12.962] Specify --start=43818 in the next get-serial-port-output invocation to get only the new output starting from here. W1025 09:56:13.253] W1025 09:56:13.254] Specify --start=43847 in the next get-serial-port-output invocation to get only the new output starting from here. W1025 09:56:14.614] scp: /var/log/fluentd.log*: No such file or directory W1025 09:56:14.614] scp: /var/log/node-problem-detector.log*: No such file or directory W1025 09:56:14.615] scp: /var/log/kubelet.cov*: No such file or directory W1025 09:56:14.615] scp: /var/log/startupscript.log*: No such file or directory W1025 09:56:14.618] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W1025 09:56:14.876] scp: /var/log/fluentd.log*: No such file or directory W1025 09:56:14.876] scp: /var/log/node-problem-detector.log*: No such file or directory W1025 09:56:14.876] scp: /var/log/kubelet.cov*: No such file or directory W1025 09:56:14.877] scp: /var/log/startupscript.log*: No such file or directory W1025 09:56:14.879] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W1025 09:56:15.111] scp: /var/log/fluentd.log*: No such file or directory W1025 09:56:15.111] scp: /var/log/node-problem-detector.log*: No such file or directory W1025 09:56:15.111] scp: /var/log/kubelet.cov*: No such file or directory W1025 09:56:15.111] scp: /var/log/startupscript.log*: No such file or directory W1025 09:56:15.114] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W1025 09:56:19.120] INSTANCE_GROUPS=bootstrap-e2e-minion-group W1025 09:56:19.120] NODE_NAMES=bootstrap-e2e-minion-group-7rch bootstrap-e2e-minion-group-gz7f bootstrap-e2e-minion-group-z24g I1025 09:56:20.308] Failures for bootstrap-e2e-minion-group (if any): W1025 09:56:22.537] 2020/10/25 09:56:22 process.go:155: Step './cluster/log-dump/log-dump.sh /workspace/_artifacts' finished in 1m46.573459597s W1025 09:56:22.537] 2020/10/25 09:56:22 process.go:153: Running: ./hack/e2e-internal/e2e-down.sh W1025 09:56:22.600] Project: k8s-boskos-gce-project-03 W1025 09:56:22.601] Network Project: k8s-boskos-gce-project-03 W1025 09:56:22.601] Zone: us-west1-b I1025 09:56:22.701] Shutting down test cluster in background. I1025 09:56:24.632] Bringing down cluster using provider: gce W1025 09:56:24.732] ... calling verify-prereqs W1025 09:56:25.251] ... calling verify-kube-binaries W1025 09:56:25.400] ... calling kube-down W1025 09:56:25.400] Project: k8s-boskos-gce-project-03 W1025 09:56:25.400] Network Project: k8s-boskos-gce-project-03 W1025 09:56:25.401] Zone: us-west1-b W1025 09:56:29.201] INSTANCE_GROUPS=bootstrap-e2e-minion-group W1025 09:56:29.201] NODE_NAMES=bootstrap-e2e-minion-group-7rch bootstrap-e2e-minion-group-gz7f bootstrap-e2e-minion-group-z24g I1025 09:56:29.302] Bringing down cluster W1025 09:57:17.687] Deleting Managed Instance Group... W1025 09:57:17.687] ..Deleted [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/zones/us-west1-b/instanceGroupManagers/bootstrap-e2e-minion-group]. W1025 09:57:17.690] done. W1025 09:57:22.280] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/instanceTemplates/bootstrap-e2e-windows-node-template]. W1025 09:57:22.401] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/instanceTemplates/bootstrap-e2e-minion-template]. W1025 09:58:26.353] Failed to execute 'curl -s --cacert /etc/srv/kubernetes/pki/etcd-apiserver-ca.crt --cert /etc/srv/kubernetes/pki/etcd-apiserver-client.crt --key /etc/srv/kubernetes/pki/etcd-apiserver-client.key https://127.0.0.1:2379/v2/members/$(curl -s --cacert /etc/srv/kubernetes/pki/etcd-apiserver-ca.crt --cert /etc/srv/kubernetes/pki/etcd-apiserver-client.crt --key /etc/srv/kubernetes/pki/etcd-apiserver-client.key https://127.0.0.1:2379/v2/members -XGET | sed 's/{\"id/\n/g' | grep bootstrap-e2e-master\" | cut -f 3 -d \") -XDELETE -L 2>/dev/null' on bootstrap-e2e-master despite 5 attempts W1025 09:58:26.354] Last attempt failed with: I1025 09:58:26.454] Removing etcd replica, name: bootstrap-e2e-master, port: 2379, result: 1 I1025 09:58:28.349] Successfully executed 'curl -s http://127.0.0.1:4002/v2/members/$(curl -s http://127.0.0.1:4002/v2/members -XGET | sed 's/{\"id/\n/g' | grep bootstrap-e2e-master\" | cut -f 3 -d \") -XDELETE -L 2>/dev/null' on bootstrap-e2e-master I1025 09:58:28.350] Removing etcd replica, name: bootstrap-e2e-master, port: 4002, result: 0 W1025 09:58:33.470] Updated [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/zones/us-west1-b/instances/bootstrap-e2e-master]. W1025 10:00:23.664] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/zones/us-west1-b/instances/bootstrap-e2e-master]. W1025 10:00:32.691] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/firewalls/bootstrap-e2e-master-https]. W1025 10:00:34.655] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/firewalls/bootstrap-e2e-master-etcd]. W1025 10:00:35.402] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/firewalls/bootstrap-e2e-minion-all]. W1025 10:00:40.820] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/regions/us-west1/addresses/bootstrap-e2e-master-ip]. W1025 10:00:51.946] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/firewalls/bootstrap-e2e-default-internal-master]. W1025 10:00:54.477] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/firewalls/bootstrap-e2e-default-internal-node]. W1025 10:00:56.838] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/firewalls/bootstrap-e2e-default-ssh]. I1025 10:00:58.251] Deleting firewall rules remaining in network bootstrap-e2e: W1025 10:01:39.839] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-03/global/networks/bootstrap-e2e]. W1025 10:01:40.184] W1025 10:01:40.184586 10857 loader.go:223] Config not found: /workspace/.kube/config W1025 10:01:40.337] W1025 10:01:40.337541 10909 loader.go:223] Config not found: /workspace/.kube/config W1025 10:01:40.338] W1025 10:01:40.337759 10909 loader.go:223] Config not found: /workspace/.kube/config I1025 10:01:40.438] Property "clusters.k8s-boskos-gce-project-03_bootstrap-e2e" unset. I1025 10:01:40.490] Property "users.k8s-boskos-gce-project-03_bootstrap-e2e" unset. W1025 10:01:40.590] W1025 10:01:40.489784 10961 loader.go:223] Config not found: /workspace/.kube/config W1025 10:01:40.591] W1025 10:01:40.489991 10961 loader.go:223] Config not found: /workspace/.kube/config W1025 10:01:40.640] W1025 10:01:40.640309 11013 loader.go:223] Config not found: /workspace/.kube/config W1025 10:01:40.640] W1025 10:01:40.640533 11013 loader.go:223] Config not found: /workspace/.kube/config I1025 10:01:40.741] Property "users.k8s-boskos-gce-project-03_bootstrap-e2e-basic-auth" unset. I1025 10:01:40.795] Property "contexts.k8s-boskos-gce-project-03_bootstrap-e2e" unset. I1025 10:01:40.799] Cleared config for k8s-boskos-gce-project-03_bootstrap-e2e from /workspace/.kube/config I1025 10:01:40.799] Done W1025 10:01:40.836] W1025 10:01:40.794584 11065 loader.go:223] Config not found: /workspace/.kube/config W1025 10:01:40.836] W1025 10:01:40.794783 11065 loader.go:223] Config not found: /workspace/.kube/config W1025 10:01:40.836] 2020/10/25 10:01:40 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 5m18.2645418s W1025 10:01:40.836] 2020/10/25 10:01:40 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W1025 10:01:40.837] 2020/10/25 10:01:40 main.go:316: Something went wrong: starting e2e cluster: error during ./hack/e2e-internal/e2e-up.sh: exit status 2 W1025 10:01:40.837] Traceback (most recent call last): W1025 10:01:40.837] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 720, in W1025 10:01:40.837] main(parse_args()) W1025 10:01:40.837] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 570, in main W1025 10:01:40.837] mode.start(runner_args) W1025 10:01:40.838] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 228, in start W1025 10:01:40.838] check_env(env, self.command, *args) W1025 10:01:40.838] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W1025 10:01:40.838] subprocess.check_call(cmd, env=env) W1025 10:01:40.838] File "/usr/lib/python2.7/subprocess.py", line 190, in check_call W1025 10:01:40.838] raise CalledProcessError(retcode, cmd) W1025 10:01:40.839] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--provider=gce', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--check-leaked-resources', '--check-version-skew=false', '--extract=ci/k8s-stable1', '--extract=ci/k8s-beta', '--gcp-node-image=gci', '--gcp-zone=us-west1-b', '--ginkgo-parallel', '--skew', '--test_args=--ginkgo.skip=\\[Slow\\]|\\[Serial\\]|\\[Disruptive\\]|\\[Flaky\\]|\\[Feature:.+\\] --kubectl-path=../../../../kubernetes_skew/cluster/kubectl.sh --minStartupPods=8', '--timeout=120m', '--upgrade_args=--ginkgo.focus=\\[Feature:ClusterDowngrade\\] --upgrade-target=ci/k8s-stable1 --upgrade-image=gci')' returned non-zero exit status 1 E1025 10:01:40.839] Command failed I1025 10:01:40.839] process 266 exited with code 1 after 16.0m E1025 10:01:40.839] FAIL: ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel I1025 10:01:40.840] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1025 10:01:41.502] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I1025 10:01:41.609] process 11076 exited with code 0 after 0.0m I1025 10:01:41.610] Call: gcloud config get-value account I1025 10:01:42.188] process 11089 exited with code 0 after 0.0m I1025 10:01:42.189] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I1025 10:01:42.189] Upload result and artifacts... I1025 10:01:42.189] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320300412443561984 I1025 10:01:42.189] Call: gsutil ls gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320300412443561984/artifacts W1025 10:01:43.154] CommandException: One or more URLs matched no objects. E1025 10:01:43.336] Command failed I1025 10:01:43.336] process 11102 exited with code 1 after 0.0m W1025 10:01:43.336] Remote dir gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320300412443561984/artifacts not exist yet I1025 10:01:43.336] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320300412443561984/artifacts I1025 10:01:45.474] process 11245 exited with code 0 after 0.0m I1025 10:01:45.475] Call: git rev-parse HEAD W1025 10:01:45.480] fatal: not a git repository (or any of the parent directories): .git E1025 10:01:45.480] Command failed I1025 10:01:45.480] process 11890 exited with code 128 after 0.0m I1025 10:01:45.480] Call: git rev-parse HEAD I1025 10:01:45.484] process 11891 exited with code 0 after 0.0m I1025 10:01:45.484] Call: gsutil stat gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/jobResultsCache.json I1025 10:01:46.569] process 11892 exited with code 0 after 0.0m I1025 10:01:46.570] Call: gsutil -q cat 'gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/jobResultsCache.json#1603612817844468' I1025 10:01:47.781] process 12035 exited with code 0 after 0.0m I1025 10:01:47.787] Call: gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1603612817844468 cp /tmp/gsutil_YNFgL_ gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/jobResultsCache.json I1025 10:01:49.251] process 12180 exited with code 0 after 0.0m I1025 10:01:49.252] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_sxDq5B gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320300412443561984/finished.json I1025 10:01:50.627] process 12359 exited with code 0 after 0.0m I1025 10:01:50.628] Call: gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_1qRzpc gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/latest-build.txt I1025 10:01:52.022] process 12538 exited with code 0 after 0.0m