W1026 01:53:36.499] ************************************************************************** bootstrap.py is deprecated! test-infra oncall does not support any job still using bootstrap.py. Please migrate your job to podutils! https://github.com/kubernetes/test-infra/blob/master/prow/pod-utilities.md ************************************************************************** I1026 01:53:36.499] Args: --job=ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel --service-account=/etc/service-account/service-account.json --upload=gs://kubernetes-jenkins/logs --timeout=140 --bare --scenario=kubernetes_e2e -- --check-leaked-resources --check-version-skew=false --env=STORAGE_MEDIA_TYPE=application/vnd.kubernetes.protobuf --env=TEST_ETCD_VERSION=3.0.17 --extract=ci/k8s-stable1 --extract=ci/k8s-beta --gcp-node-image=gci --gcp-zone=us-west1-b --ginkgo-parallel --provider=gce --skew '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\] --kubectl-path=../../../../kubernetes_skew/cluster/kubectl.sh --minStartupPods=8' --timeout=120m '--upgrade_args=--ginkgo.focus=\[Feature:ClusterDowngrade\] --upgrade-target=ci/k8s-stable1 --upgrade-image=gci' I1026 01:53:36.499] Bootstrap ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel... I1026 01:53:36.501] Builder: 07515f31-172e-11eb-b256-6ee25ea2e440 I1026 01:53:36.501] Image: gcr.io/k8s-testimages/kubekins-e2e:v20201021-a62ce8a-master I1026 01:53:36.501] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320544015057162240 I1026 01:53:36.502] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1026 01:53:37.117] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I1026 01:53:37.235] process 35 exited with code 0 after 0.0m I1026 01:53:37.235] Call: gcloud config get-value account I1026 01:53:37.829] process 48 exited with code 0 after 0.0m I1026 01:53:37.829] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I1026 01:53:37.830] Root: /workspace I1026 01:53:37.830] cd to /workspace I1026 01:53:37.830] Configure environment... I1026 01:53:37.830] Call: git show -s --format=format:%ct HEAD W1026 01:53:37.834] fatal: not a git repository (or any of the parent directories): .git I1026 01:53:37.834] process 61 exited with code 128 after 0.0m W1026 01:53:37.834] Unable to print commit date for HEAD I1026 01:53:37.834] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1026 01:53:38.496] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I1026 01:53:38.712] process 62 exited with code 0 after 0.0m I1026 01:53:38.712] Call: gcloud config get-value account I1026 01:53:39.332] process 75 exited with code 0 after 0.0m I1026 01:53:39.333] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I1026 01:53:39.333] Start 1320544015057162240 at ... I1026 01:53:39.335] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_An2B5a gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320544015057162240/started.json I1026 01:53:40.876] process 88 exited with code 0 after 0.0m I1026 01:53:40.877] Call: /workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py --check-leaked-resources --check-version-skew=false --env=STORAGE_MEDIA_TYPE=application/vnd.kubernetes.protobuf --env=TEST_ETCD_VERSION=3.0.17 --extract=ci/k8s-stable1 --extract=ci/k8s-beta --gcp-node-image=gci --gcp-zone=us-west1-b --ginkgo-parallel --provider=gce --skew '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\] --kubectl-path=../../../../kubernetes_skew/cluster/kubectl.sh --minStartupPods=8' --timeout=120m '--upgrade_args=--ginkgo.focus=\[Feature:ClusterDowngrade\] --upgrade-target=ci/k8s-stable1 --upgrade-image=gci' W1026 01:53:40.924] starts with local mode W1026 01:53:40.925] Environment: W1026 01:53:40.925] ARTIFACTS=/workspace/_artifacts W1026 01:53:40.925] AWS_SSH_PRIVATE_KEY_FILE=/root/.ssh/kube_aws_rsa W1026 01:53:40.925] AWS_SSH_PUBLIC_KEY_FILE=/root/.ssh/kube_aws_rsa.pub W1026 01:53:40.926] BAZEL_REMOTE_CACHE_ENABLED=false W1026 01:53:40.926] BAZEL_VERSION=2.2.0 W1026 01:53:40.926] BOOTSTRAP_MIGRATION=yes W1026 01:53:40.926] BOSKOS_METRICS_PORT=tcp://10.63.252.110:9090 W1026 01:53:40.926] BOSKOS_METRICS_PORT_9090_TCP=tcp://10.63.252.110:9090 W1026 01:53:40.926] BOSKOS_METRICS_PORT_9090_TCP_ADDR=10.63.252.110 W1026 01:53:40.926] BOSKOS_METRICS_PORT_9090_TCP_PORT=9090 W1026 01:53:40.927] BOSKOS_METRICS_PORT_9090_TCP_PROTO=tcp W1026 01:53:40.927] BOSKOS_METRICS_SERVICE_HOST=10.63.252.110 W1026 01:53:40.927] BOSKOS_METRICS_SERVICE_PORT=9090 W1026 01:53:40.927] BOSKOS_METRICS_SERVICE_PORT_METRICS=9090 W1026 01:53:40.927] BOSKOS_PORT=tcp://10.63.250.132:80 W1026 01:53:40.927] BOSKOS_PORT_80_TCP=tcp://10.63.250.132:80 W1026 01:53:40.927] BOSKOS_PORT_80_TCP_ADDR=10.63.250.132 W1026 01:53:40.927] BOSKOS_PORT_80_TCP_PORT=80 W1026 01:53:40.928] BOSKOS_PORT_80_TCP_PROTO=tcp W1026 01:53:40.928] BOSKOS_SERVICE_HOST=10.63.250.132 W1026 01:53:40.928] BOSKOS_SERVICE_PORT=80 W1026 01:53:40.928] BOSKOS_SERVICE_PORT_DEFAULT=80 W1026 01:53:40.928] BUILD_ID=1320544015057162240 W1026 01:53:40.928] BUILD_NUMBER=1320544015057162240 W1026 01:53:40.928] CI=true W1026 01:53:40.929] CLOUDSDK_COMPONENT_MANAGER_DISABLE_UPDATE_CHECK=true W1026 01:53:40.929] CLOUDSDK_CONFIG=/workspace/.config/gcloud W1026 01:53:40.929] CLOUDSDK_CORE_DISABLE_PROMPTS=1 W1026 01:53:40.929] CLOUDSDK_EXPERIMENTAL_FAST_COMPONENT_UPDATE=false W1026 01:53:40.929] DOCKER_IN_DOCKER_ENABLED=false W1026 01:53:40.929] DOCKER_IN_DOCKER_IPV6_ENABLED=false W1026 01:53:40.929] E2E_GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json W1026 01:53:40.929] GCS_ARTIFACTS_DIR=gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320544015057162240/artifacts W1026 01:53:40.929] GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json W1026 01:53:40.930] GOOGLE_APPLICATION_CREDENTIALS_DEPRECATED=Migrate to workload identity, contact sig-testing W1026 01:53:40.930] GOPATH=/go W1026 01:53:40.930] GOPROXY=https://proxy.golang.org W1026 01:53:40.930] GO_TARBALL=go1.15.2.linux-amd64.tar.gz W1026 01:53:40.930] HOME=/workspace W1026 01:53:40.930] HOSTNAME=07515f31-172e-11eb-b256-6ee25ea2e440 W1026 01:53:40.930] IMAGE=gcr.io/k8s-testimages/kubekins-e2e:v20201021-a62ce8a-master W1026 01:53:40.930] INSTANCE_PREFIX=bootstrap-e2e W1026 01:53:40.931] JENKINS_GCE_SSH_PRIVATE_KEY_FILE=/workspace/.ssh/google_compute_engine W1026 01:53:40.931] JENKINS_GCE_SSH_PUBLIC_KEY_FILE=/workspace/.ssh/google_compute_engine.pub W1026 01:53:40.931] JOB_NAME=ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel W1026 01:53:40.931] JOB_SPEC={"type":"periodic","job":"ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel","buildid":"1320544015057162240","prowjobid":"07515f31-172e-11eb-b256-6ee25ea2e440"} W1026 01:53:40.931] JOB_TYPE=periodic W1026 01:53:40.931] KUBERNETES_PORT=tcp://10.63.240.1:443 W1026 01:53:40.932] KUBERNETES_PORT_443_TCP=tcp://10.63.240.1:443 W1026 01:53:40.932] KUBERNETES_PORT_443_TCP_ADDR=10.63.240.1 W1026 01:53:40.932] KUBERNETES_PORT_443_TCP_PORT=443 W1026 01:53:40.932] KUBERNETES_PORT_443_TCP_PROTO=tcp W1026 01:53:40.932] KUBERNETES_SERVICE_HOST=10.63.240.1 W1026 01:53:40.932] KUBERNETES_SERVICE_PORT=443 W1026 01:53:40.932] KUBERNETES_SERVICE_PORT_HTTPS=443 W1026 01:53:40.933] KUBETEST_IN_DOCKER=true W1026 01:53:40.933] KUBETEST_MANUAL_DUMP=y W1026 01:53:40.933] KUBE_AWS_INSTANCE_PREFIX=bootstrap-e2e W1026 01:53:40.933] KUBE_GCE_INSTANCE_PREFIX=bootstrap-e2e W1026 01:53:40.933] LOG_DUMP_SCRIPT_PATH=/workspace/log-dump.sh W1026 01:53:40.933] NODE_NAME=07515f31-172e-11eb-b256-6ee25ea2e440 W1026 01:53:40.933] PATH=/go/bin:/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/workspace:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin W1026 01:53:40.934] PROW_JOB_ID=07515f31-172e-11eb-b256-6ee25ea2e440 W1026 01:53:40.934] PWD=/workspace W1026 01:53:40.934] SHLVL=2 W1026 01:53:40.934] SOURCE_DATE_EPOCH= W1026 01:53:40.934] STORAGE_MEDIA_TYPE=application/vnd.kubernetes.protobuf W1026 01:53:40.934] TERM=xterm W1026 01:53:40.934] TEST_ETCD_VERSION=3.0.17 W1026 01:53:40.934] USER=prow W1026 01:53:40.934] WORKSPACE=/workspace W1026 01:53:40.935] _=./test-infra/jenkins/bootstrap.py W1026 01:53:40.935] Run: ('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--provider=gce', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--check-leaked-resources', '--check-version-skew=false', '--extract=ci/k8s-stable1', '--extract=ci/k8s-beta', '--gcp-node-image=gci', '--gcp-zone=us-west1-b', '--ginkgo-parallel', '--skew', '--test_args=--ginkgo.skip=\\[Slow\\]|\\[Serial\\]|\\[Disruptive\\]|\\[Flaky\\]|\\[Feature:.+\\] --kubectl-path=../../../../kubernetes_skew/cluster/kubectl.sh --minStartupPods=8', '--timeout=120m', '--upgrade_args=--ginkgo.focus=\\[Feature:ClusterDowngrade\\] --upgrade-target=ci/k8s-stable1 --upgrade-image=gci') W1026 01:53:40.953] 2020/10/26 01:53:40 Warning: Couldn't find directory src/sigs.k8s.io/cloud-provider-azure under any of GOPATH /go, defaulting to /go/src/k8s.io/cloud-provider-azure W1026 01:53:40.955] 2020/10/26 01:53:40 extract_k8s.go:112: Matched extraction strategy: ^ci/(.+)$ W1026 01:53:40.955] 2020/10/26 01:53:40 extract_k8s.go:112: Matched extraction strategy: ^ci/(.+)$ W1026 01:53:40.956] 2020/10/26 01:53:40 main.go:329: Limiting testing to 2h0m0s W1026 01:53:40.956] 2020/10/26 01:53:40 process.go:153: Running: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1026 01:53:41.596] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] W1026 01:53:41.710] 2020/10/26 01:53:41 process.go:155: Step 'gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json' finished in 754.148598ms W1026 01:53:41.710] 2020/10/26 01:53:41 main.go:728: --gcp-project is missing, trying to fetch a project from boskos. W1026 01:53:41.710] (for local runs please set --gcp-project to your dev project) W1026 01:53:41.711] 2020/10/26 01:53:41 main.go:740: provider gce, will acquire project type gce-project from boskos W1026 01:53:41.723] 2020/10/26 01:53:41 process.go:153: Running: gcloud config set project k8s-jkns-e2e-gce-alpha W1026 01:53:42.200] Updated property [core/project]. W1026 01:53:42.473] 2020/10/26 01:53:42 process.go:155: Step 'gcloud config set project k8s-jkns-e2e-gce-alpha' finished in 749.689042ms W1026 01:53:42.474] 2020/10/26 01:53:42 main.go:779: Checking existing of GCP ssh keys... W1026 01:53:42.474] 2020/10/26 01:53:42 main.go:789: Checking presence of public key in k8s-jkns-e2e-gce-alpha W1026 01:53:42.474] 2020/10/26 01:53:42 process.go:153: Running: gcloud compute --project=k8s-jkns-e2e-gce-alpha project-info describe W1026 01:53:43.676] 2020/10/26 01:53:43 process.go:155: Step 'gcloud compute --project=k8s-jkns-e2e-gce-alpha project-info describe' finished in 1.202600758s W1026 01:53:43.676] 2020/10/26 01:53:43 extract_k8s.go:143: rm kubernetes W1026 01:53:43.761] 2020/10/26 01:53:43 extract_k8s.go:295: U=https://storage.googleapis.com/kubernetes-release-dev/ci R=v1.18.11-rc.0.13+806617c8cf1f0d get-kube.sh W1026 01:53:43.761] 2020/10/26 01:53:43 process.go:153: Running: ./get-kube.sh I1026 01:53:43.861] Downloading kubernetes release v1.18.11-rc.0.13+806617c8cf1f0d I1026 01:53:43.862] from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.13+806617c8cf1f0d/kubernetes.tar.gz I1026 01:53:43.862] to /workspace/kubernetes.tar.gz W1026 01:53:44.872] Copying gs://kubernetes-release-dev/ci/v1.18.11-rc.0.13+806617c8cf1f0d/kubernetes.tar.gz... W1026 01:53:44.961] / [0 files][ 0.0 B/451.1 KiB] / [1 files][451.1 KiB/451.1 KiB] W1026 01:53:44.961] Operation completed over 1 objects/451.1 KiB. I1026 01:53:45.178] Unpacking kubernetes release v1.18.11-rc.0.13+806617c8cf1f0d I1026 01:53:45.221] Kubernetes release: v1.18.11-rc.0.13+806617c8cf1f0d I1026 01:53:45.221] Server: linux/amd64 (to override, set KUBERNETES_SERVER_ARCH) I1026 01:53:45.222] Client: linux/amd64 (autodetected) (to override, set KUBERNETES_CLIENT_OS and/or KUBERNETES_CLIENT_ARCH) I1026 01:53:45.222] I1026 01:53:45.222] Will download kubernetes-server-linux-amd64.tar.gz from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.13+806617c8cf1f0d I1026 01:53:45.222] Will download and extract kubernetes-client-linux-amd64.tar.gz from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.13+806617c8cf1f0d I1026 01:53:45.223] Will download and extract kubernetes-test tarball(s) from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.13+806617c8cf1f0d W1026 01:53:46.006] % Total % Received % Xferd Average Speed Time Time Time Current W1026 01:53:46.006] Dload Upload Total Spent Left Speed W1026 01:53:48.221] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 6 518M 6 34.0M 0 0 108M 0 0:00:04 --:--:-- 0:00:04 108M 59 518M 59 310M 0 0 236M 0 0:00:02 0:00:01 0:00:01 235M 100 518M 100 518M 0 0 234M 0 0:00:02 0:00:02 --:--:-- 234M I1026 01:53:48.322] I1026 01:53:49.458] md5sum(kubernetes-server-linux-amd64.tar.gz)=ea57be0441c9a50baf1f36b189bab9f0 I1026 01:53:51.576] sha512sum(kubernetes-server-linux-amd64.tar.gz)=81035a42b39c6d2145ca78ec0e8087fe6e978bc374fcae6a94464fbc1ab7f2b869253ead5349ba964e41996281b57b073af1e1a9491d9efc05275db66bc2ca4b I1026 01:53:51.577] W1026 01:53:52.375] % Total % Received % Xferd Average Speed Time Time Time Current W1026 01:53:52.375] Dload Upload Total Spent Left Speed W1026 01:53:52.576] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 22.3M 100 22.3M 0 0 110M 0 --:--:-- --:--:-- --:--:-- 110M I1026 01:53:52.677] I1026 01:53:52.677] md5sum(kubernetes-client-linux-amd64.tar.gz)=af86cfc94e787d683b9356d7e9c885d5 I1026 01:53:52.728] sha512sum(kubernetes-client-linux-amd64.tar.gz)=18be55bbf2148dad831cb3e58fea87255c79750f60d4a234506e4598b891d1e916c6fc1527dd8b739239853bbbe97c6a8585779a96c13cabd08b88f6213d41c0 I1026 01:53:52.728] I1026 01:53:52.729] Extracting /workspace/kubernetes/client/kubernetes-client-linux-amd64.tar.gz into /workspace/kubernetes/platforms/linux/amd64 I1026 01:53:53.243] Add '/workspace/kubernetes/client/bin' to your PATH to use newly-installed binaries. W1026 01:53:54.004] % Total % Received % Xferd Average Speed Time Time Time Current W1026 01:53:54.004] Dload Upload Total Spent Left Speed W1026 01:53:54.026] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 210k 100 210k 0 0 9580k 0 --:--:-- --:--:-- --:--:-- 9580k I1026 01:53:54.127] I1026 01:53:54.127] md5sum(kubernetes-test-portable.tar.gz)=3d98bb3e68338fcbf277a8ed718967e5 I1026 01:53:54.128] sha512sum(kubernetes-test-portable.tar.gz)=4fae78f783044d1cb0800f74279c526ce2021e8c61289ad6b375329269eb6953f5dda3aa34b670a63e9095afa1405e34953c3462efca3da3d2a3c770e7807e1d I1026 01:53:54.128] I1026 01:53:54.128] Extracting kubernetes-test-portable.tar.gz into /workspace/kubernetes W1026 01:53:54.846] % Total % Received % Xferd Average Speed Time Time Time Current W1026 01:53:54.847] Dload Upload Total Spent Left Speed W1026 01:53:56.612] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 18 348M 18 64.7M 0 0 135M 0 0:00:02 --:--:-- 0:00:02 135M 81 348M 81 284M 0 0 192M 0 0:00:01 0:00:01 --:--:-- 192M 100 348M 100 348M 0 0 197M 0 0:00:01 0:00:01 --:--:-- 197M I1026 01:53:56.713] I1026 01:53:57.424] md5sum(kubernetes-test-linux-amd64.tar.gz)=f3f18f8d3b34a0dadccefc7e8f86bf02 I1026 01:53:58.820] sha512sum(kubernetes-test-linux-amd64.tar.gz)=4b471afd909b8514842d27ee01caaef1ff1bf50f5f4a042fb831507cbec3366f2bd67681285b3af26ac5e1e5df78456b437111f3195fc191c6026778b92ed226 I1026 01:53:58.820] I1026 01:53:58.820] Extracting /workspace/kubernetes/test/kubernetes-test-linux-amd64.tar.gz into /workspace/kubernetes/platforms/linux/amd64 W1026 01:54:07.312] 2020/10/26 01:54:07 process.go:155: Step './get-kube.sh' finished in 23.550608919s W1026 01:54:07.345] 2020/10/26 01:54:07 extract_k8s.go:295: U=https://storage.googleapis.com/kubernetes-release-dev/ci R=v1.19.4-rc.0.22+9e8ad8ce9d8a30 get-kube.sh W1026 01:54:07.345] 2020/10/26 01:54:07 process.go:153: Running: ./get-kube.sh I1026 01:54:07.446] Found preexisting kubernetes.tar.gz, release v1.18.11-rc.0.13+806617c8cf1f0d I1026 01:54:07.446] Downloading kubernetes release v1.19.4-rc.0.22+9e8ad8ce9d8a30 I1026 01:54:07.446] from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.19.4-rc.0.22+9e8ad8ce9d8a30/kubernetes.tar.gz I1026 01:54:07.446] to /workspace/kubernetes.tar.gz W1026 01:54:08.580] Copying gs://kubernetes-release-dev/ci/v1.19.4-rc.0.22+9e8ad8ce9d8a30/kubernetes.tar.gz... W1026 01:54:08.699] / [0 files][ 0.0 B/480.8 KiB] / [1 files][480.8 KiB/480.8 KiB] W1026 01:54:08.699] Operation completed over 1 objects/480.8 KiB. I1026 01:54:08.882] Unpacking kubernetes release v1.19.4-rc.0.22+9e8ad8ce9d8a30 I1026 01:54:08.952] Kubernetes release: v1.19.4-rc.0.22+9e8ad8ce9d8a30 I1026 01:54:08.952] Server: linux/amd64 (to override, set KUBERNETES_SERVER_ARCH) I1026 01:54:08.952] Client: linux/amd64 (autodetected) (to override, set KUBERNETES_CLIENT_OS and/or KUBERNETES_CLIENT_ARCH) I1026 01:54:08.952] I1026 01:54:08.952] Will download kubernetes-server-linux-amd64.tar.gz from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.19.4-rc.0.22+9e8ad8ce9d8a30 I1026 01:54:08.953] Will download and extract kubernetes-client-linux-amd64.tar.gz from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.19.4-rc.0.22+9e8ad8ce9d8a30 I1026 01:54:08.953] Will download and extract kubernetes-test tarball(s) from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.19.4-rc.0.22+9e8ad8ce9d8a30 W1026 01:54:09.793] % Total % Received % Xferd Average Speed Time Time Time Current W1026 01:54:09.793] Dload Upload Total Spent Left Speed W1026 01:54:14.035] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 4 499M 4 24.7M 0 0 42.8M 0 0:00:11 --:--:-- 0:00:11 42.8M 15 499M 15 75.9M 0 0 49.7M 0 0:00:10 0:00:01 0:00:09 49.6M 40 499M 40 201M 0 0 79.7M 0 0:00:06 0:00:02 0:00:04 79.6M 79 499M 79 398M 0 0 112M 0 0:00:04 0:00:03 0:00:01 112M 100 499M 100 499M 0 0 117M 0 0:00:04 0:00:04 --:--:-- 117M I1026 01:54:14.135] I1026 01:54:15.173] md5sum(kubernetes-server-linux-amd64.tar.gz)=2307538294fda2fd8d49a41593fcfc8a I1026 01:54:17.139] sha512sum(kubernetes-server-linux-amd64.tar.gz)=9749f4885819b524b7ee2e28c8acfe8a4825c849b18090cc89042e0bc8e858a08c1f73ca0b8a7ae7cfcc3198bf18511cbc7dbaa0e1df1c4cec727b7097dad9de I1026 01:54:17.139] W1026 01:54:17.933] % Total % Received % Xferd Average Speed Time Time Time Current W1026 01:54:17.934] Dload Upload Total Spent Left Speed W1026 01:54:18.201] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 22.6M 100 22.6M 0 0 84.9M 0 --:--:-- --:--:-- --:--:-- 84.9M I1026 01:54:18.301] I1026 01:54:18.302] md5sum(kubernetes-client-linux-amd64.tar.gz)=5b6a62386f1f564e27ea14bbeea45934 I1026 01:54:18.354] sha512sum(kubernetes-client-linux-amd64.tar.gz)=43a7514ccb245dcc18337a34866f2fe626ba31fde0d75e8bb7bafb55c24404b7b0655a06cf508fbca22f5edcbb23ccbcef9e2094e233b1ba7db44f666efd539f I1026 01:54:18.355] I1026 01:54:18.355] Extracting /workspace/kubernetes/client/kubernetes-client-linux-amd64.tar.gz into /workspace/kubernetes/platforms/linux/amd64 I1026 01:54:18.854] Add '/workspace/kubernetes/client/bin' to your PATH to use newly-installed binaries. W1026 01:54:19.741] % Total % Received % Xferd Average Speed Time Time Time Current W1026 01:54:19.742] Dload Upload Total Spent Left Speed W1026 01:54:19.758] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 216k 100 216k 0 0 13.2M 0 --:--:-- --:--:-- --:--:-- 13.2M I1026 01:54:19.859] I1026 01:54:19.859] md5sum(kubernetes-test-portable.tar.gz)=961a2820987bdd7624fe6fba8bd9f339 I1026 01:54:19.859] sha512sum(kubernetes-test-portable.tar.gz)=4be812a378e9a6cafa61b76d48c6b235c3cb8b05f18c67959d0699a1e09ba8f93b64f83ece3a09b4cff1e8c3eed6350bad38714eee9e334e114c6b3f90dfd079 I1026 01:54:19.859] I1026 01:54:19.860] Extracting kubernetes-test-portable.tar.gz into /workspace/kubernetes W1026 01:54:20.956] % Total % Received % Xferd Average Speed Time Time Time Current W1026 01:54:20.956] Dload Upload Total Spent Left Speed W1026 01:54:23.061] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 3 349M 3 13.6M 0 0 37.1M 0 0:00:09 --:--:-- 0:00:09 37.0M 54 349M 54 190M 0 0 139M 0 0:00:02 0:00:01 0:00:01 139M 100 349M 100 349M 0 0 166M 0 0:00:02 0:00:02 --:--:-- 166M I1026 01:54:23.162] I1026 01:54:23.866] md5sum(kubernetes-test-linux-amd64.tar.gz)=a50131e1afb65351ad3650707cc24465 I1026 01:54:25.251] sha512sum(kubernetes-test-linux-amd64.tar.gz)=f65a1934503fe402b88c31777417cdf8a44d2352ad7ad3e9d83093d70e7b647b8366d986299aa77caa72a0f31715e592a01a78c54fd273c7586d533ac89cce00 I1026 01:54:25.251] I1026 01:54:25.251] Extracting /workspace/kubernetes/test/kubernetes-test-linux-amd64.tar.gz into /workspace/kubernetes/platforms/linux/amd64 W1026 01:54:33.404] 2020/10/26 01:54:33 process.go:155: Step './get-kube.sh' finished in 26.058849515s W1026 01:54:33.404] 2020/10/26 01:54:33 process.go:153: Running: ./hack/e2e-internal/e2e-down.sh W1026 01:54:33.463] Project: k8s-jkns-e2e-gce-alpha W1026 01:54:33.463] Network Project: k8s-jkns-e2e-gce-alpha W1026 01:54:33.463] Zone: us-west1-b I1026 01:54:33.563] Shutting down test cluster in background. I1026 01:54:35.697] Bringing down cluster using provider: gce W1026 01:54:35.797] ... calling verify-prereqs W1026 01:54:36.386] ... calling verify-kube-binaries W1026 01:54:36.552] ... calling kube-down W1026 01:54:36.552] Project: k8s-jkns-e2e-gce-alpha W1026 01:54:36.552] Network Project: k8s-jkns-e2e-gce-alpha W1026 01:54:36.552] Zone: us-west1-b W1026 01:54:38.964] INSTANCE_GROUPS= W1026 01:54:38.964] NODE_NAMES= I1026 01:54:39.065] Bringing down cluster I1026 01:55:08.977] Deleting firewall rules remaining in network bootstrap-e2e: W1026 01:55:11.594] W1026 01:55:11.593902 1502 loader.go:223] Config not found: /workspace/.kube/config W1026 01:55:11.792] W1026 01:55:11.792616 1554 loader.go:223] Config not found: /workspace/.kube/config W1026 01:55:11.793] W1026 01:55:11.792952 1554 loader.go:223] Config not found: /workspace/.kube/config I1026 01:55:11.893] Property "clusters.k8s-jkns-e2e-gce-alpha_bootstrap-e2e" unset. I1026 01:55:11.983] Property "users.k8s-jkns-e2e-gce-alpha_bootstrap-e2e" unset. W1026 01:55:12.084] W1026 01:55:11.983093 1606 loader.go:223] Config not found: /workspace/.kube/config W1026 01:55:12.084] W1026 01:55:11.983322 1606 loader.go:223] Config not found: /workspace/.kube/config W1026 01:55:12.191] W1026 01:55:12.191339 1658 loader.go:223] Config not found: /workspace/.kube/config W1026 01:55:12.192] W1026 01:55:12.191630 1658 loader.go:223] Config not found: /workspace/.kube/config I1026 01:55:12.292] Property "users.k8s-jkns-e2e-gce-alpha_bootstrap-e2e-basic-auth" unset. I1026 01:55:12.384] Property "contexts.k8s-jkns-e2e-gce-alpha_bootstrap-e2e" unset. I1026 01:55:12.389] Cleared config for k8s-jkns-e2e-gce-alpha_bootstrap-e2e from /workspace/.kube/config I1026 01:55:12.390] Done W1026 01:55:12.491] W1026 01:55:12.383779 1710 loader.go:223] Config not found: /workspace/.kube/config W1026 01:55:12.491] W1026 01:55:12.383972 1710 loader.go:223] Config not found: /workspace/.kube/config W1026 01:55:12.491] 2020/10/26 01:55:12 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 38.988831047s W1026 01:55:12.492] 2020/10/26 01:55:12 e2e.go:456: Listing resources... W1026 01:55:12.492] 2020/10/26 01:55:12 process.go:153: Running: ./cluster/gce/list-resources.sh W1026 01:55:13.569] Listed 0 items. W1026 01:55:14.852] Listed 0 items. W1026 01:55:17.124] Listed 0 items. W1026 01:55:19.172] Listed 0 items. W1026 01:55:21.432] Listed 0 items. W1026 01:55:23.735] W1026 01:55:23.736] To show all fields of the firewall, please show in JSON format: --format=json W1026 01:55:23.736] To show all fields in table format, please see the examples in --help. W1026 01:55:23.736] W1026 01:55:24.887] Listed 0 items. W1026 01:55:26.004] Listed 0 items. W1026 01:55:26.883] 2020/10/26 01:55:26 process.go:155: Step './cluster/gce/list-resources.sh' finished in 14.490567699s W1026 01:55:26.884] 2020/10/26 01:55:26 process.go:153: Running: ./hack/e2e-internal/e2e-up.sh W1026 01:55:26.941] Project: k8s-jkns-e2e-gce-alpha W1026 01:55:26.941] Network Project: k8s-jkns-e2e-gce-alpha W1026 01:55:26.941] Zone: us-west1-b W1026 01:55:26.992] ... Starting cluster in us-west1-b using provider gce W1026 01:55:26.992] ... calling verify-prereqs W1026 01:55:27.630] ... calling verify-kube-binaries W1026 01:55:27.774] ... calling verify-release-tars W1026 01:55:27.786] ... calling kube-up W1026 01:55:27.797] Project: k8s-jkns-e2e-gce-alpha W1026 01:55:27.797] Network Project: k8s-jkns-e2e-gce-alpha W1026 01:55:27.798] Zone: us-west1-b I1026 01:55:31.319] +++ Staging tars to Google Storage: gs://kubernetes-staging-233f88fc9e/bootstrap-e2e-devel I1026 01:55:34.814] +++ kubernetes-server-linux-amd64.tar.gz uploaded earlier, cloud and local file md5 match (md5 = 2307538294fda2fd8d49a41593fcfc8a) I1026 01:55:36.973] +++ kubernetes-manifests.tar.gz uploaded earlier, cloud and local file md5 match (md5 = 227a521532d23f84fadefe1d009d301f) I1026 01:55:37.935] Creating new auto network: bootstrap-e2e W1026 01:56:17.900] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/networks/bootstrap-e2e]. I1026 01:56:18.070] NAME SUBNET_MODE BGP_ROUTING_MODE IPV4_RANGE GATEWAY_IPV4 I1026 01:56:18.070] bootstrap-e2e AUTO REGIONAL W1026 01:56:18.171] W1026 01:56:18.171] Instances on this network will not be reachable until firewall rules W1026 01:56:18.171] are created. As an example, you can allow all internal traffic between W1026 01:56:18.172] instances as well as SSH, RDP, and ICMP by running: W1026 01:56:18.172] W1026 01:56:18.172] $ gcloud compute firewall-rules create --network bootstrap-e2e --allow tcp,udp,icmp --source-ranges W1026 01:56:18.172] $ gcloud compute firewall-rules create --network bootstrap-e2e --allow tcp:22,tcp:3389,icmp W1026 01:56:18.172] I1026 01:56:21.411] IP aliases are disabled. I1026 01:56:22.408] Found subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e I1026 01:56:22.413] Starting master and configuring firewalls I1026 01:56:22.413] Configuring firewall for apiserver konnectivity server W1026 01:56:23.725] Creating firewall... W1026 01:56:23.726] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/firewalls/bootstrap-e2e-default-internal-master]. I1026 01:56:23.963] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1026 01:56:23.963] bootstrap-e2e-default-internal-master bootstrap-e2e INGRESS 1000 tcp:1-2379,tcp:2382-65535,udp:1-65535,icmp False W1026 01:56:24.064] done. W1026 01:56:24.388] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/zones/us-west1-b/disks/bootstrap-e2e-master-pd]. I1026 01:56:24.532] NAME ZONE SIZE_GB TYPE STATUS I1026 01:56:24.533] bootstrap-e2e-master-pd us-west1-b 20 pd-ssd READY W1026 01:56:24.633] W1026 01:56:24.634] New disks are unformatted. You must format and mount a disk before it W1026 01:56:24.634] can be used. You can find instructions on how to do this at: W1026 01:56:24.634] W1026 01:56:24.634] https://cloud.google.com/compute/docs/disks/add-persistent-disk#formatting W1026 01:56:24.634] W1026 01:56:25.872] Creating firewall... W1026 01:56:25.873] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/firewalls/bootstrap-e2e-default-internal-node]. I1026 01:56:26.037] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1026 01:56:26.038] bootstrap-e2e-default-internal-node bootstrap-e2e INGRESS 1000 tcp:1-65535,udp:1-65535,icmp False W1026 01:56:26.138] done. W1026 01:56:27.802] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/regions/us-west1/addresses/bootstrap-e2e-master-ip]. W1026 01:56:27.969] Creating firewall... W1026 01:56:27.969] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/firewalls/bootstrap-e2e-master-https]. W1026 01:56:27.976] Creating firewall... W1026 01:56:27.976] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/firewalls/bootstrap-e2e-default-ssh]. I1026 01:56:28.153] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1026 01:56:28.153] bootstrap-e2e-master-https bootstrap-e2e INGRESS 1000 tcp:443 False I1026 01:56:28.172] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1026 01:56:28.172] bootstrap-e2e-default-ssh bootstrap-e2e INGRESS 1000 tcp:22 False W1026 01:56:28.273] done. W1026 01:56:28.273] done. I1026 01:56:30.396] Generating certs for alternate-names: IP:35.233.254.186,IP:10.0.0.1,DNS:kubernetes,DNS:kubernetes.default,DNS:kubernetes.default.svc,DNS:kubernetes.default.svc.cluster.local,DNS:bootstrap-e2e-master W1026 01:56:30.496] Creating firewall... W1026 01:56:30.497] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/firewalls/bootstrap-e2e-master-etcd]. I1026 01:56:30.638] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1026 01:56:30.638] bootstrap-e2e-master-etcd bootstrap-e2e INGRESS 1000 tcp:2380,tcp:2381 False W1026 01:56:30.739] done. W1026 01:56:32.513] 2020/10/26 01:56:32 [INFO] generating a new CA key and certificate from CSR W1026 01:56:32.513] 2020/10/26 01:56:32 [INFO] generate received request W1026 01:56:32.513] 2020/10/26 01:56:32 [INFO] received CSR W1026 01:56:32.513] 2020/10/26 01:56:32 [INFO] generating key: ecdsa-256 W1026 01:56:32.531] 2020/10/26 01:56:32 [INFO] encoded CSR W1026 01:56:32.532] 2020/10/26 01:56:32 [INFO] signed certificate with serial number 355225317763254082121669079362016295731980330814 W1026 01:56:32.542] 2020/10/26 01:56:32 [INFO] generate received request W1026 01:56:32.542] 2020/10/26 01:56:32 [INFO] received CSR W1026 01:56:32.542] 2020/10/26 01:56:32 [INFO] generating key: ecdsa-256 W1026 01:56:32.560] 2020/10/26 01:56:32 [INFO] encoded CSR W1026 01:56:32.560] 2020/10/26 01:56:32 [INFO] signed certificate with serial number 192523060308752212174171537935017742610042900766 W1026 01:56:32.592] 2020/10/26 01:56:32 [INFO] generate received request W1026 01:56:32.592] 2020/10/26 01:56:32 [INFO] received CSR W1026 01:56:32.592] 2020/10/26 01:56:32 [INFO] generating key: ecdsa-256 W1026 01:56:32.610] 2020/10/26 01:56:32 [INFO] encoded CSR W1026 01:56:32.611] 2020/10/26 01:56:32 [INFO] signed certificate with serial number 138344250900835834814954325277435068105580919280 W1026 01:56:32.627] 2020/10/26 01:56:32 [INFO] generate received request W1026 01:56:32.627] 2020/10/26 01:56:32 [INFO] received CSR W1026 01:56:32.627] 2020/10/26 01:56:32 [INFO] generating key: ecdsa-256 W1026 01:56:32.645] 2020/10/26 01:56:32 [INFO] encoded CSR W1026 01:56:32.646] 2020/10/26 01:56:32 [INFO] signed certificate with serial number 503530916368732371534205670095744562250997145355 W1026 01:56:32.646] 2020/10/26 01:56:32 [WARNING] This certificate lacks a "hosts" field. This makes it unsuitable for W1026 01:56:32.646] websites. For more information see the Baseline Requirements for the Issuance and Management W1026 01:56:32.646] of Publicly-Trusted Certificates, v.1.1.6, from the CA/Browser Forum (https://cabforum.org); W1026 01:56:32.647] specifically, section 10.2.3 ("Information Requirements"). I1026 01:56:32.747] Generate peer certificates... I1026 01:56:32.747] Generate server certificates... I1026 01:56:32.747] Generate client certificates... W1026 01:56:37.306] Creating firewall... W1026 01:56:37.307] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/firewalls/bootstrap-e2e-minion-all]. I1026 01:56:37.471] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I1026 01:56:37.471] bootstrap-e2e-minion-all bootstrap-e2e INGRESS 1000 tcp,udp,icmp,esp,ah,sctp False W1026 01:56:37.572] done. W1026 01:56:42.800] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance. W1026 01:56:42.801] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master]. W1026 01:56:42.801] WARNING: Some requests generated warnings: W1026 01:56:42.801] - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details. W1026 01:56:42.801] - The resource 'projects/cos-cloud/global/images/cos-81-12871-59-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-81-12871-69-0'. W1026 01:56:42.801] W1026 01:56:42.802] NAME ZONE MACHINE_TYPE PREEMPTIBLE INTERNAL_IP EXTERNAL_IP STATUS W1026 01:56:42.802] bootstrap-e2e-master us-west1-b n1-standard-1 10.138.0.2 35.233.254.186 RUNNING I1026 01:56:42.902] Creating nodes. W1026 01:56:45.265] /workspace/kubernetes/cluster/../cluster/../cluster/gce/util.sh: line 1526: WINDOWS_CONTAINER_RUNTIME_ENDPOINT: unbound variable I1026 01:56:45.366] Using subnet bootstrap-e2e W1026 01:56:46.370] Attempt 1 to create bootstrap-e2e-minion-template W1026 01:56:47.030] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance. W1026 01:56:49.208] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/instanceTemplates/bootstrap-e2e-minion-template]. W1026 01:56:49.406] NAME MACHINE_TYPE PREEMPTIBLE CREATION_TIMESTAMP W1026 01:56:49.407] bootstrap-e2e-minion-template n1-standard-2 2020-10-25T18:56:47.816-07:00 I1026 01:56:49.620] Using subnet bootstrap-e2e W1026 01:56:50.640] Attempt 1 to create bootstrap-e2e-windows-node-template W1026 01:56:51.321] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance. W1026 01:56:53.179] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/instanceTemplates/bootstrap-e2e-windows-node-template]. W1026 01:56:53.477] NAME MACHINE_TYPE PREEMPTIBLE CREATION_TIMESTAMP W1026 01:56:53.477] bootstrap-e2e-windows-node-template n1-standard-2 2020-10-25T18:56:51.938-07:00 W1026 01:57:00.285] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/zones/us-west1-b/instanceGroupManagers/bootstrap-e2e-minion-group]. I1026 01:57:00.660] NAME LOCATION SCOPE BASE_INSTANCE_NAME SIZE TARGET_SIZE INSTANCE_TEMPLATE AUTOSCALED I1026 01:57:00.660] bootstrap-e2e-minion-group us-west1-b zone bootstrap-e2e-minion-group 0 3 bootstrap-e2e-minion-template no I1026 01:57:11.878] Waiting for group to become stable, current operations: creating: 3 I1026 01:57:11.879] Group is stable W1026 01:57:15.622] INSTANCE_GROUPS=bootstrap-e2e-minion-group W1026 01:57:15.623] NODE_NAMES=bootstrap-e2e-minion-group-0b73 bootstrap-e2e-minion-group-723b bootstrap-e2e-minion-group-qnng W1026 01:57:15.623] Trying to find master named 'bootstrap-e2e-master' W1026 01:57:15.623] Looking for address 'bootstrap-e2e-master-ip' W1026 01:57:16.645] Using master: bootstrap-e2e-master (external IP: 35.233.254.186; internal IP: (not set)) I1026 01:57:16.746] Waiting up to 300 seconds for cluster initialization. I1026 01:57:16.746] I1026 01:57:16.747] This will continually check to see if the API for kubernetes is reachable. I1026 01:57:16.747] This may time out if there was some uncaught error during start up. I1026 01:57:16.747] I1026 02:02:18.220] ................................................................................................Checking for custom logdump instances, if any I1026 02:02:18.227] Sourcing kube-util.sh I1026 02:02:18.283] Detecting project I1026 02:02:18.284] Project: k8s-jkns-e2e-gce-alpha I1026 02:02:18.284] Network Project: k8s-jkns-e2e-gce-alpha I1026 02:02:18.284] Zone: us-west1-b I1026 02:02:18.284] Dumping logs from master locally to '/workspace/_artifacts' W1026 02:02:18.385] Cluster failed to initialize within 300 seconds. W1026 02:02:18.385] Last output from querying API server follows: W1026 02:02:18.385] ----------------------------------------------------- W1026 02:02:18.385] * Expire in 0 ms for 6 (transfer 0x55f4f8769f50) W1026 02:02:18.385] * Expire in 5000 ms for 8 (transfer 0x55f4f8769f50) W1026 02:02:18.385] * Trying 35.233.254.186... W1026 02:02:18.385] * TCP_NODELAY set W1026 02:02:18.385] * Expire in 200 ms for 4 (transfer 0x55f4f8769f50) W1026 02:02:18.386] * connect to 35.233.254.186 port 443 failed: Connection refused W1026 02:02:18.386] * Failed to connect to 35.233.254.186 port 443: Connection refused W1026 02:02:18.386] * Closing connection 0 W1026 02:02:18.386] curl: (7) Failed to connect to 35.233.254.186 port 443: Connection refused W1026 02:02:18.386] ----------------------------------------------------- W1026 02:02:18.386] 2020/10/26 02:02:18 process.go:155: Step './hack/e2e-internal/e2e-up.sh' finished in 6m51.333638641s W1026 02:02:18.386] 2020/10/26 02:02:18 e2e.go:544: Dumping logs locally to: /workspace/_artifacts W1026 02:02:18.386] 2020/10/26 02:02:18 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts W1026 02:02:18.387] Trying to find master named 'bootstrap-e2e-master' W1026 02:02:18.387] Looking for address 'bootstrap-e2e-master-ip' W1026 02:02:19.395] Using master: bootstrap-e2e-master (external IP: 35.233.254.186; internal IP: (not set)) I1026 02:02:53.575] Changing logfiles to be world-readable for download I1026 02:02:57.411] Copying 'kube-apiserver.log kube-apiserver-audit.log kube-scheduler.log kube-controller-manager.log etcd.log etcd-events.log glbc.log cluster-autoscaler.log kube-addon-manager.log konnectivity-server.log fluentd.log kubelet.cov startupscript.log' from bootstrap-e2e-master W1026 02:02:58.521] W1026 02:02:58.522] Specify --start=42932 in the next get-serial-port-output invocation to get only the new output starting from here. W1026 02:03:00.921] scp: /var/log/glbc.log*: No such file or directory W1026 02:03:00.922] scp: /var/log/cluster-autoscaler.log*: No such file or directory W1026 02:03:00.924] scp: /var/log/kube-addon-manager.log*: No such file or directory W1026 02:03:00.924] scp: /var/log/konnectivity-server.log*: No such file or directory W1026 02:03:00.924] scp: /var/log/fluentd.log*: No such file or directory W1026 02:03:00.924] scp: /var/log/kubelet.cov*: No such file or directory W1026 02:03:00.925] scp: /var/log/startupscript.log*: No such file or directory W1026 02:03:00.926] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. I1026 02:03:01.136] Dumping logs from nodes locally to '/workspace/_artifacts' I1026 02:03:01.137] Detecting nodes in the cluster I1026 02:03:42.030] Changing logfiles to be world-readable for download I1026 02:03:42.387] Changing logfiles to be world-readable for download I1026 02:03:42.400] Changing logfiles to be world-readable for download I1026 02:03:45.821] Copying 'kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov startupscript.log' from bootstrap-e2e-minion-group-qnng I1026 02:03:46.039] Copying 'kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov startupscript.log' from bootstrap-e2e-minion-group-723b I1026 02:03:46.118] Copying 'kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov startupscript.log' from bootstrap-e2e-minion-group-0b73 W1026 02:03:46.939] W1026 02:03:46.939] Specify --start=44033 in the next get-serial-port-output invocation to get only the new output starting from here. W1026 02:03:47.217] W1026 02:03:47.217] Specify --start=44046 in the next get-serial-port-output invocation to get only the new output starting from here. W1026 02:03:47.302] W1026 02:03:47.302] Specify --start=44008 in the next get-serial-port-output invocation to get only the new output starting from here. W1026 02:03:48.823] scp: /var/log/fluentd.log*: No such file or directory W1026 02:03:48.824] scp: /var/log/node-problem-detector.log*: No such file or directory W1026 02:03:48.824] scp: /var/log/kubelet.cov*: No such file or directory W1026 02:03:48.824] scp: /var/log/startupscript.log*: No such file or directory W1026 02:03:48.827] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W1026 02:03:49.148] scp: /var/log/fluentd.log*: No such file or directory W1026 02:03:49.149] scp: /var/log/node-problem-detector.log*: No such file or directory W1026 02:03:49.149] scp: /var/log/kubelet.cov*: No such file or directory W1026 02:03:49.149] scp: /var/log/startupscript.log*: No such file or directory W1026 02:03:49.153] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W1026 02:03:49.225] scp: /var/log/fluentd.log*: No such file or directory W1026 02:03:49.225] scp: /var/log/node-problem-detector.log*: No such file or directory W1026 02:03:49.225] scp: /var/log/kubelet.cov*: No such file or directory W1026 02:03:49.226] scp: /var/log/startupscript.log*: No such file or directory W1026 02:03:49.230] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W1026 02:03:53.091] INSTANCE_GROUPS=bootstrap-e2e-minion-group W1026 02:03:53.091] NODE_NAMES=bootstrap-e2e-minion-group-0b73 bootstrap-e2e-minion-group-723b bootstrap-e2e-minion-group-qnng I1026 02:03:54.277] Failures for bootstrap-e2e-minion-group (if any): W1026 02:03:55.689] 2020/10/26 02:03:55 process.go:155: Step './cluster/log-dump/log-dump.sh /workspace/_artifacts' finished in 1m37.471817247s W1026 02:03:55.690] 2020/10/26 02:03:55 process.go:153: Running: ./hack/e2e-internal/e2e-down.sh W1026 02:03:55.748] Project: k8s-jkns-e2e-gce-alpha W1026 02:03:55.749] Network Project: k8s-jkns-e2e-gce-alpha W1026 02:03:55.749] Zone: us-west1-b I1026 02:03:55.849] Shutting down test cluster in background. I1026 02:03:57.745] Bringing down cluster using provider: gce W1026 02:03:57.845] ... calling verify-prereqs W1026 02:03:58.385] ... calling verify-kube-binaries W1026 02:03:58.536] ... calling kube-down W1026 02:03:58.537] Project: k8s-jkns-e2e-gce-alpha W1026 02:03:58.537] Network Project: k8s-jkns-e2e-gce-alpha W1026 02:03:58.537] Zone: us-west1-b W1026 02:04:02.192] INSTANCE_GROUPS=bootstrap-e2e-minion-group W1026 02:04:02.193] NODE_NAMES=bootstrap-e2e-minion-group-0b73 bootstrap-e2e-minion-group-723b bootstrap-e2e-minion-group-qnng I1026 02:04:02.293] Bringing down cluster W1026 02:04:44.400] Deleting Managed Instance Group... W1026 02:04:44.400] ..Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/zones/us-west1-b/instanceGroupManagers/bootstrap-e2e-minion-group]. W1026 02:04:44.404] done. W1026 02:04:48.970] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/instanceTemplates/bootstrap-e2e-windows-node-template]. W1026 02:04:49.359] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/instanceTemplates/bootstrap-e2e-minion-template]. W1026 02:05:52.635] Failed to execute 'curl -s --cacert /etc/srv/kubernetes/pki/etcd-apiserver-ca.crt --cert /etc/srv/kubernetes/pki/etcd-apiserver-client.crt --key /etc/srv/kubernetes/pki/etcd-apiserver-client.key https://127.0.0.1:2379/v2/members/$(curl -s --cacert /etc/srv/kubernetes/pki/etcd-apiserver-ca.crt --cert /etc/srv/kubernetes/pki/etcd-apiserver-client.crt --key /etc/srv/kubernetes/pki/etcd-apiserver-client.key https://127.0.0.1:2379/v2/members -XGET | sed 's/{\"id/\n/g' | grep bootstrap-e2e-master\" | cut -f 3 -d \") -XDELETE -L 2>/dev/null' on bootstrap-e2e-master despite 5 attempts W1026 02:05:52.635] Last attempt failed with: I1026 02:05:52.736] Removing etcd replica, name: bootstrap-e2e-master, port: 2379, result: 1 I1026 02:05:54.535] Successfully executed 'curl -s http://127.0.0.1:4002/v2/members/$(curl -s http://127.0.0.1:4002/v2/members -XGET | sed 's/{\"id/\n/g' | grep bootstrap-e2e-master\" | cut -f 3 -d \") -XDELETE -L 2>/dev/null' on bootstrap-e2e-master I1026 02:05:54.535] Removing etcd replica, name: bootstrap-e2e-master, port: 4002, result: 0 W1026 02:05:58.599] Updated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master]. W1026 02:07:46.191] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master]. W1026 02:07:56.588] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/firewalls/bootstrap-e2e-master-https]. W1026 02:07:59.342] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/firewalls/bootstrap-e2e-master-etcd]. W1026 02:07:59.383] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/firewalls/bootstrap-e2e-minion-all]. W1026 02:08:03.337] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/regions/us-west1/addresses/bootstrap-e2e-master-ip]. W1026 02:08:13.947] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/firewalls/bootstrap-e2e-default-internal-master]. W1026 02:08:16.057] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/firewalls/bootstrap-e2e-default-internal-node]. W1026 02:08:16.092] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/firewalls/bootstrap-e2e-default-ssh]. I1026 02:08:17.307] Deleting firewall rules remaining in network bootstrap-e2e: W1026 02:08:59.523] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-alpha/global/networks/bootstrap-e2e]. W1026 02:08:59.850] W1026 02:08:59.849909 8806 loader.go:223] Config not found: /workspace/.kube/config W1026 02:08:59.992] W1026 02:08:59.992074 8857 loader.go:223] Config not found: /workspace/.kube/config W1026 02:08:59.992] W1026 02:08:59.992301 8857 loader.go:223] Config not found: /workspace/.kube/config I1026 02:09:00.093] Property "clusters.k8s-jkns-e2e-gce-alpha_bootstrap-e2e" unset. I1026 02:09:00.133] Property "users.k8s-jkns-e2e-gce-alpha_bootstrap-e2e" unset. W1026 02:09:00.234] W1026 02:09:00.133273 8909 loader.go:223] Config not found: /workspace/.kube/config W1026 02:09:00.234] W1026 02:09:00.133464 8909 loader.go:223] Config not found: /workspace/.kube/config W1026 02:09:00.279] W1026 02:09:00.279117 8961 loader.go:223] Config not found: /workspace/.kube/config W1026 02:09:00.279] W1026 02:09:00.279395 8961 loader.go:223] Config not found: /workspace/.kube/config I1026 02:09:00.380] Property "users.k8s-jkns-e2e-gce-alpha_bootstrap-e2e-basic-auth" unset. I1026 02:09:00.420] Property "contexts.k8s-jkns-e2e-gce-alpha_bootstrap-e2e" unset. I1026 02:09:00.424] Cleared config for k8s-jkns-e2e-gce-alpha_bootstrap-e2e from /workspace/.kube/config I1026 02:09:00.424] Done W1026 02:09:00.445] W1026 02:09:00.419976 9013 loader.go:223] Config not found: /workspace/.kube/config W1026 02:09:00.445] W1026 02:09:00.420194 9013 loader.go:223] Config not found: /workspace/.kube/config W1026 02:09:00.445] 2020/10/26 02:09:00 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 5m4.736646478s W1026 02:09:00.445] 2020/10/26 02:09:00 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W1026 02:09:00.446] 2020/10/26 02:09:00 main.go:316: Something went wrong: starting e2e cluster: error during ./hack/e2e-internal/e2e-up.sh: exit status 2 W1026 02:09:00.446] Traceback (most recent call last): W1026 02:09:00.446] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 720, in W1026 02:09:00.446] main(parse_args()) W1026 02:09:00.446] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 570, in main W1026 02:09:00.446] mode.start(runner_args) W1026 02:09:00.447] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 228, in start W1026 02:09:00.447] check_env(env, self.command, *args) W1026 02:09:00.447] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W1026 02:09:00.447] subprocess.check_call(cmd, env=env) W1026 02:09:00.447] File "/usr/lib/python2.7/subprocess.py", line 190, in check_call W1026 02:09:00.448] raise CalledProcessError(retcode, cmd) W1026 02:09:00.448] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--provider=gce', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--check-leaked-resources', '--check-version-skew=false', '--extract=ci/k8s-stable1', '--extract=ci/k8s-beta', '--gcp-node-image=gci', '--gcp-zone=us-west1-b', '--ginkgo-parallel', '--skew', '--test_args=--ginkgo.skip=\\[Slow\\]|\\[Serial\\]|\\[Disruptive\\]|\\[Flaky\\]|\\[Feature:.+\\] --kubectl-path=../../../../kubernetes_skew/cluster/kubectl.sh --minStartupPods=8', '--timeout=120m', '--upgrade_args=--ginkgo.focus=\\[Feature:ClusterDowngrade\\] --upgrade-target=ci/k8s-stable1 --upgrade-image=gci')' returned non-zero exit status 1 E1026 02:09:00.449] Command failed I1026 02:09:00.449] process 267 exited with code 1 after 15.3m E1026 02:09:00.449] FAIL: ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel I1026 02:09:00.449] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1026 02:09:01.060] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I1026 02:09:01.160] process 9024 exited with code 0 after 0.0m I1026 02:09:01.161] Call: gcloud config get-value account I1026 02:09:01.744] process 9037 exited with code 0 after 0.0m I1026 02:09:01.745] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I1026 02:09:01.745] Upload result and artifacts... I1026 02:09:01.745] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320544015057162240 I1026 02:09:01.745] Call: gsutil ls gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320544015057162240/artifacts W1026 02:09:02.689] CommandException: One or more URLs matched no objects. E1026 02:09:02.851] Command failed I1026 02:09:02.851] process 9050 exited with code 1 after 0.0m W1026 02:09:02.851] Remote dir gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320544015057162240/artifacts not exist yet I1026 02:09:02.851] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320544015057162240/artifacts I1026 02:09:04.879] process 9193 exited with code 0 after 0.0m I1026 02:09:04.880] Call: git rev-parse HEAD W1026 02:09:04.884] fatal: not a git repository (or any of the parent directories): .git E1026 02:09:04.884] Command failed I1026 02:09:04.884] process 9838 exited with code 128 after 0.0m I1026 02:09:04.884] Call: git rev-parse HEAD I1026 02:09:04.888] process 9839 exited with code 0 after 0.0m I1026 02:09:04.888] Call: gsutil stat gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/jobResultsCache.json I1026 02:09:05.894] process 9840 exited with code 0 after 0.0m I1026 02:09:05.895] Call: gsutil -q cat 'gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/jobResultsCache.json#1603670911198689' I1026 02:09:07.020] process 9983 exited with code 0 after 0.0m I1026 02:09:07.025] Call: gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1603670911198689 cp /tmp/gsutil_jq9fJL gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/jobResultsCache.json I1026 02:09:08.406] process 10128 exited with code 0 after 0.0m I1026 02:09:08.407] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_72e9sr gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/1320544015057162240/finished.json I1026 02:09:09.768] process 10307 exited with code 0 after 0.0m I1026 02:09:09.768] Call: gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_AvDlkR gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-beta-stable1-downgrade-cluster-parallel/latest-build.txt I1026 02:09:11.084] process 10486 exited with code 0 after 0.0m