W1010 23:42:59.716] ************************************************************************** bootstrap.py is deprecated! test-infra oncall does not support any job still using bootstrap.py. Please migrate your job to podutils! https://github.com/kubernetes/test-infra/blob/master/prow/pod-utilities.md ************************************************************************** I1010 23:42:59.716] Args: --job=pull-azurefile-csi-driver-e2e --service-account=/etc/service-account/service-account.json --upload=gs://kubernetes-jenkins/logs --job=pull-azurefile-csi-driver-e2e --root=/go/src --service-account=/etc/service-account/service-account.json --repo=k8s.io/kubernetes --repo=sigs.k8s.io/azurefile-csi-driver=master:bd996ff37f2d725eac026d19a820ba7afeb19293,120:c075484419b673a81ba808302593ef28209eacbf --upload=gs://kubernetes-upstream/pr-logs --scenario=kubernetes_e2e --timeout=450 -- --gce-ssh= --test=true --up=true --down=true --deployment=acsengine --build=bazel --provider=skeleton --ginkgo-parallel=1 --acsengine-agentpoolcount=2 --acsengine-admin-username=azureuser '--acsengine-creds=$AZURE_CREDENTIALS' --acsengine-orchestratorRelease=1.16 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_D4s_v3 --acsengine-location=eastus2 '--acsengine-public-key=$AZURE_SSH_PUBLIC_KEY_FILE' --acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json --acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz --test-azure-file-csi-driver=True --timeout=420m --use-logexporter I1010 23:42:59.716] Bootstrap pull-azurefile-csi-driver-e2e... I1010 23:42:59.720] Builder: 9b098599-ebb7-11e9-b3d3-b20db476995a I1010 23:42:59.720] Image: chewong/kubekins-e2e:v20191010-test I1010 23:42:59.720] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/1182441356274962432 I1010 23:42:59.721] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1010 23:43:00.228] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I1010 23:43:00.259] process 218 exited with code 0 after 0.0m I1010 23:43:00.259] Call: gcloud config get-value account I1010 23:43:00.500] process 230 exited with code 0 after 0.0m I1010 23:43:00.500] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I1010 23:43:00.501] Root: /go/src I1010 23:43:00.501] cd to /go/src I1010 23:43:00.501] Checkout: /go/src/k8s.io/kubernetes master to /go/src/k8s.io/kubernetes I1010 23:43:00.501] Call: git init k8s.io/kubernetes I1010 23:43:00.505] Initialized empty Git repository in /go/src/k8s.io/kubernetes/.git/ I1010 23:43:00.505] process 242 exited with code 0 after 0.0m I1010 23:43:00.505] Call: git config --local user.name 'K8S Bootstrap' I1010 23:43:00.508] process 243 exited with code 0 after 0.0m I1010 23:43:00.508] Call: git config --local user.email k8s_bootstrap@localhost I1010 23:43:00.510] process 244 exited with code 0 after 0.0m I1010 23:43:00.511] Call: git fetch --quiet --tags https://github.com/kubernetes/kubernetes master I1010 23:43:53.052] process 245 exited with code 0 after 0.9m I1010 23:43:53.052] Call: git checkout -B test FETCH_HEAD W1010 23:43:55.159] Switched to a new branch 'test' I1010 23:43:55.170] process 257 exited with code 0 after 0.0m I1010 23:43:55.171] Call: git show -s --format=format:%ct HEAD I1010 23:43:55.178] process 258 exited with code 0 after 0.0m I1010 23:43:55.178] Checkout: /go/src/sigs.k8s.io/azurefile-csi-driver master:bd996ff37f2d725eac026d19a820ba7afeb19293,120:c075484419b673a81ba808302593ef28209eacbf to /go/src/sigs.k8s.io/azurefile-csi-driver I1010 23:43:55.179] Call: git init sigs.k8s.io/azurefile-csi-driver I1010 23:43:55.182] Initialized empty Git repository in /go/src/sigs.k8s.io/azurefile-csi-driver/.git/ I1010 23:43:55.182] process 259 exited with code 0 after 0.0m I1010 23:43:55.183] Call: git config --local user.name 'K8S Bootstrap' I1010 23:43:55.185] process 260 exited with code 0 after 0.0m I1010 23:43:55.185] Call: git config --local user.email k8s_bootstrap@localhost I1010 23:43:55.188] process 261 exited with code 0 after 0.0m I1010 23:43:55.188] Call: git fetch --quiet --tags https://github.com/kubernetes-sigs/azurefile-csi-driver master +refs/pull/120/head:refs/pr/120 I1010 23:43:59.766] process 262 exited with code 0 after 0.1m I1010 23:43:59.766] Call: git checkout -B test bd996ff37f2d725eac026d19a820ba7afeb19293 W1010 23:44:00.174] Switched to a new branch 'test' I1010 23:44:00.177] process 274 exited with code 0 after 0.0m I1010 23:44:00.177] Call: git show -s --format=format:%ct HEAD I1010 23:44:00.180] process 275 exited with code 0 after 0.0m I1010 23:44:00.181] Call: git merge --no-ff -m 'Merge +refs/pull/120/head:refs/pr/120' c075484419b673a81ba808302593ef28209eacbf I1010 23:44:00.404] Auto-merging test/utils/credentials/credentials_test.go I1010 23:44:00.405] Auto-merging test/utils/credentials/credentials.go I1010 23:44:00.405] Removing test/e2e/run-test.sh I1010 23:44:00.405] Removing hack/template/azure.json I1010 23:44:00.405] Merge made by the 'recursive' strategy. I1010 23:44:00.408] .travis.yml | 9 --- I1010 23:44:00.408] Makefile | 63 +++++++++++------ I1010 23:44:00.409] hack/template/azure.json | 9 --- I1010 23:44:00.409] test/e2e/README.md | 24 +++++-- I1010 23:44:00.409] test/e2e/dynamic_provisioning.go | 17 ----- I1010 23:44:00.409] test/e2e/pre_provisioning.go | 23 +------ I1010 23:44:00.409] test/e2e/run-test.sh | 31 --------- I1010 23:44:00.409] test/e2e/suite_test.go | 87 ++++++++++++++++++++++++ I1010 23:44:00.409] test/integration/integration_test.go | 20 +++++- I1010 23:44:00.410] test/integration/run-test.sh | 4 +- I1010 23:44:00.410] test/integration/run-tests-all-clouds.sh | 11 ++- I1010 23:44:00.410] test/sanity/run-test.sh | 9 ++- I1010 23:44:00.410] test/sanity/run-tests-all-clouds.sh | 9 ++- I1010 23:44:00.410] test/sanity/sanity_test.go | 17 ++--- I1010 23:44:00.410] test/{ => utils}/azure/azure_helpers.go | 0 I1010 23:44:00.411] test/{ => utils}/credentials/credentials.go | 83 ++++++++++++++-------- I1010 23:44:00.411] test/{ => utils}/credentials/credentials_test.go | 54 +++++++-------- I1010 23:44:00.411] test/utils/testutil/testutil.go | 8 +++ I1010 23:44:00.411] 18 files changed, 290 insertions(+), 188 deletions(-) I1010 23:44:00.411] delete mode 100644 hack/template/azure.json I1010 23:44:00.412] delete mode 100755 test/e2e/run-test.sh I1010 23:44:00.412] rename test/{ => utils}/azure/azure_helpers.go (100%) I1010 23:44:00.412] rename test/{ => utils}/credentials/credentials.go (59%) I1010 23:44:00.412] rename test/{ => utils}/credentials/credentials_test.go (77%) I1010 23:44:00.412] create mode 100644 test/utils/testutil/testutil.go I1010 23:44:00.412] process 276 exited with code 0 after 0.0m I1010 23:44:00.413] Configure environment... I1010 23:44:00.413] Call: git show -s --format=format:%ct HEAD I1010 23:44:00.421] process 278 exited with code 0 after 0.0m I1010 23:44:00.421] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1010 23:44:01.011] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I1010 23:44:01.128] process 279 exited with code 0 after 0.0m I1010 23:44:01.128] Call: gcloud config get-value account I1010 23:44:01.361] process 291 exited with code 0 after 0.0m I1010 23:44:01.361] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I1010 23:44:01.362] Call: bash -c ' set -o errexit set -o nounset export KUBE_ROOT=. source hack/lib/version.sh kube::version::get_version_vars echo $KUBE_GIT_VERSION ' I1010 23:44:01.687] process 303 exited with code 0 after 0.0m I1010 23:44:01.688] Start 1182441356274962432 at v1.17.0-alpha.1.307+77f86630d4530e... I1010 23:44:01.690] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_g33DPh gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/1182441356274962432/started.json I1010 23:44:03.143] process 336 exited with code 0 after 0.0m I1010 23:44:03.144] Call: gsutil -q -h Content-Type:text/plain -h 'x-goog-meta-link: gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/1182441356274962432' cp /tmp/gsutil_Id4T6m gs://kubernetes-upstream/pr-logs/directory/pull-azurefile-csi-driver-e2e/1182441356274962432.txt I1010 23:44:04.408] process 514 exited with code 0 after 0.0m I1010 23:44:04.409] Call: /workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py --gce-ssh= --test=true --up=true --down=true --deployment=acsengine --build=bazel --provider=skeleton --ginkgo-parallel=1 --acsengine-agentpoolcount=2 --acsengine-admin-username=azureuser --acsengine-creds=/etc/azure-cred/credentials --acsengine-orchestratorRelease=1.16 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_D4s_v3 --acsengine-location=eastus2 --acsengine-public-key=/etc/azure-ssh/azure-ssh-pub --acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json --acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz --test-azure-file-csi-driver=True --timeout=420m --use-logexporter W1010 23:44:04.448] starts with local mode W1010 23:44:04.448] Environment: W1010 23:44:04.449] ARTIFACTS=/workspace/_artifacts W1010 23:44:04.449] AWS_SSH_PRIVATE_KEY_FILE=/root/.ssh/kube_aws_rsa W1010 23:44:04.449] AWS_SSH_PUBLIC_KEY_FILE=/root/.ssh/kube_aws_rsa.pub W1010 23:44:04.449] AZURE_CREDENTIALS=/etc/azure-cred/credentials W1010 23:44:04.449] AZURE_SSH_PUBLIC_KEY_FILE=/etc/azure-ssh/azure-ssh-pub W1010 23:44:04.449] AZ_STORAGE_CONTAINER_NAME=mystoragecontainer W1010 23:44:04.449] BAZEL_REMOTE_CACHE_ENABLED=false W1010 23:44:04.449] BAZEL_VERSION=0.23.2 W1010 23:44:04.450] BOOTSTRAP_MIGRATION=yes W1010 23:44:04.450] BUILD_ID=1182441356274962432 W1010 23:44:04.450] BUILD_NUMBER=1182441356274962432 W1010 23:44:04.450] CLOUDSDK_COMPONENT_MANAGER_DISABLE_UPDATE_CHECK=true W1010 23:44:04.450] CLOUDSDK_CONFIG=/go/src/k8s.io/kubernetes/.config/gcloud W1010 23:44:04.450] CLOUDSDK_CORE_DISABLE_PROMPTS=1 W1010 23:44:04.450] CLOUDSDK_EXPERIMENTAL_FAST_COMPONENT_UPDATE=false W1010 23:44:04.450] CLOUD_CONFIG=random W1010 23:44:04.451] DECK_PORT=tcp://10.0.160.83:80 W1010 23:44:04.451] DECK_PORT_80_TCP=tcp://10.0.160.83:80 W1010 23:44:04.451] DECK_PORT_80_TCP_ADDR=10.0.160.83 W1010 23:44:04.451] DECK_PORT_80_TCP_PORT=80 W1010 23:44:04.451] DECK_PORT_80_TCP_PROTO=tcp W1010 23:44:04.451] DECK_SERVICE_HOST=10.0.160.83 W1010 23:44:04.451] DECK_SERVICE_PORT=80 W1010 23:44:04.451] DOCKER_IN_DOCKER_ENABLED=true W1010 23:44:04.452] DOCKER_IN_DOCKER_IPV6_ENABLED=false W1010 23:44:04.452] GCS_ARTIFACTS_DIR=gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/1182441356274962432/artifacts W1010 23:44:04.452] GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json W1010 23:44:04.452] GOPATH=/go W1010 23:44:04.452] GO_TARBALL=go1.12.1.linux-amd64.tar.gz W1010 23:44:04.452] HOME=/workspace W1010 23:44:04.452] HOOK_PORT=tcp://10.0.144.133:8888 W1010 23:44:04.453] HOOK_PORT_8888_TCP=tcp://10.0.144.133:8888 W1010 23:44:04.453] HOOK_PORT_8888_TCP_ADDR=10.0.144.133 W1010 23:44:04.453] HOOK_PORT_8888_TCP_PORT=8888 W1010 23:44:04.453] HOOK_PORT_8888_TCP_PROTO=tcp W1010 23:44:04.453] HOOK_SERVICE_HOST=10.0.144.133 W1010 23:44:04.453] HOOK_SERVICE_PORT=8888 W1010 23:44:04.453] HOSTNAME=9b098599-ebb7-11e9-b3d3-b20db476995a W1010 23:44:04.453] IMAGE=chewong/kubekins-e2e:v20191010-test W1010 23:44:04.454] INSTANCE_PREFIX=bootstrap-e2e W1010 23:44:04.454] JENKINS_GCE_SSH_PRIVATE_KEY_FILE=/root/.ssh/google_compute_engine W1010 23:44:04.454] JENKINS_GCE_SSH_PUBLIC_KEY_FILE=/root/.ssh/google_compute_engine.pub W1010 23:44:04.454] JOB_NAME=pull-azurefile-csi-driver-e2e W1010 23:44:04.455] JOB_SPEC={"type":"presubmit","job":"pull-azurefile-csi-driver-e2e","buildid":"1182441356274962432","prowjobid":"9b098599-ebb7-11e9-b3d3-b20db476995a","refs":{"org":"Azure","repo":"kubernetes","repo_link":"https://github.com/Azure/kubernetes","base_ref":"master","base_sha":"4d6deea24179a72f36f252664937d2585598ee30","base_link":"https://github.com/Azure/kubernetes/commit/4d6deea24179a72f36f252664937d2585598ee30","pulls":[{"number":113,"author":"chewong","sha":"879465972041635fd7bc8269da49153b67e63822","link":"https://github.com/Azure/kubernetes/pull/113","commit_link":"https://github.com/Azure/kubernetes/pull/113/commits/879465972041635fd7bc8269da49153b67e63822","author_link":"https://github.com/chewong"}]}} W1010 23:44:04.455] JOB_TYPE=presubmit W1010 23:44:04.455] KUBERNETES_PORT=tcp://10.0.0.1:443 W1010 23:44:04.455] KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443 W1010 23:44:04.455] KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1 W1010 23:44:04.455] KUBERNETES_PORT_443_TCP_PORT=443 W1010 23:44:04.455] KUBERNETES_PORT_443_TCP_PROTO=tcp W1010 23:44:04.456] KUBERNETES_SERVICE_HOST=10.0.0.1 W1010 23:44:04.456] KUBERNETES_SERVICE_PORT=443 W1010 23:44:04.456] KUBERNETES_SERVICE_PORT_HTTPS=443 W1010 23:44:04.456] KUBETEST_IN_DOCKER=true W1010 23:44:04.456] KUBETEST_MANUAL_DUMP=y W1010 23:44:04.456] KUBE_AWS_INSTANCE_PREFIX=bootstrap-e2e W1010 23:44:04.456] KUBE_GCE_INSTANCE_PREFIX=bootstrap-e2e W1010 23:44:04.457] KUBE_VERBOSE=0 W1010 23:44:04.457] NODE_NAME=9b098599-ebb7-11e9-b3d3-b20db476995a W1010 23:44:04.457] PATH=/go/bin:/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/workspace:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin W1010 23:44:04.457] PROW_JOB_ID=9b098599-ebb7-11e9-b3d3-b20db476995a W1010 23:44:04.457] PULL_BASE_REF=master W1010 23:44:04.457] PULL_BASE_SHA=4d6deea24179a72f36f252664937d2585598ee30 W1010 23:44:04.457] PULL_NUMBER=113 W1010 23:44:04.458] PULL_PULL_SHA=879465972041635fd7bc8269da49153b67e63822 W1010 23:44:04.458] PULL_REFS=master:4d6deea24179a72f36f252664937d2585598ee30,113:879465972041635fd7bc8269da49153b67e63822 W1010 23:44:04.458] PWD=/workspace W1010 23:44:04.458] REGISTRY=k8sprowinternal.azurecr.io W1010 23:44:04.458] REPO_NAME=kubernetes W1010 23:44:04.458] REPO_OWNER=Azure W1010 23:44:04.459] SHLVL=2 W1010 23:44:04.459] SOURCE_DATE_EPOCH=1570750040 W1010 23:44:04.459] TERM=xterm W1010 23:44:04.459] TIDE_PORT=tcp://10.0.180.53:80 W1010 23:44:04.459] TIDE_PORT_80_TCP=tcp://10.0.180.53:80 W1010 23:44:04.459] TIDE_PORT_80_TCP_ADDR=10.0.180.53 W1010 23:44:04.459] TIDE_PORT_80_TCP_PORT=80 W1010 23:44:04.460] TIDE_PORT_80_TCP_PROTO=tcp W1010 23:44:04.460] TIDE_SERVICE_HOST=10.0.180.53 W1010 23:44:04.460] TIDE_SERVICE_PORT=80 W1010 23:44:04.460] WORKSPACE=/workspace W1010 23:44:04.460] _=./test-infra/jenkins/bootstrap.py W1010 23:44:04.461] Run: ('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=1', '--acsengine-agentpoolcount=2', '--acsengine-admin-username=azureuser', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.16', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_D4s_v3', '--acsengine-location=eastus2', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json', '--acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz', '--test-azure-file-csi-driver=True', '--timeout=420m', '--logexporter-gcs-path=gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/1182441356274962432/artifacts') W1010 23:44:04.464] 2019/10/10 23:44:04 main.go:332: Limiting testing to 7h0m0s W1010 23:44:04.464] 2019/10/10 23:44:04 azure.go:232: Reading credentials file /etc/azure-cred/credentials W1010 23:44:04.464] 2019/10/10 23:44:04 process.go:153: Running: make -C /go/src/k8s.io/kubernetes bazel-release W1010 23:44:04.518] Extracting Bazel installation... I1010 23:44:04.619] make: Entering directory '/go/src/k8s.io/kubernetes' W1010 23:44:13.728] Starting local Bazel server and connecting to it... W1010 23:44:15.441] Loading: W1010 23:44:15.444] Loading: 0 packages loaded W1010 23:44:16.447] Loading: 0 packages loaded W1010 23:44:18.212] Loading: 0 packages loaded W1010 23:44:19.448] Loading: 0 packages loaded W1010 23:44:21.666] Loading: 0 packages loaded W1010 23:44:23.448] Loading: 0 packages loaded W1010 23:44:23.449] currently loading: build/release-tars W1010 23:44:24.924] Loading: 0 packages loaded W1010 23:44:24.924] currently loading: build/release-tars W1010 23:44:25.297] Analyzing: target //build/release-tars:release-tars (1 packages loaded, 0 targets configured) W1010 23:44:26.796] Analyzing: target //build/release-tars:release-tars (188 packages loaded, 1094 targets configured) W1010 23:44:28.545] Analyzing: target //build/release-tars:release-tars (918 packages loaded, 4140 targets configured) W1010 23:44:30.533] Analyzing: target //build/release-tars:release-tars (1871 packages loaded, 11398 targets configured) W1010 23:44:32.822] Analyzing: target //build/release-tars:release-tars (2679 packages loaded, 19722 targets configured) W1010 23:44:35.870] Analyzing: target //build/release-tars:release-tars (3035 packages loaded, 27187 targets configured) W1010 23:44:39.098] Analyzing: target //build/release-tars:release-tars (3073 packages loaded, 29653 targets configured) W1010 23:44:46.236] Analyzing: target //build/release-tars:release-tars (3080 packages loaded, 35319 targets configured) W1010 23:45:02.736] INFO: Analysed target //build/release-tars:release-tars (3080 packages loaded, 42326 targets configured). W1010 23:45:02.738] Building: checking cached actions W1010 23:45:02.739] INFO: Found 1 target... W1010 23:45:02.937] [0 / 14] [-----] BazelWorkspaceStatusAction stable-status.txt ... (2 actions, 0 running) W1010 23:45:10.086] [127 / 5,306] GoCompile vendor/github.com/pelletier/go-toml/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/pelletier/go-toml.a; 0s linux-sandbox ... (7 actions running) W1010 23:45:18.309] [384 / 5,306] CGoCodeGen //vendor/github.com/coreos/pkg/dlopen:go_default_library%linux_amd64%cgo_codegen; 0s linux-sandbox ... (8 actions, 7 running) W1010 23:45:29.452] [495 / 5,306] GoCompile vendor/gopkg.in/square/go-jose.v2/json/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/gopkg.in/square/go-jose.v2/json.a; 2s linux-sandbox ... (7 actions, 6 running) W1010 23:45:40.733] [667 / 5,306] GoCompile vendor/gonum.org/v1/gonum/blas/gonum/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/gonum.org/v1/gonum/blas/gonum.a; 0s linux-sandbox ... (8 actions running) W1010 23:45:53.844] [896 / 5,306] GoCompile vendor/gopkg.in/yaml.v2/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/gopkg.in/yaml.v2.a; 0s linux-sandbox ... (8 actions, 7 running) W1010 23:46:09.161] [1,076 / 5,306] GoCompile vendor/github.com/gogo/protobuf/proto/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/gogo/protobuf/proto.a; 2s linux-sandbox ... (7 actions, 6 running) W1010 23:46:26.313] [1,217 / 5,306] GoCompile vendor/gopkg.in/gcfg.v1/scanner/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/gopkg.in/gcfg.v1/scanner.a; 1s linux-sandbox ... (8 actions, 7 running) W1010 23:46:46.829] [1,371 / 5,306] GoCompile vendor/github.com/vmware/govmomi/pbm/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/vmware/govmomi/pbm.a; 1s linux-sandbox ... (8 actions running) W1010 23:47:10.593] [1,692 / 5,306] GoStdlib external/io_bazel_rules_go/linux_amd64_pure_stripped/stdlib%/pkg; 4s linux-sandbox ... (8 actions, 7 running) W1010 23:47:37.013] [1,835 / 5,306] GoStdlib external/io_bazel_rules_go/linux_amd64_pure_stripped/stdlib%/pkg; 30s linux-sandbox ... (7 actions, 6 running) W1010 23:48:08.810] [1,998 / 5,306] GoCompile vendor/github.com/GoogleCloudPlatform/k8s-cloud-provider/pkg/cloud/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/GoogleCloudPlatform/k8s-cloud-provider/pkg/cloud.a; 5s linux-sandbox ... (8 actions, 7 running) W1010 23:48:47.179] [2,138 / 5,306] GoCompile pkg/apis/rbac/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/pkg/apis/rbac.a; 4s linux-sandbox ... (7 actions, 6 running) W1010 23:49:30.449] [2,303 / 5,306] GoCompile staging/src/k8s.io/apiserver/pkg/storage/etcd3/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/storage/etcd3.a; 6s linux-sandbox ... (8 actions, 7 running) W1010 23:50:19.213] [2,639 / 5,306] GoCompile pkg/registry/core/namespace/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/pkg/registry/core/namespace.a; 1s linux-sandbox ... (8 actions, 7 running) W1010 23:51:14.669] [3,009 / 5,306] GoCompile staging/src/k8s.io/kubectl/pkg/cmd/rollingupdate/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/rollingupdate.a; 4s linux-sandbox ... (8 actions, 7 running) W1010 23:52:18.459] [3,386 / 5,306] GoCompile vendor/github.com/aws/aws-sdk-go/service/autoscaling/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/aws/aws-sdk-go/service/autoscaling.a; 3s linux-sandbox ... (8 actions, 7 running) W1010 23:53:33.300] [3,928 / 5,306] GoCompile staging/src/k8s.io/apimachinery/pkg/apis/meta/v1/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/apis/meta/v1.a; 5s linux-sandbox ... (8 actions, 7 running) W1010 23:54:57.021] [4,509 / 5,306] GoCompile vendor/google.golang.org/api/compute/v0.alpha/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/google.golang.org/api/compute/v0.alpha.a; 11s linux-sandbox ... (8 actions, 7 running) W1010 23:56:33.570] [4,971 / 5,306] ; 15s linux-sandbox ... (8 actions, 7 running) W1010 23:58:25.749] [5,222 / 5,306] GoLink cmd/genman/genman; 18s linux-sandbox ... (8 actions, 7 running) W1011 00:00:36.719] [5,264 / 5,306] GoLink cmd/genman/genman; 149s linux-sandbox ... (8 actions, 7 running) W1011 00:03:02.168] Target //build/release-tars:release-tars up-to-date: W1011 00:03:02.170] bazel-bin/build/release-tars/kubernetes-client-linux-amd64.tar.gz W1011 00:03:02.171] bazel-bin/build/release-tars/kubernetes-node-linux-amd64.tar.gz W1011 00:03:02.171] bazel-bin/build/release-tars/kubernetes-server-linux-amd64.tar.gz W1011 00:03:02.171] bazel-bin/build/release-tars/kubernetes-manifests.tar.gz W1011 00:03:02.171] bazel-bin/build/release-tars/kubernetes-test-portable.tar.gz W1011 00:03:02.172] bazel-bin/build/release-tars/kubernetes-test-linux-amd64.tar.gz W1011 00:03:02.172] bazel-bin/build/release-tars/kubernetes.tar.gz W1011 00:03:02.172] bazel-bin/build/release-tars/kubernetes-src.tar.gz W1011 00:03:02.204] INFO: Elapsed time: 1137.656s, Critical Path: 399.29s W1011 00:03:02.205] INFO: 5215 processes: 5215 linux-sandbox. W1011 00:03:02.209] INFO: Build completed successfully, 5306 total actions W1011 00:03:02.211] INFO: Build completed successfully, 5306 total actions W1011 00:03:02.218] 2019/10/11 00:03:02 process.go:155: Step 'make -C /go/src/k8s.io/kubernetes bazel-release' finished in 18m57.753827626s W1011 00:03:02.218] 2019/10/11 00:03:02 util.go:277: Flushing memory. I1011 00:03:02.319] make: Leaving directory '/go/src/k8s.io/kubernetes' W1011 00:03:31.773] 2019/10/11 00:03:31 azure.go:906: Deleting resource group: kubetest-d7dd0b32-ebb7-11e9-9ac4-0242819417cc. W1011 00:03:32.179] 2019/10/11 00:03:32 azure.go:787: downloading /workspace/aks180177033/kubernetes.json from https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json. W1011 00:03:32.179] 2019/10/11 00:03:32 util.go:42: curl https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json W1011 00:03:32.351] 2019/10/11 00:03:32 azure.go:529: downloading /workspace/aks-engine.tar.gz from https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz. W1011 00:03:32.351] 2019/10/11 00:03:32 util.go:42: curl https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz W1011 00:03:33.725] 2019/10/11 00:03:33 azure.go:556: Extracting tar file /workspace/aks-engine.tar.gz into directory /go/src/k8s.io/kubernetes . W1011 00:03:33.726] 2019/10/11 00:03:33 process.go:153: Running: tar -xzf /workspace/aks-engine.tar.gz --strip 1 W1011 00:03:33.888] 2019/10/11 00:03:33 process.go:155: Step 'tar -xzf /workspace/aks-engine.tar.gz --strip 1' finished in 162.205202ms W1011 00:03:33.888] 2019/10/11 00:03:33 process.go:153: Running: /go/src/k8s.io/kubernetes/aks-engine generate /workspace/aks180177033/kubernetes.json --output-directory /workspace/aks180177033 I1011 00:03:34.089] INFO[0000] Generating assets into /workspace/aks180177033... W1011 00:03:57.724] 2019/10/11 00:03:57 process.go:155: Step '/go/src/k8s.io/kubernetes/aks-engine generate /workspace/aks180177033/kubernetes.json --output-directory /workspace/aks180177033' finished in 23.83630117s W1011 00:03:57.727] 2019/10/11 00:03:57 azure.go:627: Setting kubeconfig env variable: kubeconfig path: /workspace/aks180177033/kubeconfig/kubeconfig.eastus2.json. W1011 00:03:57.727] 2019/10/11 00:03:57 azure.go:629: Creating resource group: kubetest-d7dd0b32-ebb7-11e9-9ac4-0242819417cc. W1011 00:03:57.728] 2019/10/11 00:03:57 azure.go:631: Creating Azure resource group: kubetest-d7dd0b32-ebb7-11e9-9ac4-0242819417cc for cluster deployment. W1011 00:03:59.744] 2019/10/11 00:03:59 azure.go:636: Validating deployment ARM templates. W1011 00:04:02.166] 2019/10/11 00:04:02 azure.go:642: Deploying cluster kubetest-d7dd0b32-ebb7-11e9-9ac4-0242819417cc in resource group kubetest-d7dd0b32-ebb7-11e9-9ac4-0242819417cc. W1011 00:10:08.070] 2019/10/11 00:10:08 e2e.go:519: Dumping logs from nodes to GCS directly at path: gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/1182441356274962432/artifacts W1011 00:10:08.071] 2019/10/11 00:10:08 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/1182441356274962432/artifacts W1011 00:10:08.087] KUBE_MASTER_IP: W1011 00:10:08.088] KUBE_MASTER: W1011 00:10:08.088] ./cluster/log-dump/log-dump.sh: line 285: MASTER_NAME: unbound variable W1011 00:10:08.088] 2019/10/11 00:10:08 process.go:155: Step './cluster/log-dump/log-dump.sh /workspace/_artifacts gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/1182441356274962432/artifacts' finished in 17.929741ms W1011 00:10:08.088] 2019/10/11 00:10:08 azure.go:906: Deleting resource group: kubetest-d7dd0b32-ebb7-11e9-9ac4-0242819417cc. I1011 00:10:08.189] Checking for custom logdump instances, if any I1011 00:10:08.189] Sourcing kube-util.sh I1011 00:10:08.189] Detecting project I1011 00:10:08.189] Skeleton Provider: detect-project not implemented I1011 00:10:08.190] Dumping logs from master locally to '/workspace/_artifacts' W1011 00:20:01.805] 2019/10/11 00:20:01 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W1011 00:20:01.805] 2019/10/11 00:20:01 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}" W1011 00:20:02.499] 2019/10/11 00:20:02 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 694.253803ms W1011 00:20:02.501] 2019/10/11 00:20:02 main.go:319: Something went wrong: starting e2e cluster: error creating cluster: cannot deploy: cannot get the create deployment future response: Code="DeploymentFailed" Message="At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-debug for usage details." Details=[{"code":"Conflict","message":"{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource operation completed with terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"VMExtensionProvisioningError\",\r\n \"message\": \"VM has reported a failure when processing extension 'cse-agent-0'. Error message: \\\"Enable failed: failed to execute command: command terminated with exit status=99\\n[stdout]\\n\\n[stderr]\\nConnection to k8s.gcr.io 443 port [tcp/https] succeeded!\\nConnection to gcr.io 443 port [tcp/https] succeeded!\\nConnection to docker.io 443 port [tcp/https] succeeded!\\n\\\".\"\r\n }\r\n ]\r\n }\r\n}"},{"code":"Conflict","message":"{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource operation completed with terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"VMExtensionProvisioningError\",\r\n \"message\": \"VM has reported a failure when processing extension 'cse-master-0'. Error message: \\\"Enable failed: failed to execute command: command terminated with exit status=99\\n[stdout]\\n\\n[stderr]\\nConnection to k8s.gcr.io 443 port [tcp/https] succeeded!\\nConnection to gcr.io 443 port [tcp/https] succeeded!\\nConnection to docker.io 443 port [tcp/https] succeeded!\\n\\\".\"\r\n }\r\n ]\r\n }\r\n}"},{"code":"Conflict","message":"{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource operation completed with terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"VMExtensionProvisioningError\",\r\n \"message\": \"VM has reported a failure when processing extension 'cse-agent-1'. Error message: \\\"Enable failed: failed to execute command: command terminated with exit status=99\\n[stdout]\\n\\n[stderr]\\nConnection to k8s.gcr.io 443 port [tcp/https] succeeded!\\nConnection to gcr.io 443 port [tcp/https] succeeded!\\nConnection to docker.io 443 port [tcp/https] succeeded!\\n\\\".\"\r\n }\r\n ]\r\n }\r\n}"}] W1011 00:20:02.504] Traceback (most recent call last): W1011 00:20:02.504] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in W1011 00:20:02.504] main(parse_args()) W1011 00:20:02.504] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main W1011 00:20:02.504] mode.start(runner_args) W1011 00:20:02.505] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start W1011 00:20:02.505] check_env(env, self.command, *args) W1011 00:20:02.505] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W1011 00:20:02.505] subprocess.check_call(cmd, env=env) W1011 00:20:02.505] File "/usr/lib/python2.7/subprocess.py", line 186, in check_call W1011 00:20:02.505] raise CalledProcessError(retcode, cmd) W1011 00:20:02.507] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=1', '--acsengine-agentpoolcount=2', '--acsengine-admin-username=azureuser', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.16', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_D4s_v3', '--acsengine-location=eastus2', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json', '--acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz', '--test-azure-file-csi-driver=True', '--timeout=420m', '--logexporter-gcs-path=gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/1182441356274962432/artifacts')' returned non-zero exit status 1 E1011 00:20:02.515] Command failed I1011 00:20:02.515] process 692 exited with code 1 after 36.0m E1011 00:20:02.515] FAIL: pull-azurefile-csi-driver-e2e I1011 00:20:02.515] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1011 00:20:03.289] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I1011 00:20:03.320] process 7457 exited with code 0 after 0.0m I1011 00:20:03.321] Call: gcloud config get-value account I1011 00:20:03.561] process 7469 exited with code 0 after 0.0m I1011 00:20:03.561] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I1011 00:20:03.561] Upload result and artifacts... I1011 00:20:03.561] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/1182441356274962432 I1011 00:20:03.562] Call: gsutil ls gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/1182441356274962432/artifacts W1011 00:20:04.727] CommandException: One or more URLs matched no objects. E1011 00:20:04.810] Command failed I1011 00:20:04.811] process 7481 exited with code 1 after 0.0m W1011 00:20:04.811] Remote dir gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/1182441356274962432/artifacts not exist yet I1011 00:20:04.811] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/1182441356274962432/artifacts I1011 00:20:06.327] process 7623 exited with code 0 after 0.0m I1011 00:20:06.327] Call: git rev-parse HEAD I1011 00:20:06.331] process 8147 exited with code 0 after 0.0m I1011 00:20:06.331] Call: git rev-parse HEAD I1011 00:20:06.334] process 8148 exited with code 0 after 0.0m I1011 00:20:06.335] Call: gsutil stat gs://kubernetes-upstream/pr-logs/directory/pull-azurefile-csi-driver-e2e/jobResultsCache.json I1011 00:20:07.260] process 8149 exited with code 0 after 0.0m I1011 00:20:07.261] Call: gsutil -q cat 'gs://kubernetes-upstream/pr-logs/directory/pull-azurefile-csi-driver-e2e/jobResultsCache.json#1570644287694162' I1011 00:20:08.458] process 8291 exited with code 0 after 0.0m I1011 00:20:08.459] Call: gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1570644287694162 cp /tmp/gsutil_p3o6ZQ gs://kubernetes-upstream/pr-logs/directory/pull-azurefile-csi-driver-e2e/jobResultsCache.json I1011 00:20:09.888] process 8435 exited with code 0 after 0.0m I1011 00:20:09.888] Call: gsutil stat gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/jobResultsCache.json I1011 00:20:10.926] process 8613 exited with code 0 after 0.0m I1011 00:20:10.926] Call: gsutil -q cat 'gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/jobResultsCache.json#1570644291220883' I1011 00:20:12.201] process 8755 exited with code 0 after 0.0m I1011 00:20:12.201] Call: gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1570644291220883 cp /tmp/gsutil_JHRZUQ gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/jobResultsCache.json I1011 00:20:13.485] process 8899 exited with code 0 after 0.0m I1011 00:20:13.486] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_2RPnrB gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/1182441356274962432/finished.json I1011 00:20:14.767] process 9077 exited with code 0 after 0.0m I1011 00:20:14.768] Call: gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_AvgUG9 gs://kubernetes-upstream/pr-logs/directory/pull-azurefile-csi-driver-e2e/latest-build.txt I1011 00:20:16.085] process 9255 exited with code 0 after 0.0m I1011 00:20:16.085] Call: gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_lx14ot gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azurefile-csi-driver/120/pull-azurefile-csi-driver-e2e/latest-build.txt I1011 00:20:17.375] process 9434 exited with code 0 after 0.0m