W1113 21:06:28.047] ************************************************************************** bootstrap.py is deprecated! test-infra oncall does not support any job still using bootstrap.py. Please migrate your job to podutils! https://github.com/kubernetes/test-infra/blob/master/prow/pod-utilities.md ************************************************************************** I1113 21:06:28.047] Args: --job=chewong-pull-in-tree-azure-disk-e2e --service-account=/etc/service-account/service-account.json --upload=gs://kubernetes-jenkins/logs --job=chewong-pull-in-tree-azure-disk-e2e --root=/go/src --service-account=/etc/service-account/service-account.json --repo=k8s.io/kubernetes --repo=sigs.k8s.io/azuredisk-csi-driver=master:a6a3e9b4c8eb15f983b9cfc34935ebd72f18b698,188:463a1299807122c7d9e078a5bb09bb13492c20cf --upload=gs://kubernetes-upstream/pr-logs --timeout=460 --scenario=kubernetes_e2e -- --gce-ssh= --test=true --up=true --down=true --deployment=acsengine --build=host-go --provider=skeleton --ginkgo-parallel=1 --acsengine-agentpoolcount=2 --acsengine-admin-username=azureuser '--acsengine-creds=$AZURE_CREDENTIALS' --acsengine-orchestratorRelease=1.16 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_DS2_v2 --acsengine-hyperkube=True --acsengine-location=westus2 '--acsengine-public-key=$AZURE_SSH_PUBLIC_KEY_FILE' --acsengine-template-url=https://raw.githubusercontent.com/Azure/aks-engine/master/examples/kubernetes.json --acsengine-download-url=https://chuwontest.blob.core.windows.net/aks-engine/aks-engine-8cf7c2a74-linux-amd64.tar.gz --test-azure-disk-csi-driver=True --timeout=420m I1113 21:06:28.048] Bootstrap chewong-pull-in-tree-azure-disk-e2e... I1113 21:06:28.051] Builder: 5c6379f1-0659-11ea-918b-16773c0c7aed I1113 21:06:28.051] Image: gcr.io/k8s-testimages/kubekins-e2e:v20191112-9f04410-master I1113 21:06:28.051] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/188/chewong-pull-in-tree-azure-disk-e2e/1194723159232745472 I1113 21:06:28.051] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1113 21:06:28.540] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I1113 21:06:28.569] process 194 exited with code 0 after 0.0m I1113 21:06:28.569] Call: gcloud config get-value account I1113 21:06:28.785] process 206 exited with code 0 after 0.0m I1113 21:06:28.786] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I1113 21:06:28.786] Root: /go/src I1113 21:06:28.786] cd to /go/src I1113 21:06:28.786] Checkout: /go/src/k8s.io/kubernetes master to /go/src/k8s.io/kubernetes I1113 21:06:28.786] Call: git init k8s.io/kubernetes I1113 21:06:28.790] Initialized empty Git repository in /go/src/k8s.io/kubernetes/.git/ I1113 21:06:28.790] process 218 exited with code 0 after 0.0m I1113 21:06:28.790] Call: git config --local user.name 'K8S Bootstrap' I1113 21:06:28.792] process 219 exited with code 0 after 0.0m I1113 21:06:28.793] Call: git config --local user.email k8s_bootstrap@localhost I1113 21:06:28.795] process 220 exited with code 0 after 0.0m I1113 21:06:28.795] Call: git fetch --quiet --tags https://github.com/kubernetes/kubernetes master I1113 21:07:25.772] process 221 exited with code 0 after 0.9m I1113 21:07:25.773] Call: git checkout -B test FETCH_HEAD W1113 21:07:27.752] Switched to a new branch 'test' I1113 21:07:27.762] process 232 exited with code 0 after 0.0m I1113 21:07:27.762] Call: git show -s --format=format:%ct HEAD I1113 21:07:27.783] process 233 exited with code 0 after 0.0m I1113 21:07:27.784] Checkout: /go/src/sigs.k8s.io/azuredisk-csi-driver master:a6a3e9b4c8eb15f983b9cfc34935ebd72f18b698,188:463a1299807122c7d9e078a5bb09bb13492c20cf to /go/src/sigs.k8s.io/azuredisk-csi-driver I1113 21:07:27.784] Call: git init sigs.k8s.io/azuredisk-csi-driver I1113 21:07:27.787] Initialized empty Git repository in /go/src/sigs.k8s.io/azuredisk-csi-driver/.git/ I1113 21:07:27.788] process 234 exited with code 0 after 0.0m I1113 21:07:27.788] Call: git config --local user.name 'K8S Bootstrap' I1113 21:07:27.790] process 235 exited with code 0 after 0.0m I1113 21:07:27.791] Call: git config --local user.email k8s_bootstrap@localhost I1113 21:07:27.793] process 236 exited with code 0 after 0.0m I1113 21:07:27.793] Call: git fetch --quiet --tags https://github.com/kubernetes-sigs/azuredisk-csi-driver master +refs/pull/188/head:refs/pr/188 I1113 21:07:33.600] process 237 exited with code 0 after 0.1m I1113 21:07:33.600] Call: git checkout -B test a6a3e9b4c8eb15f983b9cfc34935ebd72f18b698 W1113 21:07:34.104] Switched to a new branch 'test' I1113 21:07:34.108] process 248 exited with code 0 after 0.0m I1113 21:07:34.108] Call: git show -s --format=format:%ct HEAD I1113 21:07:34.111] process 249 exited with code 0 after 0.0m I1113 21:07:34.111] Call: git merge --no-ff -m 'Merge +refs/pull/188/head:refs/pr/188' 463a1299807122c7d9e078a5bb09bb13492c20cf I1113 21:07:34.271] Merge made by the 'recursive' strategy. I1113 21:07:34.274] ...{safe_mounter_linux.go => safe_mounter_unix.go} | 2 +- I1113 21:07:34.274] test/e2e/README.md | 9 +- I1113 21:07:34.274] test/e2e/driver/azuredisk_csi_driver.go | 23 +++- I1113 21:07:34.274] test/e2e/suite_test.go | 119 +++++++++++---------- I1113 21:07:34.275] 4 files changed, 89 insertions(+), 64 deletions(-) I1113 21:07:34.275] rename pkg/mounter/{safe_mounter_linux.go => safe_mounter_unix.go} (97%) I1113 21:07:34.275] process 250 exited with code 0 after 0.0m I1113 21:07:34.275] Configure environment... I1113 21:07:34.275] Call: git show -s --format=format:%ct HEAD I1113 21:07:34.290] process 266 exited with code 0 after 0.0m I1113 21:07:34.290] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1113 21:07:34.922] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I1113 21:07:35.027] process 267 exited with code 0 after 0.0m I1113 21:07:35.027] Call: gcloud config get-value account I1113 21:07:35.247] process 279 exited with code 0 after 0.0m I1113 21:07:35.248] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I1113 21:07:35.248] Call: bash -c ' set -o errexit set -o nounset export KUBE_ROOT=. source hack/lib/version.sh kube::version::get_version_vars echo $KUBE_GIT_VERSION ' I1113 21:07:35.910] process 291 exited with code 0 after 0.0m I1113 21:07:35.911] Start 1194723159232745472 at v1.18.0-alpha.0.822+c466fd9eaf31a6... I1113 21:07:35.912] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_UCrRmi gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/188/chewong-pull-in-tree-azure-disk-e2e/1194723159232745472/started.json I1113 21:07:37.362] process 324 exited with code 0 after 0.0m I1113 21:07:37.362] Call: gsutil -q -h Content-Type:text/plain -h 'x-goog-meta-link: gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/188/chewong-pull-in-tree-azure-disk-e2e/1194723159232745472' cp /tmp/gsutil_GNfrFQ gs://kubernetes-upstream/pr-logs/directory/chewong-pull-in-tree-azure-disk-e2e/1194723159232745472.txt I1113 21:07:38.524] process 504 exited with code 0 after 0.0m I1113 21:07:38.525] Call: /workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py --gce-ssh= --test=true --up=true --down=true --deployment=acsengine --build=host-go --provider=skeleton --ginkgo-parallel=1 --acsengine-agentpoolcount=2 --acsengine-admin-username=azureuser --acsengine-creds=/etc/azure-cred/credentials --acsengine-orchestratorRelease=1.16 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_DS2_v2 --acsengine-hyperkube=True --acsengine-location=westus2 --acsengine-public-key=/etc/azure-ssh/azure-ssh-pub --acsengine-template-url=https://raw.githubusercontent.com/Azure/aks-engine/master/examples/kubernetes.json --acsengine-download-url=https://chuwontest.blob.core.windows.net/aks-engine/aks-engine-8cf7c2a74-linux-amd64.tar.gz --test-azure-disk-csi-driver=True --timeout=420m W1113 21:07:38.560] starts with local mode W1113 21:07:38.560] Environment: W1113 21:07:38.560] ARTIFACTS=/workspace/_artifacts W1113 21:07:38.560] AWS_SSH_PRIVATE_KEY_FILE=/root/.ssh/kube_aws_rsa W1113 21:07:38.560] AWS_SSH_PUBLIC_KEY_FILE=/root/.ssh/kube_aws_rsa.pub W1113 21:07:38.560] AZURE_CREDENTIALS=/etc/azure-cred/credentials W1113 21:07:38.561] AZURE_SSH_PUBLIC_KEY_FILE=/etc/azure-ssh/azure-ssh-pub W1113 21:07:38.561] AZURE_STORAGE_DRIVER=kubernetes.io/azure-disk W1113 21:07:38.561] AZ_STORAGE_CONTAINER_NAME=mystoragecontainer W1113 21:07:38.561] BAZEL_REMOTE_CACHE_ENABLED=false W1113 21:07:38.561] BAZEL_VERSION=0.23.2 W1113 21:07:38.561] BOOTSTRAP_MIGRATION=yes W1113 21:07:38.561] BUILD_ID=1194723159232745472 W1113 21:07:38.561] BUILD_NUMBER=1194723159232745472 W1113 21:07:38.562] CLOUDSDK_COMPONENT_MANAGER_DISABLE_UPDATE_CHECK=true W1113 21:07:38.562] CLOUDSDK_CONFIG=/go/src/k8s.io/kubernetes/.config/gcloud W1113 21:07:38.562] CLOUDSDK_CORE_DISABLE_PROMPTS=1 W1113 21:07:38.562] CLOUDSDK_EXPERIMENTAL_FAST_COMPONENT_UPDATE=false W1113 21:07:38.562] CLOUD_CONFIG=random W1113 21:07:38.562] DECK_PORT=tcp://10.0.160.83:80 W1113 21:07:38.562] DECK_PORT_80_TCP=tcp://10.0.160.83:80 W1113 21:07:38.562] DECK_PORT_80_TCP_ADDR=10.0.160.83 W1113 21:07:38.562] DECK_PORT_80_TCP_PORT=80 W1113 21:07:38.563] DECK_PORT_80_TCP_PROTO=tcp W1113 21:07:38.563] DECK_SERVICE_HOST=10.0.160.83 W1113 21:07:38.563] DECK_SERVICE_PORT=80 W1113 21:07:38.563] DOCKER_IN_DOCKER_ENABLED=true W1113 21:07:38.563] DOCKER_IN_DOCKER_IPV6_ENABLED=false W1113 21:07:38.563] GCS_ARTIFACTS_DIR=gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/188/chewong-pull-in-tree-azure-disk-e2e/1194723159232745472/artifacts W1113 21:07:38.563] GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json W1113 21:07:38.563] GOPATH=/go W1113 21:07:38.564] GO_TARBALL=go1.12.12.linux-amd64.tar.gz W1113 21:07:38.564] HOME=/workspace W1113 21:07:38.564] HOOK_PORT=tcp://10.0.144.133:8888 W1113 21:07:38.564] HOOK_PORT_8888_TCP=tcp://10.0.144.133:8888 W1113 21:07:38.564] HOOK_PORT_8888_TCP_ADDR=10.0.144.133 W1113 21:07:38.564] HOOK_PORT_8888_TCP_PORT=8888 W1113 21:07:38.564] HOOK_PORT_8888_TCP_PROTO=tcp W1113 21:07:38.564] HOOK_SERVICE_HOST=10.0.144.133 W1113 21:07:38.564] HOOK_SERVICE_PORT=8888 W1113 21:07:38.565] HOSTNAME=5c6379f1-0659-11ea-918b-16773c0c7aed W1113 21:07:38.565] IMAGE=gcr.io/k8s-testimages/kubekins-e2e:v20191112-9f04410-master W1113 21:07:38.565] INSTANCE_PREFIX=bootstrap-e2e W1113 21:07:38.565] JENKINS_GCE_SSH_PRIVATE_KEY_FILE=/root/.ssh/google_compute_engine W1113 21:07:38.565] JENKINS_GCE_SSH_PUBLIC_KEY_FILE=/root/.ssh/google_compute_engine.pub W1113 21:07:38.565] JOB_NAME=chewong-pull-in-tree-azure-disk-e2e W1113 21:07:38.566] JOB_SPEC={"type":"presubmit","job":"chewong-pull-in-tree-azure-disk-e2e","buildid":"1194723159232745472","prowjobid":"5c6379f1-0659-11ea-918b-16773c0c7aed","refs":{"org":"Azure","repo":"kubernetes","repo_link":"https://github.com/Azure/kubernetes","base_ref":"master","base_sha":"e7ce8d8a6f82a366a94ee7eb2a29b023cb361007","base_link":"https://github.com/Azure/kubernetes/commit/e7ce8d8a6f82a366a94ee7eb2a29b023cb361007","pulls":[{"number":113,"author":"chewong","sha":"879465972041635fd7bc8269da49153b67e63822","link":"https://github.com/Azure/kubernetes/pull/113","commit_link":"https://github.com/Azure/kubernetes/pull/113/commits/879465972041635fd7bc8269da49153b67e63822","author_link":"https://github.com/chewong"}]}} W1113 21:07:38.566] JOB_TYPE=presubmit W1113 21:07:38.566] KUBERNETES_PORT=tcp://10.0.0.1:443 W1113 21:07:38.566] KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443 W1113 21:07:38.566] KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1 W1113 21:07:38.567] KUBERNETES_PORT_443_TCP_PORT=443 W1113 21:07:38.567] KUBERNETES_PORT_443_TCP_PROTO=tcp W1113 21:07:38.567] KUBERNETES_SERVICE_HOST=10.0.0.1 W1113 21:07:38.567] KUBERNETES_SERVICE_PORT=443 W1113 21:07:38.567] KUBERNETES_SERVICE_PORT_HTTPS=443 W1113 21:07:38.567] KUBETEST_IN_DOCKER=true W1113 21:07:38.567] KUBETEST_MANUAL_DUMP=y W1113 21:07:38.568] KUBE_AWS_INSTANCE_PREFIX=bootstrap-e2e W1113 21:07:38.568] KUBE_GCE_INSTANCE_PREFIX=bootstrap-e2e W1113 21:07:38.568] KUBE_SSH_KEY_PATH=/etc/ssh-key-secret/ssh-private W1113 21:07:38.568] KUBE_SSH_PUBLIC_KEY_PATH=/etc/ssh-key-secret/ssh-public W1113 21:07:38.568] KUBE_SSH_USER=azureuser W1113 21:07:38.568] KUBE_VERBOSE=0 W1113 21:07:38.568] NODE_NAME=5c6379f1-0659-11ea-918b-16773c0c7aed W1113 21:07:38.569] PATH=/go/bin:/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/workspace:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin W1113 21:07:38.569] PROW_JOB_ID=5c6379f1-0659-11ea-918b-16773c0c7aed W1113 21:07:38.569] PULL_BASE_REF=master W1113 21:07:38.569] PULL_BASE_SHA=e7ce8d8a6f82a366a94ee7eb2a29b023cb361007 W1113 21:07:38.569] PULL_NUMBER=113 W1113 21:07:38.569] PULL_PULL_SHA=879465972041635fd7bc8269da49153b67e63822 W1113 21:07:38.570] PULL_REFS=master:e7ce8d8a6f82a366a94ee7eb2a29b023cb361007,113:879465972041635fd7bc8269da49153b67e63822 W1113 21:07:38.570] PWD=/workspace W1113 21:07:38.570] REGISTRY=k8sprowinternal.azurecr.io W1113 21:07:38.570] REPO_NAME=kubernetes W1113 21:07:38.570] REPO_OWNER=Azure W1113 21:07:38.570] SHLVL=2 W1113 21:07:38.570] SOURCE_DATE_EPOCH=1573679130 W1113 21:07:38.570] TERM=xterm W1113 21:07:38.570] TIDE_PORT=tcp://10.0.180.53:80 W1113 21:07:38.571] TIDE_PORT_80_TCP=tcp://10.0.180.53:80 W1113 21:07:38.571] TIDE_PORT_80_TCP_ADDR=10.0.180.53 W1113 21:07:38.571] TIDE_PORT_80_TCP_PORT=80 W1113 21:07:38.571] TIDE_PORT_80_TCP_PROTO=tcp W1113 21:07:38.571] TIDE_SERVICE_HOST=10.0.180.53 W1113 21:07:38.571] TIDE_SERVICE_PORT=80 W1113 21:07:38.571] WORKSPACE=/workspace W1113 21:07:38.571] _=./test-infra/jenkins/bootstrap.py W1113 21:07:38.572] Run: ('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=host-go', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=1', '--acsengine-agentpoolcount=2', '--acsengine-admin-username=azureuser', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.16', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_DS2_v2', '--acsengine-hyperkube=True', '--acsengine-location=westus2', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://raw.githubusercontent.com/Azure/aks-engine/master/examples/kubernetes.json', '--acsengine-download-url=https://chuwontest.blob.core.windows.net/aks-engine/aks-engine-8cf7c2a74-linux-amd64.tar.gz', '--test-azure-disk-csi-driver=True', '--timeout=420m') W1113 21:07:38.576] 2019/11/13 21:07:38 main.go:332: Limiting testing to 7h0m0s W1113 21:07:38.580] 2019/11/13 21:07:38 azure.go:232: Reading credentials file /etc/azure-cred/credentials W1113 21:07:38.580] 2019/11/13 21:07:38 process.go:153: Running: make -C /go/src/k8s.io/kubernetes all I1113 21:07:38.681] make: Entering directory '/go/src/k8s.io/kubernetes' I1113 21:07:38.681] make[1]: Entering directory '/go/src/k8s.io/kubernetes' I1113 21:07:46.033] +++ [1113 21:07:46] Building go targets for linux/amd64: I1113 21:07:46.033] ./vendor/k8s.io/code-generator/cmd/deepcopy-gen I1113 21:07:52.601] +++ [1113 21:07:52] Building go targets for linux/amd64: I1113 21:07:52.601] ./vendor/k8s.io/code-generator/cmd/defaulter-gen I1113 21:07:57.976] +++ [1113 21:07:57] Building go targets for linux/amd64: I1113 21:07:57.977] ./vendor/k8s.io/code-generator/cmd/conversion-gen I1113 21:08:08.838] +++ [1113 21:08:08] Building go targets for linux/amd64: I1113 21:08:08.838] ./vendor/k8s.io/kube-openapi/cmd/openapi-gen I1113 21:08:19.338] +++ [1113 21:08:19] Building go targets for linux/amd64: I1113 21:08:19.339] ./vendor/github.com/go-bindata/go-bindata/go-bindata I1113 21:08:20.319] make[1]: Leaving directory '/go/src/k8s.io/kubernetes' I1113 21:08:20.595] +++ [1113 21:08:20] Building go targets for linux/amd64: I1113 21:08:20.596] cmd/kube-proxy I1113 21:08:20.596] cmd/kube-apiserver I1113 21:08:20.596] cmd/kube-controller-manager I1113 21:08:20.596] cmd/kubelet I1113 21:08:20.596] cmd/kubeadm I1113 21:08:20.596] cmd/kube-scheduler I1113 21:08:20.596] vendor/k8s.io/apiextensions-apiserver I1113 21:08:20.597] cluster/gce/gci/mounter I1113 21:08:20.597] cmd/kubectl I1113 21:08:20.597] cmd/gendocs I1113 21:08:20.597] cmd/genkubedocs I1113 21:08:20.597] cmd/genman I1113 21:08:20.597] cmd/genyaml I1113 21:08:20.597] cmd/genswaggertypedocs I1113 21:08:20.598] cmd/linkcheck I1113 21:08:20.598] vendor/github.com/onsi/ginkgo/ginkgo I1113 21:08:20.598] test/e2e/e2e.test I1113 21:08:20.598] cluster/images/conformance/go-runner I1113 21:08:20.598] cmd/kubemark I1113 21:08:20.598] vendor/github.com/onsi/ginkgo/ginkgo I1113 21:08:20.598] test/e2e_node/e2e_node.test I1113 21:12:27.355] make: Leaving directory '/go/src/k8s.io/kubernetes' W1113 21:12:27.456] 2019/11/13 21:12:27 process.go:155: Step 'make -C /go/src/k8s.io/kubernetes all' finished in 4m48.774859412s W1113 21:12:27.456] 2019/11/13 21:12:27 util.go:265: Flushing memory. W1113 21:12:47.771] 2019/11/13 21:12:47 azure.go:916: Deleting resource group: kubetest-9f7bc491-0659-11ea-af4e-0242b89a0000. W1113 21:12:48.271] 2019/11/13 21:12:48 azure.go:654: CWD /go/src/k8s.io/kubernetes W1113 21:12:48.271] 2019/11/13 21:12:48 azure.go:673: Attempting Docker login with azure cred. W1113 21:12:49.908] 2019/11/13 21:12:49 azure.go:682: Docker login success. W1113 21:12:49.909] 2019/11/13 21:12:49 azure.go:727: Building hyperkube. W1113 21:12:49.909] 2019/11/13 21:12:49 util.go:56: Warning: Couldn't find directory src/k8s.io/kubernetes/cmd/hyperkube under any of GOPATH /go, defaulting to /go/src/k8s.io/kubernetes/cmd/hyperkube W1113 21:12:49.909] 2019/11/13 21:12:49 azure.go:745: Pushing hyperkube. W1113 21:12:49.909] 2019/11/13 21:12:49 process.go:153: Running: make -C /go/src/k8s.io/kubernetes/cluster/images/hyperkube push I1113 21:12:50.010] make: Entering directory '/go/src/k8s.io/kubernetes/cluster/images/hyperkube' I1113 21:12:50.010] cp -r ./* /tmp/hyperkubez9jzPj I1113 21:12:50.010] tar -cvzf /tmp/hyperkubez9jzPj/binaries.tgz -C /go/src/k8s.io/kubernetes/cluster/images/hyperkube/../../../_output/local/bin/linux/amd64 kube-apiserver kube-controller-manager \ I1113 21:12:50.010] kube-proxy kube-scheduler kubectl kubelet I1113 21:12:50.010] kube-apiserver I1113 21:12:54.840] kube-controller-manager I1113 21:12:59.330] kube-proxy I1113 21:13:01.090] kube-scheduler I1113 21:13:03.099] kubectl I1113 21:13:05.179] kubelet I1113 21:13:09.856] chmod a+rx /tmp/hyperkubez9jzPj/hyperkube I1113 21:13:09.857] cd /tmp/hyperkubez9jzPj && sed -i.back "s|BASEIMAGE|k8s.gcr.io/debian-hyperkube-base-amd64:0.12.1|g" Dockerfile I1113 21:13:09.861] docker build --pull -t k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1194723159232745472-58136e92 /tmp/hyperkubez9jzPj I1113 21:13:10.682] Sending build context to Docker daemon 122MB I1113 21:13:10.707] Step 1/4 : FROM k8s.gcr.io/debian-hyperkube-base-amd64:0.12.1 I1113 21:13:11.030] 0.12.1: Pulling from debian-hyperkube-base-amd64 I1113 21:13:11.031] 346aee5ea5bc: Pulling fs layer I1113 21:13:11.031] 9c47fde751af: Pulling fs layer I1113 21:13:11.031] be2693a52daf: Pulling fs layer I1113 21:13:11.032] 6b69eb11d043: Pulling fs layer I1113 21:13:11.032] 0abeb1500767: Pulling fs layer I1113 21:13:11.032] 4062d80041b7: Pulling fs layer I1113 21:13:11.032] 23b6daf06fc2: Pulling fs layer I1113 21:13:11.032] 4062d80041b7: Waiting I1113 21:13:11.032] 6b69eb11d043: Waiting I1113 21:13:11.032] 23b6daf06fc2: Waiting I1113 21:13:11.032] 0abeb1500767: Waiting I1113 21:13:11.170] 9c47fde751af: Download complete I1113 21:13:11.196] be2693a52daf: Verifying Checksum I1113 21:13:11.196] be2693a52daf: Download complete I1113 21:13:11.342] 0abeb1500767: Download complete I1113 21:13:11.363] 6b69eb11d043: Download complete I1113 21:13:11.399] 346aee5ea5bc: Verifying Checksum I1113 21:13:11.399] 346aee5ea5bc: Download complete I1113 21:13:11.849] 23b6daf06fc2: Verifying Checksum I1113 21:13:11.849] 23b6daf06fc2: Download complete I1113 21:13:12.599] 4062d80041b7: Verifying Checksum I1113 21:13:12.600] 4062d80041b7: Download complete I1113 21:13:12.653] 346aee5ea5bc: Pull complete I1113 21:13:12.806] 9c47fde751af: Pull complete I1113 21:13:13.014] be2693a52daf: Pull complete I1113 21:13:13.173] 6b69eb11d043: Pull complete I1113 21:13:13.335] 0abeb1500767: Pull complete I1113 21:13:19.426] 4062d80041b7: Pull complete I1113 21:13:20.351] 23b6daf06fc2: Pull complete I1113 21:13:20.379] Digest: sha256:5d4ea2fb5fbe9a9a9da74f67cf2faefc881968bc39f2ac5d62d9167e575812a1 I1113 21:13:20.398] Status: Downloaded newer image for k8s.gcr.io/debian-hyperkube-base-amd64:0.12.1 I1113 21:13:20.398] ---> a46476511725 I1113 21:13:20.398] Step 2/4 : ADD binaries.tgz /usr/local/bin I1113 21:13:46.802] ---> bd514329890a I1113 21:13:46.803] Step 3/4 : COPY hyperkube /hyperkube I1113 21:13:47.468] ---> a4a5681e9ccd I1113 21:13:47.468] Step 4/4 : ENTRYPOINT ["/hyperkube"] I1113 21:13:47.601] ---> Running in 0fc1522180e5 I1113 21:13:48.137] Removing intermediate container 0fc1522180e5 I1113 21:13:48.138] ---> 197d7d3fdc15 I1113 21:13:48.152] Successfully built 197d7d3fdc15 I1113 21:13:48.237] Successfully tagged k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1194723159232745472-58136e92 I1113 21:13:48.240] rm -rf "/tmp/hyperkubez9jzPj" I1113 21:13:48.258] docker push k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1194723159232745472-58136e92 I1113 21:13:48.369] The push refers to repository [k8sprowinternal.azurecr.io/hyperkube-amd64] I1113 21:13:48.381] e08699430ee5: Preparing I1113 21:13:48.381] 5f86d049a731: Preparing I1113 21:13:48.382] 39b3ac6d96e9: Preparing I1113 21:13:48.382] 7bbae4dddb88: Preparing I1113 21:13:48.382] a00defcfe869: Preparing I1113 21:13:48.382] 2ab0ae805c74: Preparing I1113 21:13:48.382] 43a8fe7d2382: Preparing I1113 21:13:48.382] 3f6a6f542637: Preparing I1113 21:13:48.382] 5ba3be777c2d: Preparing I1113 21:13:48.382] 2ab0ae805c74: Waiting I1113 21:13:48.382] 3f6a6f542637: Waiting I1113 21:13:48.382] 5ba3be777c2d: Waiting I1113 21:13:48.383] 43a8fe7d2382: Waiting I1113 21:13:48.518] a00defcfe869: Layer already exists I1113 21:13:48.544] 39b3ac6d96e9: Layer already exists I1113 21:13:48.568] 7bbae4dddb88: Layer already exists I1113 21:13:48.621] 2ab0ae805c74: Layer already exists I1113 21:13:48.642] 43a8fe7d2382: Layer already exists I1113 21:13:48.665] 3f6a6f542637: Layer already exists I1113 21:13:48.696] 5ba3be777c2d: Layer already exists I1113 21:13:48.745] e08699430ee5: Pushed I1113 21:14:11.935] 5f86d049a731: Pushed I1113 21:14:12.902] azure-e2e-1194723159232745472-58136e92: digest: sha256:9b8a3cef3598f78158f89b47df44773df95aaaa294b0b26c54f8b5847c52c0f8 size: 2206 I1113 21:14:12.916] docker rmi k8sprowinternal.azurecr.io/hyperkube:azure-e2e-1194723159232745472-58136e92 2>/dev/null || true I1113 21:14:12.965] docker tag k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1194723159232745472-58136e92 k8sprowinternal.azurecr.io/hyperkube:azure-e2e-1194723159232745472-58136e92 I1113 21:14:13.033] docker push k8sprowinternal.azurecr.io/hyperkube:azure-e2e-1194723159232745472-58136e92 I1113 21:14:13.102] The push refers to repository [k8sprowinternal.azurecr.io/hyperkube] I1113 21:14:13.113] e08699430ee5: Preparing I1113 21:14:13.114] 5f86d049a731: Preparing I1113 21:14:13.114] 39b3ac6d96e9: Preparing I1113 21:14:13.114] 7bbae4dddb88: Preparing I1113 21:14:13.114] a00defcfe869: Preparing I1113 21:14:13.114] 2ab0ae805c74: Preparing I1113 21:14:13.114] 43a8fe7d2382: Preparing I1113 21:14:13.114] 3f6a6f542637: Preparing I1113 21:14:13.114] 5ba3be777c2d: Preparing I1113 21:14:13.115] 2ab0ae805c74: Waiting I1113 21:14:13.115] 43a8fe7d2382: Waiting I1113 21:14:13.115] 5ba3be777c2d: Waiting I1113 21:14:13.115] 3f6a6f542637: Waiting I1113 21:14:13.197] 7bbae4dddb88: Layer already exists I1113 21:14:13.222] 39b3ac6d96e9: Layer already exists I1113 21:14:13.245] a00defcfe869: Layer already exists I1113 21:14:13.279] 2ab0ae805c74: Layer already exists I1113 21:14:13.306] 5f86d049a731: Mounted from hyperkube-amd64 I1113 21:14:13.309] 3f6a6f542637: Layer already exists I1113 21:14:13.329] e08699430ee5: Mounted from hyperkube-amd64 I1113 21:14:13.330] 43a8fe7d2382: Layer already exists I1113 21:14:13.374] 5ba3be777c2d: Layer already exists I1113 21:14:14.287] azure-e2e-1194723159232745472-58136e92: digest: sha256:9b8a3cef3598f78158f89b47df44773df95aaaa294b0b26c54f8b5847c52c0f8 size: 2206 I1113 21:14:14.315] make: Leaving directory '/go/src/k8s.io/kubernetes/cluster/images/hyperkube' W1113 21:14:14.415] 2019/11/13 21:14:14 process.go:155: Step 'make -C /go/src/k8s.io/kubernetes/cluster/images/hyperkube push' finished in 1m24.40613698s W1113 21:14:14.416] 2019/11/13 21:14:14 azure.go:686: Docker logout. W1113 21:14:14.416] 2019/11/13 21:14:14 azure.go:754: Custom hyperkube URL: k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1194723159232745472-58136e92 . W1113 21:14:14.416] 2019/11/13 21:14:14 azure.go:797: downloading /workspace/aks174143420/kubernetes.json from https://raw.githubusercontent.com/Azure/aks-engine/master/examples/kubernetes.json. W1113 21:14:14.416] 2019/11/13 21:14:14 util.go:42: curl https://raw.githubusercontent.com/Azure/aks-engine/master/examples/kubernetes.json W1113 21:14:14.560] 2019/11/13 21:14:14 azure.go:529: downloading /workspace/aks-engine.tar.gz from https://chuwontest.blob.core.windows.net/aks-engine/aks-engine-8cf7c2a74-linux-amd64.tar.gz. W1113 21:14:14.561] 2019/11/13 21:14:14 util.go:42: curl https://chuwontest.blob.core.windows.net/aks-engine/aks-engine-8cf7c2a74-linux-amd64.tar.gz W1113 21:14:15.332] 2019/11/13 21:14:15 azure.go:556: Extracting tar file /workspace/aks-engine.tar.gz into directory /go/src/k8s.io/kubernetes . W1113 21:14:15.333] 2019/11/13 21:14:15 process.go:153: Running: tar -xzf /workspace/aks-engine.tar.gz --strip 1 W1113 21:14:15.436] 2019/11/13 21:14:15 process.go:155: Step 'tar -xzf /workspace/aks-engine.tar.gz --strip 1' finished in 103.371419ms W1113 21:14:15.436] 2019/11/13 21:14:15 process.go:153: Running: /go/src/k8s.io/kubernetes/aks-engine generate /workspace/aks174143420/kubernetes.json --output-directory /workspace/aks174143420 I1113 21:14:15.590] INFO[0000] Generating assets into /workspace/aks174143420... W1113 21:14:24.872] 2019/11/13 21:14:24 process.go:155: Step '/go/src/k8s.io/kubernetes/aks-engine generate /workspace/aks174143420/kubernetes.json --output-directory /workspace/aks174143420' finished in 9.435917468s W1113 21:14:24.874] 2019/11/13 21:14:24 azure.go:627: Setting kubeconfig env variable: kubeconfig path: /workspace/aks174143420/kubeconfig/kubeconfig.westus2.json. W1113 21:14:24.874] 2019/11/13 21:14:24 azure.go:629: Creating resource group: kubetest-9f7bc491-0659-11ea-af4e-0242b89a0000. W1113 21:14:24.875] 2019/11/13 21:14:24 azure.go:631: Creating Azure resource group: kubetest-9f7bc491-0659-11ea-af4e-0242b89a0000 for cluster deployment. W1113 21:14:25.137] 2019/11/13 21:14:25 azure.go:636: Validating deployment ARM templates. W1113 21:14:25.703] 2019/11/13 21:14:25 azure.go:642: Deploying cluster kubetest-9f7bc491-0659-11ea-af4e-0242b89a0000 in resource group kubetest-9f7bc491-0659-11ea-af4e-0242b89a0000. W1113 21:22:26.654] 2019/11/13 21:22:26 process.go:153: Running: kubectl --match-server-version=false version W1113 21:22:27.017] 2019/11/13 21:22:27 process.go:155: Step 'kubectl --match-server-version=false version' finished in 363.434786ms W1113 21:22:27.017] 2019/11/13 21:22:27 process.go:153: Running: kubectl --match-server-version=false get nodes -oyaml W1113 21:22:27.802] 2019/11/13 21:22:27 process.go:155: Step 'kubectl --match-server-version=false get nodes -oyaml' finished in 784.629445ms W1113 21:22:27.802] 2019/11/13 21:22:27 azure.go:980: KUBE_TEST_REPO_LIST_DOWNLOAD_LOCATION not set. Using default test image repos. W1113 21:22:27.802] 2019/11/13 21:22:27 azure.go:980: KUBE_TEST_REPO_LIST_DOWNLOAD_LOCATION not set. Using default test image repos. W1113 21:22:27.802] 2019/11/13 21:22:27 process.go:153: Running: kubectl get nodes --no-headers W1113 21:22:27.895] 2019/11/13 21:22:27 process.go:155: Step 'kubectl get nodes --no-headers' finished in 92.47746ms W1113 21:22:27.895] 2019/11/13 21:22:27 e2e.go:474: Cluster nodes: W1113 21:22:27.895] k8s-agentpool1-33017627-vmss000000 Ready agent 55s v1.18.0-alpha.0.822+c466fd9eaf31a6 W1113 21:22:27.895] k8s-agentpool1-33017627-vmss000001 Ready agent 55s v1.18.0-alpha.0.822+c466fd9eaf31a6 W1113 21:22:27.895] k8s-master-33017627-0 Ready master 55s v1.18.0-alpha.0.822+c466fd9eaf31a6 W1113 21:22:27.895] 2019/11/13 21:22:27 process.go:153: Running: kubectl --match-server-version=false version W1113 21:22:28.005] 2019/11/13 21:22:28 process.go:155: Step 'kubectl --match-server-version=false version' finished in 110.69021ms W1113 21:22:28.006] 2019/11/13 21:22:28 process.go:153: Running: make e2e-test I1113 21:22:28.106] go test -v -timeout=0 ./test/e2e "-ginkgo.noColor" I1113 21:23:13.178] === RUN TestE2E I1113 21:23:13.179] Running Suite: AzureDisk CSI Driver End-to-End Tests I1113 21:23:13.179] ==================================================== I1113 21:23:13.179] Random Seed: 1573680193 I1113 21:23:13.179] Will run 9 of 9 specs I1113 21:23:13.179] I1113 21:23:13.681] 2019/11/13 21:23:13 Attempting docker login with Azure service principal I1113 21:23:14.775] 2019/11/13 21:23:14 docker login is successful I1113 21:23:14.775] 2019/11/13 21:23:14 Installing Azure Disk CSI Driver... I1113 21:23:14.776] make[1]: Entering directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1113 21:23:14.778] # Use v2.11.0 helm to match tiller's version in clusters made by aks-engine I1113 21:23:14.778] curl https://raw.githubusercontent.com/helm/helm/master/scripts/get | DESIRED_VERSION=v2.11.0 bash I1113 21:23:15.247] % Total % Received % Xferd Average Speed Time Time Time Current I1113 21:23:15.247] Dload Upload Total Spent Left Speed I1113 21:23:15.316] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7164 100 7164 0 0 101k 0 --:--:-- --:--:-- --:--:-- 101k I1113 21:23:15.332] Downloading https://get.helm.sh/helm-v2.11.0-linux-amd64.tar.gz I1113 21:23:16.644] Preparing to install helm and tiller into /usr/local/bin I1113 21:23:16.668] helm installed into /usr/local/bin/helm I1113 21:23:16.692] tiller installed into /usr/local/bin/tiller I1113 21:23:16.694] Run 'helm init' to configure helm. I1113 21:23:16.708] # Make sure tiller is ready I1113 21:23:16.709] kubectl wait pod -l name=tiller --namespace kube-system --for condition=ready --timeout 5m I1113 21:23:16.811] error: no matching resources found I1113 21:23:16.812] make[1]: *** [Makefile:75: install-helm] Error 1 I1113 21:23:16.812] make[1]: Leaving directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1113 21:23:16.813] Nov 13 21:23:13.179: INFO: The --provider flag is not set. Continuing as if --provider=skeleton had been used. I1113 21:23:16.813] Failure [3.634 seconds] I1113 21:23:16.813] [BeforeSuite] BeforeSuite I1113 21:23:16.813] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:44 I1113 21:23:16.813] I1113 21:23:16.813] Unexpected error: I1113 21:23:16.814] <*exec.ExitError | 0xc000b40420>: { I1113 21:23:16.814] ProcessState: { I1113 21:23:16.814] pid: 25813, I1113 21:23:16.814] status: 512, I1113 21:23:16.814] rusage: { I1113 21:23:16.814] Utime: {Sec: 0, Usec: 692862}, I1113 21:23:16.814] Stime: {Sec: 0, Usec: 288834}, I1113 21:23:16.815] Maxrss: 45700, I1113 21:23:16.815] Ixrss: 0, I1113 21:23:16.815] Idrss: 0, I1113 21:23:16.815] Isrss: 0, I1113 21:23:16.815] Minflt: 6426, I1113 21:23:16.815] Majflt: 77, I1113 21:23:16.815] Nswap: 0, I1113 21:23:16.816] Inblock: 19320, I1113 21:23:16.816] Oublock: 286536, I1113 21:23:16.816] Msgsnd: 0, I1113 21:23:16.816] Msgrcv: 0, I1113 21:23:16.816] Nsignals: 0, I1113 21:23:16.816] Nvcsw: 2688, I1113 21:23:16.816] Nivcsw: 186, I1113 21:23:16.817] }, I1113 21:23:16.817] }, I1113 21:23:16.817] Stderr: nil, I1113 21:23:16.817] } I1113 21:23:16.817] exit status 2 I1113 21:23:16.817] occurred I1113 21:23:16.817] I1113 21:23:16.818] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:92 I1113 21:23:16.818] ------------------------------ I1113 21:23:16.818] 2019/11/13 21:23:16 Uninstalling Azure Disk CSI Driver... I1113 21:23:16.818] make[1]: Entering directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1113 21:23:16.818] helm delete --purge azuredisk-csi-driver I1113 21:23:16.916] Error: could not find tiller I1113 21:23:16.917] make[1]: *** [Makefile:80: e2e-teardown] Error 1 I1113 21:23:16.918] make[1]: Leaving directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1113 21:23:16.918] Failure [0.105 seconds] I1113 21:23:16.918] [AfterSuite] AfterSuite I1113 21:23:16.918] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:104 I1113 21:23:16.919] I1113 21:23:16.919] Unexpected error: I1113 21:23:16.919] <*exec.ExitError | 0xc000594d00>: { I1113 21:23:16.919] ProcessState: { I1113 21:23:16.919] pid: 25858, I1113 21:23:16.919] status: 512, I1113 21:23:16.919] rusage: { I1113 21:23:16.919] Utime: {Sec: 0, Usec: 83813}, I1113 21:23:16.919] Stime: {Sec: 0, Usec: 29382}, I1113 21:23:16.920] Maxrss: 45700, I1113 21:23:16.920] Ixrss: 0, I1113 21:23:16.920] Idrss: 0, I1113 21:23:16.920] Isrss: 0, I1113 21:23:16.920] Minflt: 3980, I1113 21:23:16.920] Majflt: 0, I1113 21:23:16.920] Nswap: 0, I1113 21:23:16.920] Inblock: 0, I1113 21:23:16.921] Oublock: 0, I1113 21:23:16.921] Msgsnd: 0, I1113 21:23:16.921] Msgrcv: 0, I1113 21:23:16.921] Nsignals: 0, I1113 21:23:16.921] Nvcsw: 646, I1113 21:23:16.921] Nivcsw: 12, I1113 21:23:16.921] }, I1113 21:23:16.921] }, I1113 21:23:16.921] Stderr: nil, I1113 21:23:16.922] } I1113 21:23:16.922] exit status 2 I1113 21:23:16.922] occurred I1113 21:23:16.922] I1113 21:23:16.922] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:123 I1113 21:23:16.922] ------------------------------ I1113 21:23:16.922] I1113 21:23:16.922] Ran 9 of 0 Specs in 3.740 seconds I1113 21:23:16.922] FAIL! -- 0 Passed | 9 Failed | 0 Pending | 0 Skipped I1113 21:23:16.923] --- FAIL: TestE2E (3.74s) I1113 21:23:16.923] FAIL I1113 21:23:16.923] FAIL sigs.k8s.io/azuredisk-csi-driver/test/e2e 3.786s I1113 21:23:16.926] FAIL W1113 21:23:17.775] make: *** [Makefile:59: e2e-test] Error 1 W1113 21:23:17.776] 2019/11/13 21:23:17 process.go:155: Step 'make e2e-test' finished in 49.770325744s W1113 21:23:17.776] 2019/11/13 21:23:17 azure.go:922: Skippng DumpClusterLogs due to CCM not being enabled. W1113 21:23:17.776] 2019/11/13 21:23:17 azure.go:916: Deleting resource group: kubetest-9f7bc491-0659-11ea-af4e-0242b89a0000. W1113 21:30:03.338] 2019/11/13 21:30:03 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W1113 21:30:03.339] 2019/11/13 21:30:03 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}" W1113 21:30:03.981] 2019/11/13 21:30:03 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 642.51012ms W1113 21:30:03.981] 2019/11/13 21:30:03 main.go:319: Something went wrong: encountered 1 errors: [error during make e2e-test: exit status 2] W1113 21:30:03.983] Traceback (most recent call last): W1113 21:30:03.983] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in W1113 21:30:03.984] main(parse_args()) W1113 21:30:03.984] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main W1113 21:30:03.984] mode.start(runner_args) W1113 21:30:03.984] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start W1113 21:30:03.984] check_env(env, self.command, *args) W1113 21:30:03.984] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W1113 21:30:03.985] subprocess.check_call(cmd, env=env) W1113 21:30:03.985] File "/usr/lib/python2.7/subprocess.py", line 190, in check_call W1113 21:30:03.985] raise CalledProcessError(retcode, cmd) W1113 21:30:03.985] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=host-go', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=1', '--acsengine-agentpoolcount=2', '--acsengine-admin-username=azureuser', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.16', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_DS2_v2', '--acsengine-hyperkube=True', '--acsengine-location=westus2', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://raw.githubusercontent.com/Azure/aks-engine/master/examples/kubernetes.json', '--acsengine-download-url=https://chuwontest.blob.core.windows.net/aks-engine/aks-engine-8cf7c2a74-linux-amd64.tar.gz', '--test-azure-disk-csi-driver=True', '--timeout=420m')' returned non-zero exit status 1 E1113 21:30:03.991] Command failed I1113 21:30:03.991] process 684 exited with code 1 after 22.4m E1113 21:30:03.991] FAIL: chewong-pull-in-tree-azure-disk-e2e I1113 21:30:03.991] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1113 21:30:04.710] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I1113 21:30:04.740] process 25906 exited with code 0 after 0.0m I1113 21:30:04.741] Call: gcloud config get-value account I1113 21:30:04.960] process 25918 exited with code 0 after 0.0m I1113 21:30:04.960] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I1113 21:30:04.960] Upload result and artifacts... I1113 21:30:04.960] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/188/chewong-pull-in-tree-azure-disk-e2e/1194723159232745472 I1113 21:30:04.961] Call: gsutil ls gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/188/chewong-pull-in-tree-azure-disk-e2e/1194723159232745472/artifacts W1113 21:30:06.003] CommandException: One or more URLs matched no objects. E1113 21:30:06.081] Command failed I1113 21:30:06.081] process 25930 exited with code 1 after 0.0m W1113 21:30:06.081] Remote dir gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/188/chewong-pull-in-tree-azure-disk-e2e/1194723159232745472/artifacts not exist yet I1113 21:30:06.081] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/188/chewong-pull-in-tree-azure-disk-e2e/1194723159232745472/artifacts I1113 21:30:07.573] process 26074 exited with code 0 after 0.0m I1113 21:30:07.573] Call: git rev-parse HEAD I1113 21:30:07.576] process 26603 exited with code 0 after 0.0m I1113 21:30:07.577] Call: git rev-parse HEAD I1113 21:30:07.580] process 26604 exited with code 0 after 0.0m I1113 21:30:07.581] Call: gsutil stat gs://kubernetes-upstream/pr-logs/directory/chewong-pull-in-tree-azure-disk-e2e/jobResultsCache.json I1113 21:30:08.342] process 26605 exited with code 0 after 0.0m I1113 21:30:08.343] Call: gsutil -q cat 'gs://kubernetes-upstream/pr-logs/directory/chewong-pull-in-tree-azure-disk-e2e/jobResultsCache.json#1573673500352155' I1113 21:30:09.325] process 26749 exited with code 0 after 0.0m I1113 21:30:09.326] Call: gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1573673500352155 cp /tmp/gsutil_0WFLJh gs://kubernetes-upstream/pr-logs/directory/chewong-pull-in-tree-azure-disk-e2e/jobResultsCache.json I1113 21:30:10.424] process 26895 exited with code 0 after 0.0m I1113 21:30:10.425] Call: gsutil stat gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/188/chewong-pull-in-tree-azure-disk-e2e/jobResultsCache.json I1113 21:30:11.187] process 27075 exited with code 0 after 0.0m I1113 21:30:11.187] Call: gsutil -q cat 'gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/188/chewong-pull-in-tree-azure-disk-e2e/jobResultsCache.json#1573673502224952' I1113 21:30:12.262] process 27219 exited with code 0 after 0.0m I1113 21:30:12.262] Call: gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1573673502224952 cp /tmp/gsutil_T0S5SV gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/188/chewong-pull-in-tree-azure-disk-e2e/jobResultsCache.json I1113 21:30:13.513] process 27365 exited with code 0 after 0.0m I1113 21:30:13.514] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_1crK_b gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/188/chewong-pull-in-tree-azure-disk-e2e/1194723159232745472/finished.json I1113 21:30:14.719] process 27545 exited with code 0 after 0.0m I1113 21:30:14.720] Call: gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_jNnCJX gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/188/chewong-pull-in-tree-azure-disk-e2e/latest-build.txt I1113 21:30:15.872] process 27725 exited with code 0 after 0.0m I1113 21:30:15.873] Call: gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_y5oXNf gs://kubernetes-upstream/pr-logs/directory/chewong-pull-in-tree-azure-disk-e2e/latest-build.txt I1113 21:30:17.095] process 27905 exited with code 0 after 0.0m