W1104 23:57:27.513] ************************************************************************** bootstrap.py is deprecated! test-infra oncall does not support any job still using bootstrap.py. Please migrate your job to podutils! https://github.com/kubernetes/test-infra/blob/master/prow/pod-utilities.md ************************************************************************** I1104 23:57:27.513] Args: --job=chewong-pull-azuredisk-csi-driver-e2e-multi-az --service-account=/etc/service-account/service-account.json --upload=gs://kubernetes-jenkins/logs --job=chewong-pull-azuredisk-csi-driver-e2e-multi-az --root=/go/src --service-account=/etc/service-account/service-account.json --repo=k8s.io/kubernetes=master --repo=sigs.k8s.io/azuredisk-csi-driver=master:b7c03af8eae7388e84115ace30cf2ff3285b0dc9,180:dbf2ba05476df3f4c50de82e8d2f2a5264329cb5 --upload=gs://kubernetes-upstream/pr-logs --timeout=460 --scenario=kubernetes_e2e -- --gce-ssh= --test=true --up=true --down=true --deployment=acsengine --build=bazel --provider=skeleton --ginkgo-parallel=1 --acsengine-agentpoolcount=2 --acsengine-admin-username=azureuser '--acsengine-creds=$AZURE_CREDENTIALS' --acsengine-orchestratorRelease=1.16 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_D4s_v3 --acsengine-location=eastus2 '--acsengine-public-key=$AZURE_SSH_PUBLIC_KEY_FILE' --acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux-vmss-multi-zones.json --acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz --test-azure-disk-csi-driver=True '--test_args=--ginkgo.focus=\[multi-az\]' --timeout=420m I1104 23:57:27.513] Bootstrap chewong-pull-azuredisk-csi-driver-e2e-multi-az... I1104 23:57:27.516] Builder: c307ff45-ff5e-11e9-918b-16773c0c7aed I1104 23:57:27.517] Image: gcr.io/k8s-testimages/kubekins-e2e:v20191103-6816af1-master I1104 23:57:27.517] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191504701992996864 I1104 23:57:27.517] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1104 23:57:28.022] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I1104 23:57:28.053] process 195 exited with code 0 after 0.0m I1104 23:57:28.053] Call: gcloud config get-value account I1104 23:57:28.298] process 207 exited with code 0 after 0.0m I1104 23:57:28.299] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I1104 23:57:28.299] Root: /go/src I1104 23:57:28.299] cd to /go/src I1104 23:57:28.299] Checkout: /go/src/k8s.io/kubernetes master to /go/src/k8s.io/kubernetes I1104 23:57:28.299] Call: git init k8s.io/kubernetes I1104 23:57:28.303] Initialized empty Git repository in /go/src/k8s.io/kubernetes/.git/ I1104 23:57:28.303] process 219 exited with code 0 after 0.0m I1104 23:57:28.304] Call: git config --local user.name 'K8S Bootstrap' I1104 23:57:28.306] process 220 exited with code 0 after 0.0m I1104 23:57:28.306] Call: git config --local user.email k8s_bootstrap@localhost I1104 23:57:28.309] process 221 exited with code 0 after 0.0m I1104 23:57:28.309] Call: git fetch --quiet --tags https://github.com/kubernetes/kubernetes master I1104 23:58:27.061] process 222 exited with code 0 after 1.0m I1104 23:58:27.061] Call: git checkout -B test FETCH_HEAD W1104 23:58:29.308] Switched to a new branch 'test' I1104 23:58:29.316] process 234 exited with code 0 after 0.0m I1104 23:58:29.316] Call: git show -s --format=format:%ct HEAD I1104 23:58:29.333] process 235 exited with code 0 after 0.0m I1104 23:58:29.333] Checkout: /go/src/sigs.k8s.io/azuredisk-csi-driver master:b7c03af8eae7388e84115ace30cf2ff3285b0dc9,180:dbf2ba05476df3f4c50de82e8d2f2a5264329cb5 to /go/src/sigs.k8s.io/azuredisk-csi-driver I1104 23:58:29.333] Call: git init sigs.k8s.io/azuredisk-csi-driver I1104 23:58:29.337] Initialized empty Git repository in /go/src/sigs.k8s.io/azuredisk-csi-driver/.git/ I1104 23:58:29.337] process 236 exited with code 0 after 0.0m I1104 23:58:29.337] Call: git config --local user.name 'K8S Bootstrap' I1104 23:58:29.340] process 237 exited with code 0 after 0.0m I1104 23:58:29.340] Call: git config --local user.email k8s_bootstrap@localhost I1104 23:58:29.342] process 238 exited with code 0 after 0.0m I1104 23:58:29.342] Call: git fetch --quiet --tags https://github.com/kubernetes-sigs/azuredisk-csi-driver master +refs/pull/180/head:refs/pr/180 I1104 23:58:35.852] process 239 exited with code 0 after 0.1m I1104 23:58:35.853] Call: git checkout -B test b7c03af8eae7388e84115ace30cf2ff3285b0dc9 W1104 23:58:36.412] Switched to a new branch 'test' I1104 23:58:36.414] process 250 exited with code 0 after 0.0m I1104 23:58:36.415] Call: git show -s --format=format:%ct HEAD I1104 23:58:36.417] process 251 exited with code 0 after 0.0m I1104 23:58:36.418] Call: git merge --no-ff -m 'Merge +refs/pull/180/head:refs/pr/180' dbf2ba05476df3f4c50de82e8d2f2a5264329cb5 I1104 23:58:37.218] Merge made by the 'recursive' strategy. I1104 23:58:37.222] .../templates/csi-azuredisk-controller.yaml | 5 +- I1104 23:58:37.222] deploy/csi-azuredisk-controller.yaml | 3 +- I1104 23:58:37.222] .../storageclass-azuredisk-csi-topology.yaml | 17 +++ I1104 23:58:37.222] pkg/azuredisk/azuredisk.go | 1 + I1104 23:58:37.222] pkg/azuredisk/identityserver.go | 7 ++ I1104 23:58:37.222] pkg/azuredisk/nodeserver.go | 23 +++- I1104 23:58:37.222] test/e2e/driver/azuredisk_csi_driver.go | 19 ++- I1104 23:58:37.222] test/e2e/dynamic_provisioning.go | 134 +++++++++++++++------ I1104 23:58:37.223] test/e2e/testsuites/testsuites.go | 8 ++ I1104 23:58:37.223] 9 files changed, 170 insertions(+), 47 deletions(-) I1104 23:58:37.223] create mode 100644 deploy/example/storageclass-azuredisk-csi-topology.yaml I1104 23:58:37.223] process 252 exited with code 0 after 0.0m I1104 23:58:37.223] Configure environment... I1104 23:58:37.223] Call: git show -s --format=format:%ct HEAD I1104 23:58:37.241] process 268 exited with code 0 after 0.0m I1104 23:58:37.241] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1104 23:58:37.968] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I1104 23:58:38.123] process 269 exited with code 0 after 0.0m I1104 23:58:38.124] Call: gcloud config get-value account I1104 23:58:38.357] process 281 exited with code 0 after 0.0m I1104 23:58:38.358] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I1104 23:58:38.358] Call: bash -c ' set -o errexit set -o nounset export KUBE_ROOT=. source hack/lib/version.sh kube::version::get_version_vars echo $KUBE_GIT_VERSION ' I1104 23:58:38.797] process 293 exited with code 0 after 0.0m I1104 23:58:38.797] Start 1191504701992996864 at v1.18.0-alpha.0.230+b735a17163ac7c... I1104 23:58:38.799] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_XTn0QO gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191504701992996864/started.json I1104 23:58:40.167] process 326 exited with code 0 after 0.0m I1104 23:58:40.168] Call: gsutil -q -h Content-Type:text/plain -h 'x-goog-meta-link: gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191504701992996864' cp /tmp/gsutil_Sak6CZ gs://kubernetes-upstream/pr-logs/directory/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191504701992996864.txt I1104 23:58:41.268] process 506 exited with code 0 after 0.0m I1104 23:58:41.269] Call: /workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py --gce-ssh= --test=true --up=true --down=true --deployment=acsengine --build=bazel --provider=skeleton --ginkgo-parallel=1 --acsengine-agentpoolcount=2 --acsengine-admin-username=azureuser --acsengine-creds=/etc/azure-cred/credentials --acsengine-orchestratorRelease=1.16 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_D4s_v3 --acsengine-location=eastus2 --acsengine-public-key=/etc/azure-ssh/azure-ssh-pub --acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux-vmss-multi-zones.json --acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz --test-azure-disk-csi-driver=True '--test_args=--ginkgo.focus=\[multi-az\]' --timeout=420m W1104 23:58:41.305] starts with local mode W1104 23:58:41.305] Environment: W1104 23:58:41.305] ARTIFACTS=/workspace/_artifacts W1104 23:58:41.306] AWS_SSH_PRIVATE_KEY_FILE=/root/.ssh/kube_aws_rsa W1104 23:58:41.306] AWS_SSH_PUBLIC_KEY_FILE=/root/.ssh/kube_aws_rsa.pub W1104 23:58:41.306] AZURE_CREDENTIALS=/etc/azure-cred/credentials W1104 23:58:41.306] AZURE_SSH_PUBLIC_KEY_FILE=/etc/azure-ssh/azure-ssh-pub W1104 23:58:41.306] AZ_STORAGE_CONTAINER_NAME=mystoragecontainer W1104 23:58:41.306] BAZEL_REMOTE_CACHE_ENABLED=false W1104 23:58:41.306] BAZEL_VERSION=0.23.2 W1104 23:58:41.307] BOOTSTRAP_MIGRATION=yes W1104 23:58:41.307] BUILD_ID=1191504701992996864 W1104 23:58:41.307] BUILD_NUMBER=1191504701992996864 W1104 23:58:41.307] CLOUDSDK_COMPONENT_MANAGER_DISABLE_UPDATE_CHECK=true W1104 23:58:41.307] CLOUDSDK_CONFIG=/go/src/k8s.io/kubernetes/.config/gcloud W1104 23:58:41.307] CLOUDSDK_CORE_DISABLE_PROMPTS=1 W1104 23:58:41.307] CLOUDSDK_EXPERIMENTAL_FAST_COMPONENT_UPDATE=false W1104 23:58:41.308] CLOUD_CONFIG=random W1104 23:58:41.308] DECK_PORT=tcp://10.0.160.83:80 W1104 23:58:41.308] DECK_PORT_80_TCP=tcp://10.0.160.83:80 W1104 23:58:41.308] DECK_PORT_80_TCP_ADDR=10.0.160.83 W1104 23:58:41.308] DECK_PORT_80_TCP_PORT=80 W1104 23:58:41.308] DECK_PORT_80_TCP_PROTO=tcp W1104 23:58:41.308] DECK_SERVICE_HOST=10.0.160.83 W1104 23:58:41.309] DECK_SERVICE_PORT=80 W1104 23:58:41.309] DOCKER_IN_DOCKER_ENABLED=true W1104 23:58:41.309] DOCKER_IN_DOCKER_IPV6_ENABLED=false W1104 23:58:41.309] GCS_ARTIFACTS_DIR=gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191504701992996864/artifacts W1104 23:58:41.309] GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json W1104 23:58:41.310] GOPATH=/go W1104 23:58:41.310] GO_TARBALL=go1.12.12.linux-amd64.tar.gz W1104 23:58:41.310] HOME=/workspace W1104 23:58:41.310] HOOK_PORT=tcp://10.0.144.133:8888 W1104 23:58:41.310] HOOK_PORT_8888_TCP=tcp://10.0.144.133:8888 W1104 23:58:41.310] HOOK_PORT_8888_TCP_ADDR=10.0.144.133 W1104 23:58:41.311] HOOK_PORT_8888_TCP_PORT=8888 W1104 23:58:41.311] HOOK_PORT_8888_TCP_PROTO=tcp W1104 23:58:41.311] HOOK_SERVICE_HOST=10.0.144.133 W1104 23:58:41.311] HOOK_SERVICE_PORT=8888 W1104 23:58:41.311] HOSTNAME=c307ff45-ff5e-11e9-918b-16773c0c7aed W1104 23:58:41.311] IMAGE=gcr.io/k8s-testimages/kubekins-e2e:v20191103-6816af1-master W1104 23:58:41.312] INSTANCE_PREFIX=bootstrap-e2e W1104 23:58:41.312] JENKINS_GCE_SSH_PRIVATE_KEY_FILE=/root/.ssh/google_compute_engine W1104 23:58:41.312] JENKINS_GCE_SSH_PUBLIC_KEY_FILE=/root/.ssh/google_compute_engine.pub W1104 23:58:41.312] JOB_NAME=chewong-pull-azuredisk-csi-driver-e2e-multi-az W1104 23:58:41.313] JOB_SPEC={"type":"presubmit","job":"chewong-pull-azuredisk-csi-driver-e2e-multi-az","buildid":"1191504701992996864","prowjobid":"c307ff45-ff5e-11e9-918b-16773c0c7aed","refs":{"org":"Azure","repo":"kubernetes","repo_link":"https://github.com/Azure/kubernetes","base_ref":"master","base_sha":"077f825c584903eeb5854040192c2977079343e9","base_link":"https://github.com/Azure/kubernetes/commit/077f825c584903eeb5854040192c2977079343e9","pulls":[{"number":113,"author":"chewong","sha":"879465972041635fd7bc8269da49153b67e63822","link":"https://github.com/Azure/kubernetes/pull/113","commit_link":"https://github.com/Azure/kubernetes/pull/113/commits/879465972041635fd7bc8269da49153b67e63822","author_link":"https://github.com/chewong"}]}} W1104 23:58:41.313] JOB_TYPE=presubmit W1104 23:58:41.313] KUBERNETES_PORT=tcp://10.0.0.1:443 W1104 23:58:41.313] KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443 W1104 23:58:41.314] KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1 W1104 23:58:41.314] KUBERNETES_PORT_443_TCP_PORT=443 W1104 23:58:41.314] KUBERNETES_PORT_443_TCP_PROTO=tcp W1104 23:58:41.314] KUBERNETES_SERVICE_HOST=10.0.0.1 W1104 23:58:41.314] KUBERNETES_SERVICE_PORT=443 W1104 23:58:41.315] KUBERNETES_SERVICE_PORT_HTTPS=443 W1104 23:58:41.315] KUBETEST_IN_DOCKER=true W1104 23:58:41.315] KUBETEST_MANUAL_DUMP=y W1104 23:58:41.315] KUBE_AWS_INSTANCE_PREFIX=bootstrap-e2e W1104 23:58:41.315] KUBE_GCE_INSTANCE_PREFIX=bootstrap-e2e W1104 23:58:41.315] KUBE_SSH_KEY_PATH=/etc/ssh-key-secret/ssh-private W1104 23:58:41.316] KUBE_SSH_PUBLIC_KEY_PATH=/etc/ssh-key-secret/ssh-public W1104 23:58:41.316] KUBE_SSH_USER=azureuser W1104 23:58:41.316] KUBE_VERBOSE=0 W1104 23:58:41.316] NODE_NAME=c307ff45-ff5e-11e9-918b-16773c0c7aed W1104 23:58:41.316] PATH=/go/bin:/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/workspace:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin W1104 23:58:41.317] PROW_JOB_ID=c307ff45-ff5e-11e9-918b-16773c0c7aed W1104 23:58:41.317] PULL_BASE_REF=master W1104 23:58:41.317] PULL_BASE_SHA=077f825c584903eeb5854040192c2977079343e9 W1104 23:58:41.317] PULL_NUMBER=113 W1104 23:58:41.317] PULL_PULL_SHA=879465972041635fd7bc8269da49153b67e63822 W1104 23:58:41.317] PULL_REFS=master:077f825c584903eeb5854040192c2977079343e9,113:879465972041635fd7bc8269da49153b67e63822 W1104 23:58:41.318] PWD=/workspace W1104 23:58:41.318] REGISTRY=k8sprowinternal.azurecr.io W1104 23:58:41.318] REPO_NAME=kubernetes W1104 23:58:41.318] REPO_OWNER=Azure W1104 23:58:41.318] SHLVL=2 W1104 23:58:41.319] SOURCE_DATE_EPOCH=1572910143 W1104 23:58:41.319] TERM=xterm W1104 23:58:41.319] TIDE_PORT=tcp://10.0.180.53:80 W1104 23:58:41.319] TIDE_PORT_80_TCP=tcp://10.0.180.53:80 W1104 23:58:41.319] TIDE_PORT_80_TCP_ADDR=10.0.180.53 W1104 23:58:41.319] TIDE_PORT_80_TCP_PORT=80 W1104 23:58:41.320] TIDE_PORT_80_TCP_PROTO=tcp W1104 23:58:41.320] TIDE_SERVICE_HOST=10.0.180.53 W1104 23:58:41.320] TIDE_SERVICE_PORT=80 W1104 23:58:41.320] WORKSPACE=/workspace W1104 23:58:41.320] _=./test-infra/jenkins/bootstrap.py W1104 23:58:41.321] Run: ('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=1', '--acsengine-agentpoolcount=2', '--acsengine-admin-username=azureuser', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.16', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_D4s_v3', '--acsengine-location=eastus2', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux-vmss-multi-zones.json', '--acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz', '--test-azure-disk-csi-driver=True', '--test_args=--ginkgo.focus=\\[multi-az\\]', '--timeout=420m') W1104 23:58:41.324] 2019/11/04 23:58:41 main.go:332: Limiting testing to 7h0m0s W1104 23:58:41.324] 2019/11/04 23:58:41 azure.go:232: Reading credentials file /etc/azure-cred/credentials W1104 23:58:41.325] 2019/11/04 23:58:41 process.go:153: Running: make -C /go/src/k8s.io/kubernetes bazel-release W1104 23:58:41.338] Extracting Bazel installation... I1104 23:58:41.438] make: Entering directory '/go/src/k8s.io/kubernetes' W1104 23:58:49.560] Starting local Bazel server and connecting to it... W1104 23:58:51.511] Loading: W1104 23:58:51.515] Loading: 0 packages loaded W1104 23:58:52.517] Loading: 0 packages loaded W1104 23:58:54.165] Loading: 0 packages loaded W1104 23:58:55.519] Loading: 0 packages loaded W1104 23:58:57.414] Loading: 0 packages loaded W1104 23:58:58.519] Loading: 0 packages loaded W1104 23:58:58.519] currently loading: build/release-tars W1104 23:59:00.649] Loading: 0 packages loaded W1104 23:59:00.649] currently loading: build/release-tars W1104 23:59:01.038] Analyzing: target //build/release-tars:release-tars (1 packages loaded, 0 targets configured) W1104 23:59:02.498] Analyzing: target //build/release-tars:release-tars (187 packages loaded, 1039 targets configured) W1104 23:59:04.172] Analyzing: target //build/release-tars:release-tars (1051 packages loaded, 3904 targets configured) W1104 23:59:06.115] Analyzing: target //build/release-tars:release-tars (1896 packages loaded, 11206 targets configured) W1104 23:59:08.334] Analyzing: target //build/release-tars:release-tars (2670 packages loaded, 22650 targets configured) W1104 23:59:11.569] Analyzing: target //build/release-tars:release-tars (3059 packages loaded, 27353 targets configured) W1104 23:59:14.608] Analyzing: target //build/release-tars:release-tars (3094 packages loaded, 34014 targets configured) W1104 23:59:18.771] Analyzing: target //build/release-tars:release-tars (3103 packages loaded, 34718 targets configured) W1104 23:59:25.250] Analyzing: target //build/release-tars:release-tars (3104 packages loaded, 36746 targets configured) W1104 23:59:27.379] INFO: Analysed target //build/release-tars:release-tars (3104 packages loaded, 36836 targets configured). W1104 23:59:27.381] INFO: Found 1 target... W1104 23:59:27.558] [0 / 20] [-----] BazelWorkspaceStatusAction stable-status.txt W1104 23:59:33.069] [85 / 4,429] GUNZIP external/debian-iptables-amd64/image/000.tar.gz.nogz; 1s linux-sandbox ... (8 actions, 7 running) W1104 23:59:42.037] [161 / 4,429] GoCompilePkg vendor/github.com/elazarl/goproxy/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/elazarl/goproxy.a; 4s linux-sandbox ... (8 actions running) W1104 23:59:50.894] [224 / 4,429] GoCompilePkg vendor/gonum.org/v1/gonum/internal/asm/f64/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/gonum.org/v1/gonum/internal/asm/f64.a; 2s linux-sandbox ... (8 actions, 7 running) W1105 00:00:00.538] [277 / 4,429] GoCompilePkg vendor/gonum.org/v1/gonum/graph/internal/set/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/gonum.org/v1/gonum/graph/internal/set.a; 6s linux-sandbox ... (8 actions, 7 running) W1105 00:00:11.144] [325 / 4,429] GoStdlib external/io_bazel_rules_go/linux_amd64_pure_stripped/stdlib%/pkg; 9s linux-sandbox ... (8 actions, 7 running) W1105 00:00:25.582] [387 / 4,429] GoStdlib external/io_bazel_rules_go/linux_amd64_pure_stripped/stdlib%/pkg; 24s linux-sandbox ... (8 actions, 7 running) W1105 00:00:39.890] [464 / 4,429] GoStdlib external/io_bazel_rules_go/linux_amd64_pure_stripped/stdlib%/pkg; 38s linux-sandbox ... (6 actions, 5 running) W1105 00:00:57.617] [560 / 4,429] GoStdlib external/io_bazel_rules_go/linux_amd64_pure_stripped/stdlib%/pkg; 56s linux-sandbox ... (8 actions, 7 running) W1105 00:01:17.670] [685 / 4,429] GoCompilePkg vendor/github.com/aws/aws-sdk-go/service/ec2/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/aws/aws-sdk-go/service/ec2.a; 7s linux-sandbox ... (8 actions, 7 running) W1105 00:01:39.724] [865 / 4,429] GoCompilePkg staging/src/k8s.io/apimachinery/pkg/conversion/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/conversion.a; 2s linux-sandbox ... (8 actions, 7 running) W1105 00:02:05.120] [1,057 / 4,429] GoCompilePkg vendor/github.com/golang/protobuf/protoc-gen-go/descriptor/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/golang/protobuf/protoc-gen-go/descriptor.a; 3s linux-sandbox ... (8 actions running) W1105 00:02:34.235] [1,318 / 4,429] GoCompilePkg staging/src/k8s.io/cri-api/pkg/apis/runtime/v1alpha2/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1alpha2.a; 4s linux-sandbox ... (8 actions, 7 running) W1105 00:03:07.919] [1,532 / 4,429] GoCompilePkg vendor/github.com/Azure/azure-sdk-for-go/services/network/mgmt/2019-06-01/network/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/Azure/azure-sdk-for-go/services/network/mgmt/2019-06-01/network.a; 16s linux-sandbox ... (8 actions running) W1105 00:03:46.484] [1,766 / 4,429] GoCompilePkg vendor/github.com/GoogleCloudPlatform/k8s-cloud-provider/pkg/cloud/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/GoogleCloudPlatform/k8s-cloud-provider/pkg/cloud.a; 10s linux-sandbox ... (8 actions, 7 running) W1105 00:04:39.752] [1,877 / 4,429] ; 42s linux-sandbox ... (8 actions running) W1105 00:05:32.867] [2,063 / 4,429] PackageTar build/release-tars/kubernetes-src.tar.gz; 28s linux-sandbox ... (8 actions, 7 running) W1105 00:06:33.819] [2,597 / 4,429] GoCompilePkg staging/src/k8s.io/client-go/kubernetes/typed/storage/v1beta1/fake/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/client-go/kubernetes/typed/storage/v1beta1/fake.a; 1s linux-sandbox ... (8 actions, 7 running) W1105 00:07:44.623] [3,016 / 4,429] GoCompilePkg pkg/volume/gcepd/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/pkg/volume/gcepd.a; 2s linux-sandbox ... (8 actions, 7 running) W1105 00:09:05.608] [3,490 / 4,429] GoCompilePkg plugin/pkg/admission/priority/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/plugin/pkg/admission/priority.a; 1s linux-sandbox ... (8 actions, 7 running) W1105 00:10:37.758] [3,912 / 4,429] GoCompilePkg staging/src/k8s.io/client-go/informers/storage/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/client-go/informers/storage.a; 2s linux-sandbox ... (8 actions, 7 running) W1105 00:12:24.364] [4,284 / 4,429] GoLink cmd/kube-scheduler/linux_amd64_pure_stripped/kube-scheduler; 20s linux-sandbox ... (8 actions, 7 running) W1105 00:14:26.365] [4,402 / 4,429] GoLink cmd/kubemark/kubemark; 79s linux-sandbox ... (8 actions running) W1105 00:14:36.513] Slow read: a 304908-byte read from /workspace/.cache/bazel/_bazel_root/48d5366022b4e3197674c8d6e2bee219/execroot/io_k8s_kubernetes/bazel-out/k8-fastbuild/bin/test/e2e_node/services/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/test/e2e_node/services.a took 21317 ms. W1105 00:15:58.635] Slow read: a 281570532-byte read from /workspace/.cache/bazel/_bazel_root/48d5366022b4e3197674c8d6e2bee219/execroot/io_k8s_kubernetes/bazel-out/k8-fastbuild/bin/test/e2e_node/linux_amd64_stripped/_go_default_test-cgo took 29081 ms. W1105 00:16:27.375] Target //build/release-tars:release-tars up-to-date: W1105 00:16:27.419] bazel-bin/build/release-tars/kubernetes-client-linux-amd64.tar.gz W1105 00:16:27.420] bazel-bin/build/release-tars/kubernetes-node-linux-amd64.tar.gz W1105 00:16:27.420] bazel-bin/build/release-tars/kubernetes-server-linux-amd64.tar.gz W1105 00:16:27.421] bazel-bin/build/release-tars/kubernetes-manifests.tar.gz W1105 00:16:27.421] bazel-bin/build/release-tars/kubernetes-test-portable.tar.gz W1105 00:16:27.422] bazel-bin/build/release-tars/kubernetes-test-linux-amd64.tar.gz W1105 00:16:27.422] bazel-bin/build/release-tars/kubernetes.tar.gz W1105 00:16:27.422] bazel-bin/build/release-tars/kubernetes-src.tar.gz W1105 00:16:27.463] INFO: Elapsed time: 1066.064s, Critical Path: 348.80s W1105 00:16:27.464] INFO: 4364 processes: 4364 linux-sandbox. W1105 00:16:27.470] INFO: Build completed successfully, 4429 total actions W1105 00:16:27.472] INFO: Build completed successfully, 4429 total actions W1105 00:16:27.480] 2019/11/05 00:16:27 process.go:155: Step 'make -C /go/src/k8s.io/kubernetes bazel-release' finished in 17m46.155629296s W1105 00:16:27.480] 2019/11/05 00:16:27 util.go:277: Flushing memory. I1105 00:16:27.581] make: Leaving directory '/go/src/k8s.io/kubernetes' W1105 00:17:14.364] 2019/11/05 00:17:14 azure.go:906: Deleting resource group: kubetest-06d70b8a-ff5f-11e9-be38-0242ff015fe9. W1105 00:17:15.060] 2019/11/05 00:17:15 azure.go:787: downloading /workspace/aks698357945/kubernetes.json from https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux-vmss-multi-zones.json. W1105 00:17:15.061] 2019/11/05 00:17:15 util.go:42: curl https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux-vmss-multi-zones.json W1105 00:17:15.434] 2019/11/05 00:17:15 azure.go:529: downloading /workspace/aks-engine.tar.gz from https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz. W1105 00:17:15.434] 2019/11/05 00:17:15 util.go:42: curl https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz W1105 00:17:16.789] 2019/11/05 00:17:16 azure.go:556: Extracting tar file /workspace/aks-engine.tar.gz into directory /go/src/k8s.io/kubernetes . W1105 00:17:16.789] 2019/11/05 00:17:16 process.go:153: Running: tar -xzf /workspace/aks-engine.tar.gz --strip 1 W1105 00:17:16.938] 2019/11/05 00:17:16 process.go:155: Step 'tar -xzf /workspace/aks-engine.tar.gz --strip 1' finished in 148.957347ms W1105 00:17:16.938] 2019/11/05 00:17:16 process.go:153: Running: /go/src/k8s.io/kubernetes/aks-engine generate /workspace/aks698357945/kubernetes.json --output-directory /workspace/aks698357945 I1105 00:17:17.146] INFO[0000] Generating assets into /workspace/aks698357945... W1105 00:17:32.677] 2019/11/05 00:17:32 process.go:155: Step '/go/src/k8s.io/kubernetes/aks-engine generate /workspace/aks698357945/kubernetes.json --output-directory /workspace/aks698357945' finished in 15.739701309s W1105 00:17:32.682] 2019/11/05 00:17:32 azure.go:627: Setting kubeconfig env variable: kubeconfig path: /workspace/aks698357945/kubeconfig/kubeconfig.eastus2.json. W1105 00:17:32.682] 2019/11/05 00:17:32 azure.go:629: Creating resource group: kubetest-06d70b8a-ff5f-11e9-be38-0242ff015fe9. W1105 00:17:32.682] 2019/11/05 00:17:32 azure.go:631: Creating Azure resource group: kubetest-06d70b8a-ff5f-11e9-be38-0242ff015fe9 for cluster deployment. W1105 00:17:34.036] 2019/11/05 00:17:34 azure.go:636: Validating deployment ARM templates. W1105 00:17:36.459] 2019/11/05 00:17:36 azure.go:642: Deploying cluster kubetest-06d70b8a-ff5f-11e9-be38-0242ff015fe9 in resource group kubetest-06d70b8a-ff5f-11e9-be38-0242ff015fe9. W1105 00:28:42.157] 2019/11/05 00:28:42 process.go:153: Running: ./cluster/kubectl.sh --match-server-version=false version W1105 00:28:52.826] 2019/11/05 00:28:52 process.go:155: Step './cluster/kubectl.sh --match-server-version=false version' finished in 10.666222243s W1105 00:28:52.826] 2019/11/05 00:28:52 process.go:153: Running: ./cluster/kubectl.sh --match-server-version=false get nodes -oyaml W1105 00:29:48.628] 2019/11/05 00:29:48 process.go:155: Step './cluster/kubectl.sh --match-server-version=false get nodes -oyaml' finished in 55.804168451s W1105 00:29:48.628] 2019/11/05 00:29:48 azure.go:970: KUBE_TEST_REPO_LIST_DOWNLOAD_LOCATION not set. Using default test image repos. W1105 00:29:48.628] 2019/11/05 00:29:48 azure.go:970: KUBE_TEST_REPO_LIST_DOWNLOAD_LOCATION not set. Using default test image repos. W1105 00:29:48.629] 2019/11/05 00:29:48 process.go:153: Running: kubectl get nodes --no-headers W1105 00:29:50.099] 2019/11/05 00:29:50 process.go:155: Step 'kubectl get nodes --no-headers' finished in 1.470922249s W1105 00:29:50.099] 2019/11/05 00:29:50 e2e.go:474: Cluster nodes: W1105 00:29:50.100] k8s-agentpool-26890500-vmss000000 Ready agent 3m18s v1.15.0 W1105 00:29:50.100] k8s-agentpool-26890500-vmss000001 Ready agent 3m8s v1.15.0 W1105 00:29:50.100] k8s-master-26890500-0 Ready master 2m57s v1.15.0 W1105 00:29:50.100] k8s-master-26890500-1 Ready master 114s v1.15.0 W1105 00:29:50.100] k8s-master-26890500-2 Ready master 3m17s v1.15.0 W1105 00:29:50.100] k8s-master-26890500-3 Ready master 3m19s v1.15.0 W1105 00:29:50.100] k8s-master-26890500-4 Ready master 3m17s v1.15.0 W1105 00:29:50.101] 2019/11/05 00:29:50 process.go:153: Running: ./cluster/kubectl.sh --match-server-version=false version W1105 00:29:51.790] 2019/11/05 00:29:51 process.go:155: Step './cluster/kubectl.sh --match-server-version=false version' finished in 1.690474403s W1105 00:29:51.790] 2019/11/05 00:29:51 process.go:153: Running: make e2e-test I1105 00:29:51.891] go test -v -timeout=0 ./test/e2e "-ginkgo.noColor" I1105 00:31:57.302] Nov 5 00:31:57.302: INFO: The --provider flag is not set. Continuing as if --provider=skeleton had been used. I1105 00:31:57.302] === RUN TestE2E I1105 00:31:57.303] Running Suite: AzureDisk CSI Driver End-to-End Tests I1105 00:31:57.303] ==================================================== I1105 00:31:57.303] Random Seed: 1572913917 - Will randomize all specs I1105 00:31:57.304] Will run 16 of 16 specs I1105 00:31:57.304] I1105 00:31:58.832] 2019/11/05 00:31:58 Attempting docker login with Azure service principal I1105 00:32:00.714] 2019/11/05 00:32:00 docker login is successful I1105 00:32:00.714] 2019/11/05 00:32:00 Installing Azure Disk CSI Driver... I1105 00:32:00.722] make[1]: Entering directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1105 00:32:00.731] # Use v2.11.0 helm to match tiller's version in clusters made by aks-engine I1105 00:32:00.734] curl https://raw.githubusercontent.com/helm/helm/master/scripts/get | DESIRED_VERSION=v2.11.0 bash I1105 00:32:00.805] % Total % Received % Xferd Average Speed Time Time Time Current I1105 00:32:00.806] Dload Upload Total Spent Left Speed I1105 00:32:01.142] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7034 100 7034 0 0 20997 0 --:--:-- --:--:-- --:--:-- 20934 I1105 00:32:01.302] Downloading https://get.helm.sh/helm-v2.11.0-linux-amd64.tar.gz I1105 00:32:06.221] Preparing to install helm and tiller into /usr/local/bin I1105 00:32:06.266] helm installed into /usr/local/bin/helm I1105 00:32:06.314] tiller installed into /usr/local/bin/tiller I1105 00:32:06.322] Run 'helm init' to configure helm. I1105 00:32:06.354] # Make sure tiller is ready I1105 00:32:06.358] kubectl wait pod -l name=tiller --namespace kube-system --for condition=ready --timeout 5m I1105 00:32:06.982] pod/tiller-deploy-54c96cb5df-wf2c2 condition met I1105 00:32:07.020] helm version I1105 00:32:07.120] Client: &version.Version{SemVer:"v2.11.0", GitCommit:"2e55dbe1fdb5fdb96b75ff144a339489417b146b", GitTreeState:"clean"} I1105 00:32:09.069] Server: &version.Version{SemVer:"v2.11.0", GitCommit:"2e55dbe1fdb5fdb96b75ff144a339489417b146b", GitTreeState:"clean"} I1105 00:32:09.444] # Only build and push the image if it does not exist in the registry I1105 00:32:09.444] docker pull k8sprowinternal.azurecr.io/azuredisk-csi:e2e-3e3ed045c6faa509dbd8d2890ee9f56aa2934887 || make azuredisk-container push I1105 00:32:09.869] Error response from daemon: manifest for k8sprowinternal.azurecr.io/azuredisk-csi:e2e-3e3ed045c6faa509dbd8d2890ee9f56aa2934887 not found: manifest unknown: manifest unknown I1105 00:32:09.875] make[2]: Entering directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1105 00:32:09.894] if [ ! -d ./vendor ]; then dep ensure -vendor-only; fi I1105 00:32:09.899] CGO_ENABLED=0 GOOS=linux go build -a -ldflags "-X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.driverVersion=e2e-3e3ed045c6faa509dbd8d2890ee9f56aa2934887 -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.gitCommit=3e3ed045c6faa509dbd8d2890ee9f56aa2934887 -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.buildDate=2019-11-05T00:32:09Z -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.DriverName=disk.csi.azure.com -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.topologyKey=topology.disk.csi.azure.com/zone -extldflags "-static"" -o _output/azurediskplugin ./pkg/azurediskplugin I1105 00:34:07.527] docker build --no-cache -t k8sprowinternal.azurecr.io/azuredisk-csi:e2e-3e3ed045c6faa509dbd8d2890ee9f56aa2934887 -f ./pkg/azurediskplugin/Dockerfile . I1105 00:34:16.546] Sending build context to Docker daemon 214.4MB I1105 00:34:16.606] Step 1/6 : FROM aksrepos.azurecr.io/fundamental/base-ubuntu:v0.0.5 I1105 00:34:17.293] v0.0.5: Pulling from fundamental/base-ubuntu I1105 00:34:17.293] 5667fdb72017: Pulling fs layer I1105 00:34:17.294] d83811f270d5: Pulling fs layer I1105 00:34:17.294] ee671aafb583: Pulling fs layer I1105 00:34:17.294] 7fc152dfb3a6: Pulling fs layer I1105 00:34:17.294] 7940edb1bae7: Pulling fs layer I1105 00:34:17.295] 2ac04aec52fc: Pulling fs layer I1105 00:34:17.295] 3d25cb8b687d: Pulling fs layer I1105 00:34:17.295] 7fc152dfb3a6: Waiting I1105 00:34:17.295] 2ac04aec52fc: Waiting I1105 00:34:17.295] 3d25cb8b687d: Waiting I1105 00:34:17.295] 7940edb1bae7: Waiting I1105 00:34:17.728] ee671aafb583: Verifying Checksum I1105 00:34:17.730] ee671aafb583: Download complete I1105 00:34:17.754] d83811f270d5: Verifying Checksum I1105 00:34:17.754] d83811f270d5: Download complete I1105 00:34:18.050] 7fc152dfb3a6: Verifying Checksum I1105 00:34:18.050] 7fc152dfb3a6: Download complete I1105 00:34:18.150] 7940edb1bae7: Verifying Checksum I1105 00:34:18.150] 7940edb1bae7: Download complete I1105 00:34:18.673] 5667fdb72017: Verifying Checksum I1105 00:34:18.673] 5667fdb72017: Download complete I1105 00:34:19.870] 3d25cb8b687d: Verifying Checksum I1105 00:34:19.870] 3d25cb8b687d: Download complete I1105 00:34:20.318] 2ac04aec52fc: Verifying Checksum I1105 00:34:20.318] 2ac04aec52fc: Download complete I1105 00:34:34.138] 5667fdb72017: Pull complete I1105 00:34:34.631] d83811f270d5: Pull complete I1105 00:34:52.101] ee671aafb583: Pull complete I1105 00:35:13.926] 7fc152dfb3a6: Pull complete I1105 00:35:56.786] 7940edb1bae7: Pull complete I1105 00:36:19.366] 2ac04aec52fc: Pull complete I1105 00:36:25.708] 3d25cb8b687d: Pull complete I1105 00:36:26.499] Digest: sha256:786f291c07d8b7a063d1cabd1a143a217767b34deeca1188565c46f496e50f03 I1105 00:36:28.277] Status: Downloaded newer image for aksrepos.azurecr.io/fundamental/base-ubuntu:v0.0.5 I1105 00:36:28.278] ---> 7730e8d0ed58 I1105 00:36:28.278] Step 2/6 : RUN apt-get update && apt-get install -y util-linux e2fsprogs mount ca-certificates udev xfsprogs I1105 00:37:02.190] ---> Running in 9bb37a4d0a61 I1105 00:37:11.672] Hit:1 http://azure.archive.ubuntu.com/ubuntu bionic InRelease I1105 00:37:11.672] Get:2 http://azure.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] I1105 00:37:11.676] Get:3 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] I1105 00:37:11.712] Get:4 http://azure.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] I1105 00:37:12.277] Get:5 http://azure.archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [23.2 kB] I1105 00:37:12.343] Get:6 http://azure.archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [9022 B] I1105 00:37:12.345] Get:7 http://azure.archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [995 kB] I1105 00:37:13.083] Get:8 http://azure.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1304 kB] I1105 00:37:13.122] Get:9 http://azure.archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4234 B] I1105 00:37:13.458] Get:10 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [5944 B] I1105 00:37:13.750] Get:11 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [12.6 kB] I1105 00:37:14.038] Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [782 kB] I1105 00:37:17.110] Get:13 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [700 kB] I1105 00:37:18.057] Fetched 4089 kB in 7s (586 kB/s) I1105 00:37:19.568] Reading package lists... I1105 00:37:21.238] Reading package lists... I1105 00:37:21.530] Building dependency tree... I1105 00:37:21.530] Reading state information... I1105 00:37:21.726] ca-certificates is already the newest version (20180409). I1105 00:37:21.726] e2fsprogs is already the newest version (1.44.1-1ubuntu1.2). I1105 00:37:21.727] mount is already the newest version (2.31.1-0.4ubuntu3.4). I1105 00:37:21.727] util-linux is already the newest version (2.31.1-0.4ubuntu3.4). I1105 00:37:21.727] The following additional packages will be installed: I1105 00:37:21.728] libreadline5 I1105 00:37:21.728] Suggested packages: I1105 00:37:21.728] xfsdump acl attr quota I1105 00:37:21.782] The following NEW packages will be installed: I1105 00:37:21.782] libreadline5 udev xfsprogs I1105 00:37:21.927] 0 upgraded, 3 newly installed, 0 to remove and 1 not upgraded. I1105 00:37:21.927] Need to get 1884 kB of archives. I1105 00:37:21.927] After this operation, 12.2 MB of additional disk space will be used. I1105 00:37:21.927] Err:1 http://azure.archive.ubuntu.com/ubuntu bionic-updates/main amd64 udev amd64 237-3ubuntu10.31 I1105 00:37:21.927] 503 Service Unavailable [IP: 52.165.132.12 80] I1105 00:37:21.999] Err:2 http://azure.archive.ubuntu.com/ubuntu bionic/main amd64 libreadline5 amd64 5.2+dfsg-3build1 I1105 00:37:21.999] 503 Service Unavailable [IP: 52.165.132.12 80] I1105 00:37:22.071] Err:3 http://azure.archive.ubuntu.com/ubuntu bionic/main amd64 xfsprogs amd64 4.9.0+nmu1ubuntu2 I1105 00:37:22.071] 503 Service Unavailable [IP: 52.165.132.12 80] I1105 00:37:22.076] E: Failed to fetch http://azure.archive.ubuntu.com/ubuntu/pool/main/s/systemd/udev_237-3ubuntu10.31_amd64.deb 503 Service Unavailable [IP: 52.165.132.12 80] I1105 00:37:22.076] E: Failed to fetch http://azure.archive.ubuntu.com/ubuntu/pool/main/r/readline5/libreadline5_5.2+dfsg-3build1_amd64.deb 503 Service Unavailable [IP: 52.165.132.12 80] I1105 00:37:22.076] E: Failed to fetch http://azure.archive.ubuntu.com/ubuntu/pool/main/x/xfsprogs/xfsprogs_4.9.0+nmu1ubuntu2_amd64.deb 503 Service Unavailable [IP: 52.165.132.12 80] I1105 00:37:22.076] E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing? I1105 00:37:28.281] The command '/bin/sh -c apt-get update && apt-get install -y util-linux e2fsprogs mount ca-certificates udev xfsprogs' returned a non-zero code: 100 I1105 00:37:28.282] make[2]: *** [Makefile:94: azuredisk-container] Error 100 I1105 00:37:28.283] make[2]: Leaving directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1105 00:37:28.283] make[1]: *** [Makefile:64: e2e-bootstrap] Error 2 I1105 00:37:28.283] make[1]: Leaving directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1105 00:37:28.286] Failure [330.981 seconds] I1105 00:37:28.286] [BeforeSuite] BeforeSuite I1105 00:37:28.286] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:55 I1105 00:37:28.286] I1105 00:37:28.287] Unexpected error: I1105 00:37:28.287] <*exec.ExitError | 0xc0008a8020>: { I1105 00:37:28.287] ProcessState: { I1105 00:37:28.287] pid: 13798, I1105 00:37:28.288] status: 512, I1105 00:37:28.288] rusage: { I1105 00:37:28.288] Utime: {Sec: 197, Usec: 502936}, I1105 00:37:28.288] Stime: {Sec: 11, Usec: 521557}, I1105 00:37:28.288] Maxrss: 991416, I1105 00:37:28.289] Ixrss: 0, I1105 00:37:28.289] Idrss: 0, I1105 00:37:28.289] Isrss: 0, I1105 00:37:28.291] Minflt: 537650, I1105 00:37:28.291] Majflt: 65, I1105 00:37:28.291] Nswap: 0, I1105 00:37:28.292] Inblock: 251552, I1105 00:37:28.292] Oublock: 983816, I1105 00:37:28.292] Msgsnd: 0, I1105 00:37:28.292] Msgrcv: 0, I1105 00:37:28.292] Nsignals: 0, I1105 00:37:28.292] Nvcsw: 352005, I1105 00:37:28.293] Nivcsw: 288840, I1105 00:37:28.293] }, I1105 00:37:28.293] }, I1105 00:37:28.294] Stderr: nil, I1105 00:37:28.294] } I1105 00:37:28.294] exit status 2 I1105 00:37:28.294] occurred I1105 00:37:28.294] I1105 00:37:28.294] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:94 I1105 00:37:28.294] ------------------------------ I1105 00:37:28.295] 2019/11/05 00:37:28 Uninstalling Azure Disk CSI Driver... I1105 00:37:28.295] make[1]: Entering directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1105 00:37:28.295] helm delete --purge azuredisk-csi-driver I1105 00:37:29.400] Error: release: "azuredisk-csi-driver" not found I1105 00:37:29.404] make[1]: *** [Makefile:80: e2e-teardown] Error 1 I1105 00:37:29.404] make[1]: Leaving directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1105 00:37:29.404] Failure [1.121 seconds] I1105 00:37:29.405] [AfterSuite] AfterSuite I1105 00:37:29.405] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:105 I1105 00:37:29.405] I1105 00:37:29.405] Unexpected error: I1105 00:37:29.405] <*exec.ExitError | 0xc0008a82a0>: { I1105 00:37:29.405] ProcessState: { I1105 00:37:29.405] pid: 19175, I1105 00:37:29.405] status: 512, I1105 00:37:29.406] rusage: { I1105 00:37:29.406] Utime: {Sec: 0, Usec: 149003}, I1105 00:37:29.406] Stime: {Sec: 0, Usec: 28284}, I1105 00:37:29.406] Maxrss: 47788, I1105 00:37:29.406] Ixrss: 0, I1105 00:37:29.406] Idrss: 0, I1105 00:37:29.406] Isrss: 0, I1105 00:37:29.407] Minflt: 4482, I1105 00:37:29.407] Majflt: 0, I1105 00:37:29.407] Nswap: 0, I1105 00:37:29.407] Inblock: 0, I1105 00:37:29.407] Oublock: 0, I1105 00:37:29.407] Msgsnd: 0, I1105 00:37:29.407] Msgrcv: 0, I1105 00:37:29.407] Nsignals: 0, I1105 00:37:29.408] Nvcsw: 883, I1105 00:37:29.408] Nivcsw: 65, I1105 00:37:29.408] }, I1105 00:37:29.408] }, I1105 00:37:29.408] Stderr: nil, I1105 00:37:29.408] } I1105 00:37:29.408] exit status 2 I1105 00:37:29.408] occurred I1105 00:37:29.409] I1105 00:37:29.409] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:123 I1105 00:37:29.409] ------------------------------ I1105 00:37:29.409] I1105 00:37:29.409] Ran 16 of 0 Specs in 332.102 seconds I1105 00:37:29.409] FAIL! -- 0 Passed | 16 Failed | 0 Pending | 0 Skipped I1105 00:37:29.409] --- FAIL: TestE2E (332.10s) I1105 00:37:29.410] FAIL I1105 00:37:29.410] FAIL sigs.k8s.io/azuredisk-csi-driver/test/e2e 332.199s W1105 00:37:32.663] make: *** [Makefile:59: e2e-test] Error 1 W1105 00:37:32.663] 2019/11/05 00:37:32 process.go:155: Step 'make e2e-test' finished in 7m40.873354272s W1105 00:37:32.663] 2019/11/05 00:37:32 azure.go:912: Skippng DumpClusterLogs due to CCM not being enabled. W1105 00:37:32.664] 2019/11/05 00:37:32 azure.go:906: Deleting resource group: kubetest-06d70b8a-ff5f-11e9-be38-0242ff015fe9. W1105 00:47:24.913] 2019/11/05 00:47:24 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W1105 00:47:24.915] 2019/11/05 00:47:24 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}" W1105 00:47:25.579] 2019/11/05 00:47:25 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 665.741065ms W1105 00:47:25.579] 2019/11/05 00:47:25 main.go:319: Something went wrong: encountered 1 errors: [error during make e2e-test: exit status 2] W1105 00:47:25.582] Traceback (most recent call last): W1105 00:47:25.582] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in W1105 00:47:25.583] main(parse_args()) W1105 00:47:25.584] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main W1105 00:47:25.584] mode.start(runner_args) W1105 00:47:25.584] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start W1105 00:47:25.584] check_env(env, self.command, *args) W1105 00:47:25.584] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W1105 00:47:25.584] subprocess.check_call(cmd, env=env) W1105 00:47:25.584] File "/usr/lib/python2.7/subprocess.py", line 190, in check_call W1105 00:47:25.584] raise CalledProcessError(retcode, cmd) W1105 00:47:25.585] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=1', '--acsengine-agentpoolcount=2', '--acsengine-admin-username=azureuser', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.16', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_D4s_v3', '--acsengine-location=eastus2', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux-vmss-multi-zones.json', '--acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz', '--test-azure-disk-csi-driver=True', '--test_args=--ginkgo.focus=\\[multi-az\\]', '--timeout=420m')' returned non-zero exit status 1 E1105 00:47:25.600] Command failed I1105 00:47:25.600] process 686 exited with code 1 after 48.7m E1105 00:47:25.601] FAIL: chewong-pull-azuredisk-csi-driver-e2e-multi-az I1105 00:47:25.602] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1105 00:47:26.512] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I1105 00:47:26.548] process 19226 exited with code 0 after 0.0m I1105 00:47:26.549] Call: gcloud config get-value account I1105 00:47:26.805] process 19238 exited with code 0 after 0.0m I1105 00:47:26.805] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I1105 00:47:26.805] Upload result and artifacts... I1105 00:47:26.805] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191504701992996864 I1105 00:47:26.806] Call: gsutil ls gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191504701992996864/artifacts W1105 00:47:27.893] CommandException: One or more URLs matched no objects. E1105 00:47:27.967] Command failed I1105 00:47:27.967] process 19250 exited with code 1 after 0.0m W1105 00:47:27.967] Remote dir gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191504701992996864/artifacts not exist yet I1105 00:47:27.967] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191504701992996864/artifacts I1105 00:47:29.410] process 19394 exited with code 0 after 0.0m I1105 00:47:29.411] Call: git rev-parse HEAD I1105 00:47:29.415] process 19923 exited with code 0 after 0.0m I1105 00:47:29.415] Call: git rev-parse HEAD I1105 00:47:29.420] process 19924 exited with code 0 after 0.0m I1105 00:47:29.420] Call: gsutil stat gs://kubernetes-upstream/pr-logs/directory/chewong-pull-azuredisk-csi-driver-e2e-multi-az/jobResultsCache.json I1105 00:47:30.232] process 19925 exited with code 0 after 0.0m I1105 00:47:30.233] Call: gsutil -q cat 'gs://kubernetes-upstream/pr-logs/directory/chewong-pull-azuredisk-csi-driver-e2e-multi-az/jobResultsCache.json#1572911352272950' I1105 00:47:31.372] process 20069 exited with code 0 after 0.0m I1105 00:47:31.372] Call: gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1572911352272950 cp /tmp/gsutil_HOGzKV gs://kubernetes-upstream/pr-logs/directory/chewong-pull-azuredisk-csi-driver-e2e-multi-az/jobResultsCache.json I1105 00:47:32.606] process 20215 exited with code 0 after 0.0m I1105 00:47:32.606] Call: gsutil stat gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/jobResultsCache.json W1105 00:47:34.130] No URLs matched: gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/jobResultsCache.json I1105 00:47:34.130] process 20395 exited with code 1 after 0.0m I1105 00:47:34.131] Call: gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:0 cp /tmp/gsutil__FeydG gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/jobResultsCache.json I1105 00:47:36.028] process 20539 exited with code 0 after 0.0m I1105 00:47:36.029] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_PqLK31 gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191504701992996864/finished.json I1105 00:47:37.644] process 20719 exited with code 0 after 0.0m I1105 00:47:37.644] Call: gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_Wy6MoC gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/latest-build.txt I1105 00:47:38.951] process 20899 exited with code 0 after 0.0m I1105 00:47:38.952] Call: gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_WqA5U5 gs://kubernetes-upstream/pr-logs/directory/chewong-pull-azuredisk-csi-driver-e2e-multi-az/latest-build.txt I1105 00:47:40.111] process 21079 exited with code 0 after 0.0m