W1021 21:09:16.784] **************************************************************************
bootstrap.py is deprecated!
test-infra oncall does not support any job still using bootstrap.py.
Please migrate your job to podutils!
https://github.com/kubernetes/test-infra/blob/master/prow/pod-utilities.md
**************************************************************************
I1021 21:09:16.784] Args: --job=chewong-e2e-ccm --service-account=/etc/service-account/service-account.json --upload=gs://kubernetes-jenkins/logs --job=chewong-e2e-ccm --repo=k8s.io/kubernetes=release-1.16 --repo=k8s.io/cloud-provider-azure=master:c470e6f36d76e5a565478fcba22118c06bc1548f,248:5dd5805d1e39f8239e6d7acb8db36ad0e30e78a0 --root=/go/src --service-account=/etc/service-account/service-account.json --timeout=450 --upload=gs://kubernetes-upstream/pr-logs --scenario=kubernetes_e2e -- --gce-ssh= --test=true --up=true --down=true --deployment=acsengine --provider=skeleton --ginkgo-parallel=30 --test-ccm=True --acsengine-agentpoolcount=1 '--acsengine-admin-username=$AZURE_SSH_USER' '--acsengine-creds=$AZURE_CREDENTIALS' --acsengine-orchestratorRelease=1.16 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_D4s_v3 --acsengine-hyperkube=True --acsengine-ccm=True --acsengine-location=eastus2 '--acsengine-public-key=$AZURE_SSH_PUBLIC_KEY_FILE' --acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json --acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.42.0/aks-engine-v0.42.0-linux-amd64.tar.gz --timeout=420m
I1021 21:09:16.785] Bootstrap chewong-e2e-ccm...
I1021 21:09:16.788] Builder: ebdd8cbb-f446-11e9-918b-16773c0c7aed
I1021 21:09:16.788] Image: chewong/kubekins-e2e:v20191021-test-1
I1021 21:09:16.788] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186388867482128384
I1021 21:09:16.789] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W1021 21:09:17.384] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com]
I1021 21:09:17.416] process 218 exited with code 0 after 0.0m
I1021 21:09:17.416] Call:  gcloud config get-value account
I1021 21:09:17.741] process 230 exited with code 0 after 0.0m
I1021 21:09:17.741] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com
I1021 21:09:17.742] Root: /go/src
I1021 21:09:17.742] cd to /go/src
I1021 21:09:17.742] Checkout: /go/src/k8s.io/kubernetes release-1.16 to /go/src/k8s.io/kubernetes
I1021 21:09:17.742] Call:  git init k8s.io/kubernetes
I1021 21:09:17.748] Initialized empty Git repository in /go/src/k8s.io/kubernetes/.git/
I1021 21:09:17.748] process 242 exited with code 0 after 0.0m
I1021 21:09:17.749] Call:  git config --local user.name 'K8S Bootstrap'
I1021 21:09:17.752] process 243 exited with code 0 after 0.0m
I1021 21:09:17.752] Call:  git config --local user.email k8s_bootstrap@localhost
I1021 21:09:17.760] process 244 exited with code 0 after 0.0m
I1021 21:09:17.760] Call:  git fetch --quiet --tags https://github.com/kubernetes/kubernetes release-1.16
I1021 21:10:22.431] process 245 exited with code 0 after 1.1m
I1021 21:10:22.432] Call:  git checkout -B test FETCH_HEAD
W1021 21:10:25.025] Switched to a new branch 'test'
I1021 21:10:25.037] process 257 exited with code 0 after 0.0m
I1021 21:10:25.037] Call:  git show -s --format=format:%ct HEAD
I1021 21:10:25.043] process 258 exited with code 0 after 0.0m
I1021 21:10:25.043] Checkout: /go/src/k8s.io/cloud-provider-azure master:c470e6f36d76e5a565478fcba22118c06bc1548f,248:5dd5805d1e39f8239e6d7acb8db36ad0e30e78a0 to /go/src/k8s.io/cloud-provider-azure
I1021 21:10:25.043] Call:  git init k8s.io/cloud-provider-azure
I1021 21:10:25.047] Initialized empty Git repository in /go/src/k8s.io/cloud-provider-azure/.git/
I1021 21:10:25.048] process 259 exited with code 0 after 0.0m
I1021 21:10:25.048] Call:  git config --local user.name 'K8S Bootstrap'
I1021 21:10:25.050] process 260 exited with code 0 after 0.0m
I1021 21:10:25.051] Call:  git config --local user.email k8s_bootstrap@localhost
I1021 21:10:25.054] process 261 exited with code 0 after 0.0m
I1021 21:10:25.054] Call:  git fetch --quiet --tags https://github.com/kubernetes/cloud-provider-azure master +refs/pull/248/head:refs/pr/248
I1021 21:10:26.632] process 262 exited with code 0 after 0.0m
I1021 21:10:26.633] Call:  git checkout -B test c470e6f36d76e5a565478fcba22118c06bc1548f
W1021 21:10:28.147] Switched to a new branch 'test'
I1021 21:10:28.150] process 275 exited with code 0 after 0.0m
I1021 21:10:28.151] Call:  git show -s --format=format:%ct HEAD
I1021 21:10:28.154] process 276 exited with code 0 after 0.0m
I1021 21:10:28.154] Call:  git merge --no-ff -m 'Merge +refs/pull/248/head:refs/pr/248' 5dd5805d1e39f8239e6d7acb8db36ad0e30e78a0
I1021 21:10:28.298] Merge made by the 'recursive' strategy.
I1021 21:10:28.301]  hack/log-dump/log-dump-daemonset.yaml |  52 +++++++++++++
I1021 21:10:28.301]  hack/log-dump/log-dump.sh             | 140 ++++++++++++++++++++++++++++++++++
I1021 21:10:28.301]  2 files changed, 192 insertions(+)
I1021 21:10:28.302]  create mode 100644 hack/log-dump/log-dump-daemonset.yaml
I1021 21:10:28.302]  create mode 100755 hack/log-dump/log-dump.sh
I1021 21:10:28.302] process 277 exited with code 0 after 0.0m
I1021 21:10:28.302] Configure environment...
I1021 21:10:28.302] Call:  git show -s --format=format:%ct HEAD
I1021 21:10:28.308] process 279 exited with code 0 after 0.0m
I1021 21:10:28.308] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W1021 21:10:41.179] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com]
I1021 21:10:41.338] process 280 exited with code 0 after 0.2m
I1021 21:10:41.339] Call:  gcloud config get-value account
I1021 21:10:41.600] process 292 exited with code 0 after 0.0m
I1021 21:10:41.600] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com
I1021 21:10:41.600] Call:  bash -c '
set -o errexit
set -o nounset
export KUBE_ROOT=.
source hack/lib/version.sh
kube::version::get_version_vars
echo $KUBE_GIT_VERSION
'
I1021 21:10:42.158] process 304 exited with code 0 after 0.0m
I1021 21:10:42.158] Start 1186388867482128384 at v1.16.3-beta.0.16+1cd381987d44f1...
I1021 21:10:42.160] Call:  gsutil -q -h Content-Type:application/json cp /tmp/gsutil_KMl9MQ gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186388867482128384/started.json
I1021 21:10:44.579] process 337 exited with code 0 after 0.0m
I1021 21:10:44.580] Call:  gsutil -q -h Content-Type:text/plain -h 'x-goog-meta-link: gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186388867482128384' cp /tmp/gsutil_NGY5gr gs://kubernetes-upstream/pr-logs/directory/chewong-e2e-ccm/1186388867482128384.txt
I1021 21:10:46.126] process 515 exited with code 0 after 0.0m
I1021 21:10:46.127] Call:  /workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py --gce-ssh= --test=true --up=true --down=true --deployment=acsengine --provider=skeleton --ginkgo-parallel=30 --test-ccm=True --acsengine-agentpoolcount=1 '--acsengine-admin-username=$AZURE_SSH_USER' --acsengine-creds=/etc/azure-cred/credentials --acsengine-orchestratorRelease=1.16 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_D4s_v3 --acsengine-hyperkube=True --acsengine-ccm=True --acsengine-location=eastus2 --acsengine-public-key=/etc/azure-ssh/azure-ssh-pub --acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json --acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.42.0/aks-engine-v0.42.0-linux-amd64.tar.gz --timeout=420m
W1021 21:10:46.167] starts with local mode
W1021 21:10:46.167] Environment:
W1021 21:10:46.167] ARTIFACTS=/workspace/_artifacts
W1021 21:10:46.167] AWS_SSH_PRIVATE_KEY_FILE=/root/.ssh/kube_aws_rsa
W1021 21:10:46.168] AWS_SSH_PUBLIC_KEY_FILE=/root/.ssh/kube_aws_rsa.pub
W1021 21:10:46.168] AZURE_CREDENTIALS=/etc/azure-cred/credentials
W1021 21:10:46.168] AZURE_SSH_PUBLIC_KEY_FILE=/etc/azure-ssh/azure-ssh-pub
W1021 21:10:46.168] AZ_STORAGE_CONTAINER_NAME=mystoragecontainer
W1021 21:10:46.168] BAZEL_REMOTE_CACHE_ENABLED=false
W1021 21:10:46.168] BAZEL_VERSION=0.23.2
W1021 21:10:46.168] BOOTSTRAP_MIGRATION=yes
W1021 21:10:46.169] BUILD_ID=1186388867482128384
W1021 21:10:46.169] BUILD_NUMBER=1186388867482128384
W1021 21:10:46.169] CLOUDSDK_COMPONENT_MANAGER_DISABLE_UPDATE_CHECK=true
W1021 21:10:46.169] CLOUDSDK_CONFIG=/go/src/k8s.io/kubernetes/.config/gcloud
W1021 21:10:46.169] CLOUDSDK_CORE_DISABLE_PROMPTS=1
W1021 21:10:46.169] CLOUDSDK_EXPERIMENTAL_FAST_COMPONENT_UPDATE=false
W1021 21:10:46.169] CLOUD_CONFIG=random
W1021 21:10:46.169] DECK_PORT=tcp://10.0.160.83:80
W1021 21:10:46.170] DECK_PORT_80_TCP=tcp://10.0.160.83:80
W1021 21:10:46.170] DECK_PORT_80_TCP_ADDR=10.0.160.83
W1021 21:10:46.170] DECK_PORT_80_TCP_PORT=80
W1021 21:10:46.170] DECK_PORT_80_TCP_PROTO=tcp
W1021 21:10:46.170] DECK_SERVICE_HOST=10.0.160.83
W1021 21:10:46.170] DECK_SERVICE_PORT=80
W1021 21:10:46.170] DOCKER_IN_DOCKER_ENABLED=true
W1021 21:10:46.170] DOCKER_IN_DOCKER_IPV6_ENABLED=false
W1021 21:10:46.171] GCS_ARTIFACTS_DIR=gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186388867482128384/artifacts
W1021 21:10:46.171] GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json
W1021 21:10:46.171] GOPATH=/go
W1021 21:10:46.171] GO_TARBALL=go1.12.10.linux-amd64.tar.gz
W1021 21:10:46.171] HOME=/workspace
W1021 21:10:46.171] HOOK_PORT=tcp://10.0.144.133:8888
W1021 21:10:46.172] HOOK_PORT_8888_TCP=tcp://10.0.144.133:8888
W1021 21:10:46.172] HOOK_PORT_8888_TCP_ADDR=10.0.144.133
W1021 21:10:46.172] HOOK_PORT_8888_TCP_PORT=8888
W1021 21:10:46.172] HOOK_PORT_8888_TCP_PROTO=tcp
W1021 21:10:46.172] HOOK_SERVICE_HOST=10.0.144.133
W1021 21:10:46.172] HOOK_SERVICE_PORT=8888
W1021 21:10:46.172] HOSTNAME=ebdd8cbb-f446-11e9-918b-16773c0c7aed
W1021 21:10:46.173] IMAGE=chewong/kubekins-e2e:v20191021-test-1
W1021 21:10:46.173] INSTANCE_PREFIX=bootstrap-e2e
W1021 21:10:46.173] JENKINS_GCE_SSH_PRIVATE_KEY_FILE=/root/.ssh/google_compute_engine
W1021 21:10:46.174] JENKINS_GCE_SSH_PUBLIC_KEY_FILE=/root/.ssh/google_compute_engine.pub
W1021 21:10:46.174] JOB_NAME=chewong-e2e-ccm
W1021 21:10:46.174] JOB_SPEC={"type":"presubmit","job":"chewong-e2e-ccm","buildid":"1186388867482128384","prowjobid":"ebdd8cbb-f446-11e9-918b-16773c0c7aed","refs":{"org":"Azure","repo":"kubernetes","repo_link":"https://github.com/Azure/kubernetes","base_ref":"master","base_sha":"b717be8269a4f381ab6c23e711e8924bc1f64c93","base_link":"https://github.com/Azure/kubernetes/commit/b717be8269a4f381ab6c23e711e8924bc1f64c93","pulls":[{"number":113,"author":"chewong","sha":"879465972041635fd7bc8269da49153b67e63822","link":"https://github.com/Azure/kubernetes/pull/113","commit_link":"https://github.com/Azure/kubernetes/pull/113/commits/879465972041635fd7bc8269da49153b67e63822","author_link":"https://github.com/chewong"}]}}
W1021 21:10:46.174] JOB_TYPE=presubmit
W1021 21:10:46.175] KUBERNETES_PORT=tcp://10.0.0.1:443
W1021 21:10:46.175] KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
W1021 21:10:46.175] KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
W1021 21:10:46.175] KUBERNETES_PORT_443_TCP_PORT=443
W1021 21:10:46.175] KUBERNETES_PORT_443_TCP_PROTO=tcp
W1021 21:10:46.175] KUBERNETES_SERVICE_HOST=10.0.0.1
W1021 21:10:46.175] KUBERNETES_SERVICE_PORT=443
W1021 21:10:46.176] KUBERNETES_SERVICE_PORT_HTTPS=443
W1021 21:10:46.176] KUBETEST_IN_DOCKER=true
W1021 21:10:46.176] KUBETEST_MANUAL_DUMP=y
W1021 21:10:46.176] KUBE_AWS_INSTANCE_PREFIX=bootstrap-e2e
W1021 21:10:46.176] KUBE_GCE_INSTANCE_PREFIX=bootstrap-e2e
W1021 21:10:46.176] KUBE_VERBOSE=0
W1021 21:10:46.176] NODE_NAME=ebdd8cbb-f446-11e9-918b-16773c0c7aed
W1021 21:10:46.177] PATH=/go/bin:/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/workspace:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
W1021 21:10:46.177] PROW_JOB_ID=ebdd8cbb-f446-11e9-918b-16773c0c7aed
W1021 21:10:46.177] PULL_BASE_REF=master
W1021 21:10:46.177] PULL_BASE_SHA=b717be8269a4f381ab6c23e711e8924bc1f64c93
W1021 21:10:46.177] PULL_NUMBER=113
W1021 21:10:46.177] PULL_PULL_SHA=879465972041635fd7bc8269da49153b67e63822
W1021 21:10:46.177] PULL_REFS=master:b717be8269a4f381ab6c23e711e8924bc1f64c93,113:879465972041635fd7bc8269da49153b67e63822
W1021 21:10:46.177] PWD=/workspace
W1021 21:10:46.179] REGISTRY=k8sprowinternal.azurecr.io
W1021 21:10:46.179] REPO_NAME=kubernetes
W1021 21:10:46.179] REPO_OWNER=Azure
W1021 21:10:46.179] SHLVL=2
W1021 21:10:46.180] SOURCE_DATE_EPOCH=1571647177
W1021 21:10:46.180] TERM=xterm
W1021 21:10:46.180] TIDE_PORT=tcp://10.0.180.53:80
W1021 21:10:46.180] TIDE_PORT_80_TCP=tcp://10.0.180.53:80
W1021 21:10:46.180] TIDE_PORT_80_TCP_ADDR=10.0.180.53
W1021 21:10:46.181] TIDE_PORT_80_TCP_PORT=80
W1021 21:10:46.181] TIDE_PORT_80_TCP_PROTO=tcp
W1021 21:10:46.181] TIDE_SERVICE_HOST=10.0.180.53
W1021 21:10:46.181] TIDE_SERVICE_PORT=80
W1021 21:10:46.182] WORKSPACE=/workspace
W1021 21:10:46.182] _=./test-infra/jenkins/bootstrap.py
W1021 21:10:46.183] Run: ('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=30', '--test-ccm=True', '--acsengine-agentpoolcount=1', '--acsengine-admin-username=$AZURE_SSH_USER', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.16', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_D4s_v3', '--acsengine-hyperkube=True', '--acsengine-ccm=True', '--acsengine-location=eastus2', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json', '--acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.42.0/aks-engine-v0.42.0-linux-amd64.tar.gz', '--timeout=420m')
W1021 21:10:46.184] 2019/10/21 21:10:46 main.go:332: Limiting testing to 7h0m0s
W1021 21:10:46.184] 2019/10/21 21:10:46 azure.go:232: Reading credentials file /etc/azure-cred/credentials
W1021 21:10:46.185] 2019/10/21 21:10:46 azure.go:906: Deleting resource group: kubetest-3fce3fae-f447-11e9-b5da-02424caf4264.
W1021 21:10:46.632] 2019/10/21 21:10:46 azure.go:654: CWD /go/src/k8s.io/kubernetes
W1021 21:10:46.632] 2019/10/21 21:10:46 azure.go:673: Attempting Docker login with azure cred.
W1021 21:10:47.594] 2019/10/21 21:10:47 azure.go:682: Docker login success.
W1021 21:10:47.595] 2019/10/21 21:10:47 azure.go:697: Building ccm.
W1021 21:10:47.595] 2019/10/21 21:10:47 azure.go:699: projectPath /go/src/k8s.io/cloud-provider-azure
W1021 21:10:47.595] 2019/10/21 21:10:47 process.go:153: Running: docker build -t k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1186388867482128384-4012834b .
I1021 21:10:48.997] Sending build context to Docker daemon  67.16MB

I1021 21:10:49.035] Step 1/7 : FROM golang:1.12.9-stretch AS build
I1021 21:10:49.923] 1.12.9-stretch: Pulling from library/golang
I1021 21:10:50.259] 092586df9206: Pulling fs layer
I1021 21:10:50.259] ef599477fae0: Pulling fs layer
I1021 21:10:50.260] 4530c6472b5d: Pulling fs layer
I1021 21:10:50.260] d34d61487075: Pulling fs layer
I1021 21:10:50.260] 89c6ec31b9e9: Pulling fs layer
I1021 21:10:50.260] e37857ebcafa: Pulling fs layer
I1021 21:10:50.260] b0e29f6c7f0a: Pulling fs layer
I1021 21:10:50.260] 89c6ec31b9e9: Waiting
I1021 21:10:50.260] e37857ebcafa: Waiting
I1021 21:10:50.261] d34d61487075: Waiting
I1021 21:10:50.261] b0e29f6c7f0a: Waiting
I1021 21:10:50.707] 4530c6472b5d: Verifying Checksum
I1021 21:10:50.708] 4530c6472b5d: Download complete
I1021 21:10:50.754] ef599477fae0: Verifying Checksum
I1021 21:10:50.755] ef599477fae0: Download complete
I1021 21:10:51.370] 092586df9206: Verifying Checksum
I1021 21:10:51.370] 092586df9206: Download complete
I1021 21:10:51.569] d34d61487075: Verifying Checksum
I1021 21:10:51.570] d34d61487075: Download complete
I1021 21:10:51.640] 89c6ec31b9e9: Verifying Checksum
I1021 21:10:51.641] 89c6ec31b9e9: Download complete
I1021 21:10:51.932] b0e29f6c7f0a: Verifying Checksum
I1021 21:10:51.932] b0e29f6c7f0a: Download complete
I1021 21:10:52.923] e37857ebcafa: Verifying Checksum
I1021 21:10:52.923] e37857ebcafa: Download complete
I1021 21:10:54.657] 092586df9206: Pull complete
I1021 21:10:55.514] ef599477fae0: Pull complete
I1021 21:10:55.915] 4530c6472b5d: Pull complete
I1021 21:10:59.927] d34d61487075: Pull complete
I1021 21:11:04.012] 89c6ec31b9e9: Pull complete
I1021 21:11:12.862] e37857ebcafa: Pull complete
I1021 21:11:13.012] b0e29f6c7f0a: Pull complete
I1021 21:11:13.042] Digest: sha256:76b52857546f070cc3ac499accb27b8c411b10ff6d45c0b1da2a8aab7b61fe29
I1021 21:11:13.062] Status: Downloaded newer image for golang:1.12.9-stretch
I1021 21:11:13.062]  ---> 2c4a601e5da9
I1021 21:11:13.063] Step 2/7 : WORKDIR /go/src/k8s.io/cloud-provider-azure
I1021 21:11:25.162]  ---> Running in 9eb2cce35ec2
I1021 21:11:26.474] Removing intermediate container 9eb2cce35ec2
I1021 21:11:26.474]  ---> 79ae2fde96be
I1021 21:11:26.475] Step 3/7 : COPY . .
I1021 21:11:33.273]  ---> 56b7ab4c53be
I1021 21:11:33.274] Step 4/7 : RUN make
I1021 21:11:33.577]  ---> Running in 7b0f77fc8fdf
I1021 21:11:34.603] hack/pkg-config.sh > .pkg_config
I1021 21:11:34.631] go build -o bin/azure-cloud-controller-manager -ldflags '-s -w -X k8s.io/cloud-provider-azure/pkg/version.gitVersion=v0.3.0-11-gb6a51653d -X k8s.io/cloud-provider-azure/pkg/version.gitCommit=b6a51653dac907e44dbc7f4d147fa6b8cd50faab -X k8s.io/cloud-provider-azure/pkg/version.buildDate=2019-10-21T21:11:34Z' ./cmd/cloud-controller-manager
I1021 21:12:40.640] go build -o bin/azure-cloud-node-manager -ldflags '-s -w -X k8s.io/cloud-provider-azure/pkg/version.gitVersion=v0.3.0-11-gb6a51653d -X k8s.io/cloud-provider-azure/pkg/version.gitCommit=b6a51653dac907e44dbc7f4d147fa6b8cd50faab -X k8s.io/cloud-provider-azure/pkg/version.buildDate=2019-10-21T21:11:34Z' ./cmd/cloud-node-manager
I1021 21:13:29.792] Removing intermediate container 7b0f77fc8fdf
I1021 21:13:29.793]  ---> 00e25393614b
I1021 21:13:29.793] Step 5/7 : FROM k8s.gcr.io/debian-base:v1.0.0
I1021 21:13:30.255] v1.0.0: Pulling from debian-base
I1021 21:13:30.442] 39fafc05754f: Pulling fs layer
I1021 21:13:30.901] 39fafc05754f: Verifying Checksum
I1021 21:13:30.902] 39fafc05754f: Download complete
I1021 21:13:33.440] 39fafc05754f: Pull complete
I1021 21:13:33.469] Digest: sha256:3801f944c765dc1b54900826ca67b1380bb8c73b9caf4a2a27ce613b3ba3e742
I1021 21:13:33.491] Status: Downloaded newer image for k8s.gcr.io/debian-base:v1.0.0
I1021 21:13:33.492]  ---> 204e96332c91
I1021 21:13:33.492] Step 6/7 : COPY --from=build /go/src/k8s.io/cloud-provider-azure/bin/azure-cloud-controller-manager /usr/local/bin
I1021 21:13:42.174]  ---> 2f119e043a00
I1021 21:13:42.174] Step 7/7 : RUN ln -s /usr/local/bin/azure-cloud-controller-manager /usr/local/bin/cloud-controller-manager
I1021 21:13:42.633]  ---> Running in 971511c8ed3f
I1021 21:13:46.298] Removing intermediate container 971511c8ed3f
I1021 21:13:46.298]  ---> 047dd05cc0a4
I1021 21:13:46.498] Successfully built 047dd05cc0a4
I1021 21:13:46.645] Successfully tagged k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1186388867482128384-4012834b
W1021 21:13:46.746] 2019/10/21 21:13:46 process.go:155: Step 'docker build -t k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1186388867482128384-4012834b .' finished in 2m59.050592696s
W1021 21:13:46.746] 2019/10/21 21:13:46 process.go:153: Running: docker push k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1186388867482128384-4012834b
W1021 21:13:58.722] 2019/10/21 21:13:58 process.go:155: Step 'docker push k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1186388867482128384-4012834b' finished in 12.048485284s
W1021 21:13:58.722] 2019/10/21 21:13:58 azure.go:686: Docker logout.
W1021 21:13:58.846] 2019/10/21 21:13:58 azure.go:716: Custom cloud controller manager URL: k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1186388867482128384-4012834b .
W1021 21:13:58.846] 2019/10/21 21:13:58 azure.go:654: CWD /go/src/k8s.io/kubernetes
W1021 21:13:58.846] 2019/10/21 21:13:58 azure.go:673: Attempting Docker login with azure cred.
W1021 21:13:59.935] 2019/10/21 21:13:59 azure.go:682: Docker login success.
W1021 21:13:59.936] 2019/10/21 21:13:59 azure.go:726: Building hyperkube.
W1021 21:13:59.936] 2019/10/21 21:13:59 process.go:153: Running: make -C /go/src/k8s.io/kubernetes WHAT=cmd/hyperkube
W1021 21:17:17.079] 2019/10/21 21:17:17 process.go:155: Step 'make -C /go/src/k8s.io/kubernetes WHAT=cmd/hyperkube' finished in 3m17.143796436s
W1021 21:17:17.080] 2019/10/21 21:17:17 azure.go:733: Pushing hyperkube.
W1021 21:17:17.080] 2019/10/21 21:17:17 process.go:153: Running: make -C /go/src/k8s.io/kubernetes/cluster/images/hyperkube push HYPERKUBE_BIN=/go/src/k8s.io/kubernetes/_output/bin/hyperkube
I1021 21:17:17.180] make: Entering directory '/go/src/k8s.io/kubernetes/cluster/images/hyperkube'
I1021 21:17:17.181] cp -r ./* /tmp/hyperkube8qhmxG
I1021 21:17:17.181] cp /go/src/k8s.io/kubernetes/_output/bin/hyperkube /tmp/hyperkube8qhmxG
I1021 21:17:17.251] chmod a+rx /tmp/hyperkube8qhmxG/hyperkube
I1021 21:17:17.252] cd /tmp/hyperkube8qhmxG && sed -i.back "s|BASEIMAGE|k8s.gcr.io/debian-hyperkube-base-amd64:0.12.1|g" Dockerfile
I1021 21:17:17.254] docker build --pull -t k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1186388867482128384-b2a3f05a /tmp/hyperkube8qhmxG
I1021 21:17:18.461] Sending build context to Docker daemon  212.1MB

I1021 21:17:18.490] Step 1/2 : FROM k8s.gcr.io/debian-hyperkube-base-amd64:0.12.1
I1021 21:17:18.802] 0.12.1: Pulling from debian-hyperkube-base-amd64
I1021 21:17:18.802] 346aee5ea5bc: Pulling fs layer
I1021 21:17:18.803] 9c47fde751af: Pulling fs layer
I1021 21:17:18.803] be2693a52daf: Pulling fs layer
I1021 21:17:18.803] 6b69eb11d043: Pulling fs layer
I1021 21:17:18.803] 0abeb1500767: Pulling fs layer
I1021 21:17:18.803] 4062d80041b7: Pulling fs layer
I1021 21:17:18.803] 23b6daf06fc2: Pulling fs layer
I1021 21:17:18.804] 6b69eb11d043: Waiting
I1021 21:17:18.804] 0abeb1500767: Waiting
I1021 21:17:18.804] 4062d80041b7: Waiting
I1021 21:17:18.804] 23b6daf06fc2: Waiting
I1021 21:17:18.986] 9c47fde751af: Download complete
I1021 21:17:19.015] be2693a52daf: Verifying Checksum
I1021 21:17:19.015] be2693a52daf: Download complete
I1021 21:17:19.122] 6b69eb11d043: Verifying Checksum
I1021 21:17:19.122] 6b69eb11d043: Download complete
I1021 21:17:19.147] 0abeb1500767: Verifying Checksum
I1021 21:17:19.148] 0abeb1500767: Download complete
I1021 21:17:19.417] 346aee5ea5bc: Verifying Checksum
I1021 21:17:19.418] 346aee5ea5bc: Download complete
I1021 21:17:19.910] 23b6daf06fc2: Verifying Checksum
I1021 21:17:19.911] 23b6daf06fc2: Download complete
I1021 21:17:20.577] 4062d80041b7: Verifying Checksum
I1021 21:17:20.578] 4062d80041b7: Download complete
I1021 21:17:26.000] 346aee5ea5bc: Pull complete
I1021 21:17:26.158] 9c47fde751af: Pull complete
I1021 21:17:26.374] be2693a52daf: Pull complete
I1021 21:17:26.519] 6b69eb11d043: Pull complete
I1021 21:17:26.681] 0abeb1500767: Pull complete
I1021 21:17:34.331] 4062d80041b7: Pull complete
I1021 21:17:35.341] 23b6daf06fc2: Pull complete
I1021 21:17:35.365] Digest: sha256:5d4ea2fb5fbe9a9a9da74f67cf2faefc881968bc39f2ac5d62d9167e575812a1
I1021 21:17:35.384] Status: Downloaded newer image for k8s.gcr.io/debian-hyperkube-base-amd64:0.12.1
I1021 21:17:35.384]  ---> a46476511725
I1021 21:17:35.384] Step 2/2 : COPY hyperkube /hyperkube
I1021 21:17:58.931]  ---> 8218fa8783e5
I1021 21:17:58.957] Successfully built 8218fa8783e5
I1021 21:17:59.023] Successfully tagged k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1186388867482128384-b2a3f05a
I1021 21:17:59.026] rm -rf "/tmp/hyperkube8qhmxG"
I1021 21:17:59.057] docker push k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1186388867482128384-b2a3f05a
I1021 21:17:59.118] The push refers to repository [k8sprowinternal.azurecr.io/hyperkube-amd64]
I1021 21:17:59.131] 32d26feb460c: Preparing
I1021 21:17:59.131] 39b3ac6d96e9: Preparing
I1021 21:17:59.131] 7bbae4dddb88: Preparing
I1021 21:17:59.131] a00defcfe869: Preparing
I1021 21:17:59.131] 2ab0ae805c74: Preparing
I1021 21:17:59.132] 43a8fe7d2382: Preparing
I1021 21:17:59.132] 3f6a6f542637: Preparing
I1021 21:17:59.132] 5ba3be777c2d: Preparing
I1021 21:17:59.132] 43a8fe7d2382: Waiting
I1021 21:17:59.132] 3f6a6f542637: Waiting
I1021 21:17:59.132] 5ba3be777c2d: Waiting
I1021 21:17:59.325] 2ab0ae805c74: Layer already exists
I1021 21:17:59.347] 39b3ac6d96e9: Layer already exists
I1021 21:17:59.371] 7bbae4dddb88: Layer already exists
I1021 21:17:59.396] 43a8fe7d2382: Layer already exists
I1021 21:17:59.417] 3f6a6f542637: Layer already exists
I1021 21:17:59.449] a00defcfe869: Layer already exists
I1021 21:17:59.459] 5ba3be777c2d: Layer already exists
I1021 21:18:09.620] 32d26feb460c: Pushed
I1021 21:18:10.261] azure-e2e-1186388867482128384-b2a3f05a: digest: sha256:00ef8d00cfb187d8e2f54f21f8130ef856cbf308f17e9cc54d6bf356b347e09a size: 1998
I1021 21:18:10.282] docker rmi k8sprowinternal.azurecr.io/hyperkube:azure-e2e-1186388867482128384-b2a3f05a 2>/dev/null || true
I1021 21:18:10.331] docker tag k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1186388867482128384-b2a3f05a k8sprowinternal.azurecr.io/hyperkube:azure-e2e-1186388867482128384-b2a3f05a
I1021 21:18:10.398] docker push k8sprowinternal.azurecr.io/hyperkube:azure-e2e-1186388867482128384-b2a3f05a
I1021 21:18:10.455] The push refers to repository [k8sprowinternal.azurecr.io/hyperkube]
I1021 21:18:10.466] 32d26feb460c: Preparing
I1021 21:18:10.466] 39b3ac6d96e9: Preparing
I1021 21:18:10.467] 7bbae4dddb88: Preparing
I1021 21:18:10.467] a00defcfe869: Preparing
I1021 21:18:10.467] 2ab0ae805c74: Preparing
I1021 21:18:10.467] 43a8fe7d2382: Preparing
I1021 21:18:10.467] 3f6a6f542637: Preparing
I1021 21:18:10.467] 5ba3be777c2d: Preparing
I1021 21:18:10.467] 43a8fe7d2382: Waiting
I1021 21:18:10.467] 3f6a6f542637: Waiting
I1021 21:18:10.468] 5ba3be777c2d: Waiting
I1021 21:18:10.534] a00defcfe869: Layer already exists
I1021 21:18:10.555] 39b3ac6d96e9: Layer already exists
I1021 21:18:10.600] 2ab0ae805c74: Layer already exists
I1021 21:18:10.611] 7bbae4dddb88: Layer already exists
I1021 21:18:10.636] 43a8fe7d2382: Layer already exists
I1021 21:18:10.651] 3f6a6f542637: Layer already exists
I1021 21:18:10.673] 32d26feb460c: Mounted from hyperkube-amd64
I1021 21:18:10.674] 5ba3be777c2d: Layer already exists
I1021 21:18:11.450] azure-e2e-1186388867482128384-b2a3f05a: digest: sha256:00ef8d00cfb187d8e2f54f21f8130ef856cbf308f17e9cc54d6bf356b347e09a size: 1998
I1021 21:18:11.465] make: Leaving directory '/go/src/k8s.io/kubernetes/cluster/images/hyperkube'
W1021 21:18:11.566] 2019/10/21 21:18:11 process.go:155: Step 'make -C /go/src/k8s.io/kubernetes/cluster/images/hyperkube push HYPERKUBE_BIN=/go/src/k8s.io/kubernetes/_output/bin/hyperkube' finished in 54.386235079s
W1021 21:18:11.566] 2019/10/21 21:18:11 azure.go:686: Docker logout.
W1021 21:18:11.566] 2019/10/21 21:18:11 azure.go:744: Custom hyperkube URL: k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1186388867482128384-b2a3f05a .
W1021 21:18:11.567] 2019/10/21 21:18:11 azure.go:787: downloading /workspace/aks162336262/kubernetes.json from https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json.
W1021 21:18:11.567] 2019/10/21 21:18:11 util.go:42: curl https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json
W1021 21:18:11.803] 2019/10/21 21:18:11 azure.go:529: downloading /workspace/aks-engine.tar.gz from https://github.com/Azure/aks-engine/releases/download/v0.42.0/aks-engine-v0.42.0-linux-amd64.tar.gz.
W1021 21:18:11.803] 2019/10/21 21:18:11 util.go:42: curl https://github.com/Azure/aks-engine/releases/download/v0.42.0/aks-engine-v0.42.0-linux-amd64.tar.gz
W1021 21:18:13.021] 2019/10/21 21:18:13 azure.go:556: Extracting tar file /workspace/aks-engine.tar.gz into directory /go/src/k8s.io/kubernetes .
W1021 21:18:13.021] 2019/10/21 21:18:13 process.go:153: Running: tar -xzf /workspace/aks-engine.tar.gz --strip 1
W1021 21:18:13.164] 2019/10/21 21:18:13 process.go:155: Step 'tar -xzf /workspace/aks-engine.tar.gz --strip 1' finished in 143.486217ms
W1021 21:18:13.164] 2019/10/21 21:18:13 process.go:153: Running: /go/src/k8s.io/kubernetes/aks-engine generate /workspace/aks162336262/kubernetes.json --output-directory /workspace/aks162336262
I1021 21:18:13.333] INFO[0000] Generating assets into /workspace/aks162336262... 
W1021 21:18:25.145] 2019/10/21 21:18:25 process.go:155: Step '/go/src/k8s.io/kubernetes/aks-engine generate /workspace/aks162336262/kubernetes.json --output-directory /workspace/aks162336262' finished in 11.980683234s
W1021 21:18:25.149] 2019/10/21 21:18:25 azure.go:627: Setting kubeconfig env variable: kubeconfig path: /workspace/aks162336262/kubeconfig/kubeconfig.eastus2.json.
W1021 21:18:25.149] 2019/10/21 21:18:25 azure.go:629: Creating resource group: kubetest-3fce3fae-f447-11e9-b5da-02424caf4264.
W1021 21:18:25.149] 2019/10/21 21:18:25 azure.go:631: Creating Azure resource group: kubetest-3fce3fae-f447-11e9-b5da-02424caf4264 for cluster deployment.
W1021 21:18:26.712] 2019/10/21 21:18:26 azure.go:636: Validating deployment ARM templates.
W1021 21:18:28.486] 2019/10/21 21:18:28 azure.go:642: Deploying cluster kubetest-3fce3fae-f447-11e9-b5da-02424caf4264 in resource group kubetest-3fce3fae-f447-11e9-b5da-02424caf4264.
W1021 21:20:33.345] 2019/10/21 21:20:33 process.go:153: Running: bash -c ./log-dump.sh
I1021 21:20:33.446] Installing log-dump-daemonset.yaml via kubectl
W1021 21:21:33.410] error: unable to recognize "/go/src/k8s.io/cloud-provider-azure/hack/log-dump/log-dump-daemonset.yaml": Get https://kubetest-3fce3fae-f447-11e9-b5da-02424caf4264.eastus2.cloudapp.azure.com/api?timeout=32s: dial tcp 52.167.40.209:443: i/o timeout
I1021 21:21:33.511] Uninstalling log-dump-daemonset.yaml via kubectl
W1021 21:22:03.467] error: unable to recognize "/go/src/k8s.io/cloud-provider-azure/hack/log-dump/log-dump-daemonset.yaml": Get https://kubetest-3fce3fae-f447-11e9-b5da-02424caf4264.eastus2.cloudapp.azure.com/api?timeout=32s: dial tcp 52.167.40.209:443: i/o timeout
W1021 21:22:03.469] 2019/10/21 21:22:03 process.go:155: Step 'bash -c ./log-dump.sh' finished in 1m30.123250025s
W1021 21:22:03.469] 2019/10/21 21:22:03 azure.go:906: Deleting resource group: kubetest-3fce3fae-f447-11e9-b5da-02424caf4264.
W1021 21:27:08.750] 2019/10/21 21:27:08 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml.
W1021 21:27:08.751] 2019/10/21 21:27:08 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"
W1021 21:27:08.893] 2019/10/21 21:27:08 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 142.446007ms
W1021 21:27:08.894] 2019/10/21 21:27:08 main.go:319: Something went wrong: starting e2e cluster: error creating cluster: cannot deploy: cannot get the create deployment future response: Code="DeploymentFailed" Message="At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-debug for usage details." Details=[{"code":"BadRequest","message":"{\r\n  \"error\": {\r\n    \"code\": \"InvalidParameter\",\r\n    \"message\": \"The value of parameter linuxConfiguration.ssh.publicKeys.path is invalid.\",\r\n    \"target\": \"linuxConfiguration.ssh.publicKeys.path\"\r\n  }\r\n}"},{"code":"BadRequest","message":"{\r\n  \"error\": {\r\n    \"code\": \"InvalidParameter\",\r\n    \"message\": \"The value of parameter linuxConfiguration.ssh.publicKeys.path is invalid.\",\r\n    \"target\": \"linuxConfiguration.ssh.publicKeys.path\"\r\n  }\r\n}"}]
W1021 21:27:08.895] Traceback (most recent call last):
W1021 21:27:08.895]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module>
W1021 21:27:08.895]     main(parse_args())
W1021 21:27:08.895]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main
W1021 21:27:08.895]     mode.start(runner_args)
W1021 21:27:08.895]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start
W1021 21:27:08.896]     check_env(env, self.command, *args)
W1021 21:27:08.896]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env
W1021 21:27:08.896]     subprocess.check_call(cmd, env=env)
W1021 21:27:08.896]   File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
W1021 21:27:08.896]     raise CalledProcessError(retcode, cmd)
W1021 21:27:08.897] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=30', '--test-ccm=True', '--acsengine-agentpoolcount=1', '--acsengine-admin-username=$AZURE_SSH_USER', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.16', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_D4s_v3', '--acsengine-hyperkube=True', '--acsengine-ccm=True', '--acsengine-location=eastus2', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json', '--acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.42.0/aks-engine-v0.42.0-linux-amd64.tar.gz', '--timeout=420m')' returned non-zero exit status 1
E1021 21:27:08.902] Command failed
I1021 21:27:08.902] process 693 exited with code 1 after 16.4m
E1021 21:27:08.902] FAIL: chewong-e2e-ccm
I1021 21:27:08.902] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W1021 21:27:09.423] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com]
I1021 21:27:09.458] process 29142 exited with code 0 after 0.0m
I1021 21:27:09.458] Call:  gcloud config get-value account
I1021 21:27:09.699] process 29154 exited with code 0 after 0.0m
I1021 21:27:09.699] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com
I1021 21:27:09.699] Upload result and artifacts...
I1021 21:27:09.699] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186388867482128384
I1021 21:27:09.700] Call:  gsutil ls gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186388867482128384/artifacts
W1021 21:27:10.765] CommandException: One or more URLs matched no objects.
E1021 21:27:10.842] Command failed
I1021 21:27:10.842] process 29166 exited with code 1 after 0.0m
W1021 21:27:10.843] Remote dir gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186388867482128384/artifacts not exist yet
I1021 21:27:10.843] Call:  gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186388867482128384/artifacts
I1021 21:27:12.430] process 29308 exited with code 0 after 0.0m
I1021 21:27:12.430] Call:  git rev-parse HEAD
I1021 21:27:12.433] process 29832 exited with code 0 after 0.0m
I1021 21:27:12.433] Call:  git rev-parse HEAD
I1021 21:27:12.435] process 29833 exited with code 0 after 0.0m
I1021 21:27:12.436] Call:  gsutil stat gs://kubernetes-upstream/pr-logs/directory/chewong-e2e-ccm/jobResultsCache.json
I1021 21:27:13.391] process 29834 exited with code 0 after 0.0m
I1021 21:27:13.391] Call:  gsutil -q cat 'gs://kubernetes-upstream/pr-logs/directory/chewong-e2e-ccm/jobResultsCache.json#1571692815976070'
I1021 21:27:14.564] process 29976 exited with code 0 after 0.0m
I1021 21:27:14.565] Call:  gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1571692815976070 cp /tmp/gsutil_huvPU_ gs://kubernetes-upstream/pr-logs/directory/chewong-e2e-ccm/jobResultsCache.json
I1021 21:27:15.940] process 30120 exited with code 0 after 0.0m
I1021 21:27:15.940] Call:  gsutil stat gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/jobResultsCache.json
I1021 21:27:16.914] process 30298 exited with code 0 after 0.0m
I1021 21:27:16.915] Call:  gsutil -q cat 'gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/jobResultsCache.json#1571692819728878'
I1021 21:27:18.173] process 30440 exited with code 0 after 0.0m
I1021 21:27:18.174] Call:  gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1571692819728878 cp /tmp/gsutil_7qZuAm gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/jobResultsCache.json
I1021 21:27:19.575] process 30584 exited with code 0 after 0.0m
I1021 21:27:19.575] Call:  gsutil -q -h Content-Type:application/json cp /tmp/gsutil_etBeL_ gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186388867482128384/finished.json
I1021 21:27:20.880] process 30762 exited with code 0 after 0.0m
I1021 21:27:20.881] Call:  gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_KsqUuD gs://kubernetes-upstream/pr-logs/directory/chewong-e2e-ccm/latest-build.txt
I1021 21:27:22.200] process 30940 exited with code 0 after 0.0m
I1021 21:27:22.201] Call:  gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_9BlZ27 gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/latest-build.txt
I1021 21:27:23.517] process 31118 exited with code 0 after 0.0m