W1021 21:40:25.600] **************************************************************************
bootstrap.py is deprecated!
test-infra oncall does not support any job still using bootstrap.py.
Please migrate your job to podutils!
https://github.com/kubernetes/test-infra/blob/master/prow/pod-utilities.md
**************************************************************************
I1021 21:40:25.600] Args: --job=chewong-e2e-ccm --service-account=/etc/service-account/service-account.json --upload=gs://kubernetes-jenkins/logs --job=chewong-e2e-ccm --repo=k8s.io/kubernetes=release-1.16 --repo=k8s.io/cloud-provider-azure=master:c470e6f36d76e5a565478fcba22118c06bc1548f,248:5dd5805d1e39f8239e6d7acb8db36ad0e30e78a0 --root=/go/src --service-account=/etc/service-account/service-account.json --timeout=450 --upload=gs://kubernetes-upstream/pr-logs --scenario=kubernetes_e2e -- --gce-ssh= --test=true --up=true --down=true --deployment=acsengine --provider=skeleton --ginkgo-parallel=30 --test-ccm=True --acsengine-agentpoolcount=1 '--acsengine-admin-username=$AZURE_SSH_USER' '--acsengine-creds=$AZURE_CREDENTIALS' --acsengine-orchestratorRelease=1.16 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_D4s_v3 --acsengine-hyperkube=True --acsengine-ccm=True --acsengine-location=eastus2 '--acsengine-public-key=$AZURE_SSH_PUBLIC_KEY_FILE' --acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json --acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.42.0/aks-engine-v0.42.0-linux-amd64.tar.gz --timeout=420m
I1021 21:40:25.600] Bootstrap chewong-e2e-ccm...
I1021 21:40:25.604] Builder: 4de4de37-f44b-11e9-b3d3-b20db476995a
I1021 21:40:25.604] Image: chewong/kubekins-e2e:v20191021-test-1
I1021 21:40:25.605] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186396794708299776
I1021 21:40:25.605] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W1021 21:40:26.126] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com]
I1021 21:40:26.158] process 213 exited with code 0 after 0.0m
I1021 21:40:26.159] Call:  gcloud config get-value account
I1021 21:40:26.401] process 225 exited with code 0 after 0.0m
I1021 21:40:26.401] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com
I1021 21:40:26.401] Root: /go/src
I1021 21:40:26.401] cd to /go/src
I1021 21:40:26.402] Checkout: /go/src/k8s.io/kubernetes release-1.16 to /go/src/k8s.io/kubernetes
I1021 21:40:26.402] Call:  git init k8s.io/kubernetes
I1021 21:40:26.406] Initialized empty Git repository in /go/src/k8s.io/kubernetes/.git/
I1021 21:40:26.406] process 237 exited with code 0 after 0.0m
I1021 21:40:26.406] Call:  git config --local user.name 'K8S Bootstrap'
I1021 21:40:26.408] process 238 exited with code 0 after 0.0m
I1021 21:40:26.409] Call:  git config --local user.email k8s_bootstrap@localhost
I1021 21:40:26.411] process 239 exited with code 0 after 0.0m
I1021 21:40:26.411] Call:  git fetch --quiet --tags https://github.com/kubernetes/kubernetes release-1.16
I1021 21:41:18.252] process 240 exited with code 0 after 0.9m
I1021 21:41:18.252] Call:  git checkout -B test FETCH_HEAD
W1021 21:41:20.305] Switched to a new branch 'test'
I1021 21:41:20.315] process 252 exited with code 0 after 0.0m
I1021 21:41:20.315] Call:  git show -s --format=format:%ct HEAD
I1021 21:41:20.320] process 253 exited with code 0 after 0.0m
I1021 21:41:20.321] Checkout: /go/src/k8s.io/cloud-provider-azure master:c470e6f36d76e5a565478fcba22118c06bc1548f,248:5dd5805d1e39f8239e6d7acb8db36ad0e30e78a0 to /go/src/k8s.io/cloud-provider-azure
I1021 21:41:20.321] Call:  git init k8s.io/cloud-provider-azure
I1021 21:41:20.324] Initialized empty Git repository in /go/src/k8s.io/cloud-provider-azure/.git/
I1021 21:41:20.325] process 254 exited with code 0 after 0.0m
I1021 21:41:20.325] Call:  git config --local user.name 'K8S Bootstrap'
I1021 21:41:20.327] process 255 exited with code 0 after 0.0m
I1021 21:41:20.327] Call:  git config --local user.email k8s_bootstrap@localhost
I1021 21:41:20.330] process 256 exited with code 0 after 0.0m
I1021 21:41:20.330] Call:  git fetch --quiet --tags https://github.com/kubernetes/cloud-provider-azure master +refs/pull/248/head:refs/pr/248
I1021 21:41:21.690] process 257 exited with code 0 after 0.0m
I1021 21:41:21.691] Call:  git checkout -B test c470e6f36d76e5a565478fcba22118c06bc1548f
W1021 21:41:22.110] Switched to a new branch 'test'
I1021 21:41:22.113] process 269 exited with code 0 after 0.0m
I1021 21:41:22.113] Call:  git show -s --format=format:%ct HEAD
I1021 21:41:22.116] process 270 exited with code 0 after 0.0m
I1021 21:41:22.116] Call:  git merge --no-ff -m 'Merge +refs/pull/248/head:refs/pr/248' 5dd5805d1e39f8239e6d7acb8db36ad0e30e78a0
I1021 21:41:22.237] Merge made by the 'recursive' strategy.
I1021 21:41:22.239]  hack/log-dump/log-dump-daemonset.yaml |  52 +++++++++++++
I1021 21:41:22.239]  hack/log-dump/log-dump.sh             | 140 ++++++++++++++++++++++++++++++++++
I1021 21:41:22.239]  2 files changed, 192 insertions(+)
I1021 21:41:22.239]  create mode 100644 hack/log-dump/log-dump-daemonset.yaml
I1021 21:41:22.239]  create mode 100755 hack/log-dump/log-dump.sh
I1021 21:41:22.240] process 271 exited with code 0 after 0.0m
I1021 21:41:22.240] Configure environment...
I1021 21:41:22.240] Call:  git show -s --format=format:%ct HEAD
I1021 21:41:22.245] process 273 exited with code 0 after 0.0m
I1021 21:41:22.245] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W1021 21:41:22.876] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com]
I1021 21:41:22.987] process 274 exited with code 0 after 0.0m
I1021 21:41:22.987] Call:  gcloud config get-value account
I1021 21:41:23.237] process 286 exited with code 0 after 0.0m
I1021 21:41:23.238] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com
I1021 21:41:23.238] Call:  bash -c '
set -o errexit
set -o nounset
export KUBE_ROOT=.
source hack/lib/version.sh
kube::version::get_version_vars
echo $KUBE_GIT_VERSION
'
I1021 21:41:23.516] process 298 exited with code 0 after 0.0m
I1021 21:41:23.517] Start 1186396794708299776 at v1.16.3-beta.0.16+1cd381987d44f1...
I1021 21:41:23.519] Call:  gsutil -q -h Content-Type:application/json cp /tmp/gsutil_DupDhy gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186396794708299776/started.json
I1021 21:41:25.141] process 331 exited with code 0 after 0.0m
I1021 21:41:25.142] Call:  gsutil -q -h Content-Type:text/plain -h 'x-goog-meta-link: gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186396794708299776' cp /tmp/gsutil_BIY5Id gs://kubernetes-upstream/pr-logs/directory/chewong-e2e-ccm/1186396794708299776.txt
I1021 21:41:26.580] process 509 exited with code 0 after 0.0m
I1021 21:41:26.581] Call:  /workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py --gce-ssh= --test=true --up=true --down=true --deployment=acsengine --provider=skeleton --ginkgo-parallel=30 --test-ccm=True --acsengine-agentpoolcount=1 '--acsengine-admin-username=$AZURE_SSH_USER' --acsengine-creds=/etc/azure-cred/credentials --acsengine-orchestratorRelease=1.16 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_D4s_v3 --acsengine-hyperkube=True --acsengine-ccm=True --acsengine-location=eastus2 --acsengine-public-key=/etc/azure-ssh/azure-ssh-pub --acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json --acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.42.0/aks-engine-v0.42.0-linux-amd64.tar.gz --timeout=420m
W1021 21:41:26.618] starts with local mode
W1021 21:41:26.618] Environment:
W1021 21:41:26.618] ARTIFACTS=/workspace/_artifacts
W1021 21:41:26.618] AWS_SSH_PRIVATE_KEY_FILE=/root/.ssh/kube_aws_rsa
W1021 21:41:26.618] AWS_SSH_PUBLIC_KEY_FILE=/root/.ssh/kube_aws_rsa.pub
W1021 21:41:26.618] AZURE_CREDENTIALS=/etc/azure-cred/credentials
W1021 21:41:26.618] AZURE_SSH_PUBLIC_KEY_FILE=/etc/azure-ssh/azure-ssh-pub
W1021 21:41:26.618] AZ_STORAGE_CONTAINER_NAME=mystoragecontainer
W1021 21:41:26.619] BAZEL_REMOTE_CACHE_ENABLED=false
W1021 21:41:26.619] BAZEL_VERSION=0.23.2
W1021 21:41:26.619] BOOTSTRAP_MIGRATION=yes
W1021 21:41:26.619] BUILD_ID=1186396794708299776
W1021 21:41:26.619] BUILD_NUMBER=1186396794708299776
W1021 21:41:26.619] CLOUDSDK_COMPONENT_MANAGER_DISABLE_UPDATE_CHECK=true
W1021 21:41:26.619] CLOUDSDK_CONFIG=/go/src/k8s.io/kubernetes/.config/gcloud
W1021 21:41:26.619] CLOUDSDK_CORE_DISABLE_PROMPTS=1
W1021 21:41:26.620] CLOUDSDK_EXPERIMENTAL_FAST_COMPONENT_UPDATE=false
W1021 21:41:26.620] CLOUD_CONFIG=random
W1021 21:41:26.620] DECK_PORT=tcp://10.0.160.83:80
W1021 21:41:26.620] DECK_PORT_80_TCP=tcp://10.0.160.83:80
W1021 21:41:26.620] DECK_PORT_80_TCP_ADDR=10.0.160.83
W1021 21:41:26.620] DECK_PORT_80_TCP_PORT=80
W1021 21:41:26.620] DECK_PORT_80_TCP_PROTO=tcp
W1021 21:41:26.620] DECK_SERVICE_HOST=10.0.160.83
W1021 21:41:26.621] DECK_SERVICE_PORT=80
W1021 21:41:26.621] DOCKER_IN_DOCKER_ENABLED=true
W1021 21:41:26.621] DOCKER_IN_DOCKER_IPV6_ENABLED=false
W1021 21:41:26.621] GCS_ARTIFACTS_DIR=gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186396794708299776/artifacts
W1021 21:41:26.621] GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json
W1021 21:41:26.621] GOPATH=/go
W1021 21:41:26.621] GO_TARBALL=go1.12.10.linux-amd64.tar.gz
W1021 21:41:26.622] HOME=/workspace
W1021 21:41:26.622] HOOK_PORT=tcp://10.0.144.133:8888
W1021 21:41:26.622] HOOK_PORT_8888_TCP=tcp://10.0.144.133:8888
W1021 21:41:26.622] HOOK_PORT_8888_TCP_ADDR=10.0.144.133
W1021 21:41:26.622] HOOK_PORT_8888_TCP_PORT=8888
W1021 21:41:26.622] HOOK_PORT_8888_TCP_PROTO=tcp
W1021 21:41:26.622] HOOK_SERVICE_HOST=10.0.144.133
W1021 21:41:26.622] HOOK_SERVICE_PORT=8888
W1021 21:41:26.622] HOSTNAME=4de4de37-f44b-11e9-b3d3-b20db476995a
W1021 21:41:26.623] IMAGE=chewong/kubekins-e2e:v20191021-test-1
W1021 21:41:26.623] INSTANCE_PREFIX=bootstrap-e2e
W1021 21:41:26.623] JENKINS_GCE_SSH_PRIVATE_KEY_FILE=/root/.ssh/google_compute_engine
W1021 21:41:26.623] JENKINS_GCE_SSH_PUBLIC_KEY_FILE=/root/.ssh/google_compute_engine.pub
W1021 21:41:26.623] JOB_NAME=chewong-e2e-ccm
W1021 21:41:26.623] JOB_SPEC={"type":"presubmit","job":"chewong-e2e-ccm","buildid":"1186396794708299776","prowjobid":"4de4de37-f44b-11e9-b3d3-b20db476995a","refs":{"org":"Azure","repo":"kubernetes","repo_link":"https://github.com/Azure/kubernetes","base_ref":"master","base_sha":"b717be8269a4f381ab6c23e711e8924bc1f64c93","base_link":"https://github.com/Azure/kubernetes/commit/b717be8269a4f381ab6c23e711e8924bc1f64c93","pulls":[{"number":113,"author":"chewong","sha":"879465972041635fd7bc8269da49153b67e63822","link":"https://github.com/Azure/kubernetes/pull/113","commit_link":"https://github.com/Azure/kubernetes/pull/113/commits/879465972041635fd7bc8269da49153b67e63822","author_link":"https://github.com/chewong"}]}}
W1021 21:41:26.624] JOB_TYPE=presubmit
W1021 21:41:26.624] KUBERNETES_PORT=tcp://10.0.0.1:443
W1021 21:41:26.624] KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
W1021 21:41:26.624] KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
W1021 21:41:26.624] KUBERNETES_PORT_443_TCP_PORT=443
W1021 21:41:26.624] KUBERNETES_PORT_443_TCP_PROTO=tcp
W1021 21:41:26.625] KUBERNETES_SERVICE_HOST=10.0.0.1
W1021 21:41:26.625] KUBERNETES_SERVICE_PORT=443
W1021 21:41:26.625] KUBERNETES_SERVICE_PORT_HTTPS=443
W1021 21:41:26.625] KUBETEST_IN_DOCKER=true
W1021 21:41:26.625] KUBETEST_MANUAL_DUMP=y
W1021 21:41:26.625] KUBE_AWS_INSTANCE_PREFIX=bootstrap-e2e
W1021 21:41:26.625] KUBE_GCE_INSTANCE_PREFIX=bootstrap-e2e
W1021 21:41:26.626] KUBE_VERBOSE=0
W1021 21:41:26.626] NODE_NAME=4de4de37-f44b-11e9-b3d3-b20db476995a
W1021 21:41:26.626] PATH=/go/bin:/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/workspace:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
W1021 21:41:26.626] PROW_JOB_ID=4de4de37-f44b-11e9-b3d3-b20db476995a
W1021 21:41:26.626] PULL_BASE_REF=master
W1021 21:41:26.626] PULL_BASE_SHA=b717be8269a4f381ab6c23e711e8924bc1f64c93
W1021 21:41:26.626] PULL_NUMBER=113
W1021 21:41:26.627] PULL_PULL_SHA=879465972041635fd7bc8269da49153b67e63822
W1021 21:41:26.627] PULL_REFS=master:b717be8269a4f381ab6c23e711e8924bc1f64c93,113:879465972041635fd7bc8269da49153b67e63822
W1021 21:41:26.627] PWD=/workspace
W1021 21:41:26.627] REGISTRY=k8sprowinternal.azurecr.io
W1021 21:41:26.627] REPO_NAME=kubernetes
W1021 21:41:26.627] REPO_OWNER=Azure
W1021 21:41:26.627] SHLVL=2
W1021 21:41:26.628] SOURCE_DATE_EPOCH=1571647177
W1021 21:41:26.628] TERM=xterm
W1021 21:41:26.628] TIDE_PORT=tcp://10.0.180.53:80
W1021 21:41:26.628] TIDE_PORT_80_TCP=tcp://10.0.180.53:80
W1021 21:41:26.628] TIDE_PORT_80_TCP_ADDR=10.0.180.53
W1021 21:41:26.628] TIDE_PORT_80_TCP_PORT=80
W1021 21:41:26.628] TIDE_PORT_80_TCP_PROTO=tcp
W1021 21:41:26.628] TIDE_SERVICE_HOST=10.0.180.53
W1021 21:41:26.629] TIDE_SERVICE_PORT=80
W1021 21:41:26.629] WORKSPACE=/workspace
W1021 21:41:26.629] _=./test-infra/jenkins/bootstrap.py
W1021 21:41:26.630] Run: ('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=30', '--test-ccm=True', '--acsengine-agentpoolcount=1', '--acsengine-admin-username=$AZURE_SSH_USER', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.16', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_D4s_v3', '--acsengine-hyperkube=True', '--acsengine-ccm=True', '--acsengine-location=eastus2', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json', '--acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.42.0/aks-engine-v0.42.0-linux-amd64.tar.gz', '--timeout=420m')
W1021 21:41:26.632] 2019/10/21 21:41:26 main.go:332: Limiting testing to 7h0m0s
W1021 21:41:26.632] 2019/10/21 21:41:26 azure.go:232: Reading credentials file /etc/azure-cred/credentials
W1021 21:41:26.633] 2019/10/21 21:41:26 azure.go:906: Deleting resource group: kubetest-88cc52da-f44b-11e9-bc2b-024237dc7795.
W1021 21:41:27.139] 2019/10/21 21:41:27 azure.go:654: CWD /go/src/k8s.io/kubernetes
W1021 21:41:27.139] 2019/10/21 21:41:27 azure.go:673: Attempting Docker login with azure cred.
W1021 21:41:28.127] 2019/10/21 21:41:28 azure.go:682: Docker login success.
W1021 21:41:28.127] 2019/10/21 21:41:28 azure.go:697: Building ccm.
W1021 21:41:28.127] 2019/10/21 21:41:28 azure.go:699: projectPath /go/src/k8s.io/cloud-provider-azure
W1021 21:41:28.127] 2019/10/21 21:41:28 process.go:153: Running: docker build -t k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1186396794708299776-89199b85 .
I1021 21:41:29.408] Sending build context to Docker daemon  67.16MB

I1021 21:41:29.439] Step 1/7 : FROM golang:1.12.9-stretch AS build
I1021 21:41:30.337] 1.12.9-stretch: Pulling from library/golang
I1021 21:41:30.695] 092586df9206: Pulling fs layer
I1021 21:41:30.696] ef599477fae0: Pulling fs layer
I1021 21:41:30.696] 4530c6472b5d: Pulling fs layer
I1021 21:41:30.696] d34d61487075: Pulling fs layer
I1021 21:41:30.696] 89c6ec31b9e9: Pulling fs layer
I1021 21:41:30.696] e37857ebcafa: Pulling fs layer
I1021 21:41:30.696] b0e29f6c7f0a: Pulling fs layer
I1021 21:41:30.697] 89c6ec31b9e9: Waiting
I1021 21:41:30.697] e37857ebcafa: Waiting
I1021 21:41:30.697] b0e29f6c7f0a: Waiting
I1021 21:41:30.697] d34d61487075: Waiting
I1021 21:41:31.174] ef599477fae0: Verifying Checksum
I1021 21:41:31.174] ef599477fae0: Download complete
I1021 21:41:31.446] 092586df9206: Verifying Checksum
I1021 21:41:31.447] 092586df9206: Download complete
I1021 21:41:32.021] d34d61487075: Verifying Checksum
I1021 21:41:32.021] d34d61487075: Download complete
I1021 21:41:32.120] 4530c6472b5d: Download complete
I1021 21:41:32.342] 89c6ec31b9e9: Verifying Checksum
I1021 21:41:32.342] 89c6ec31b9e9: Download complete
I1021 21:41:32.491] b0e29f6c7f0a: Download complete
I1021 21:41:33.875] e37857ebcafa: Verifying Checksum
I1021 21:41:33.875] e37857ebcafa: Download complete
I1021 21:41:34.707] 092586df9206: Pull complete
I1021 21:41:35.449] ef599477fae0: Pull complete
I1021 21:41:35.830] 4530c6472b5d: Pull complete
I1021 21:41:39.443] d34d61487075: Pull complete
I1021 21:41:42.912] 89c6ec31b9e9: Pull complete
I1021 21:41:53.057] e37857ebcafa: Pull complete
I1021 21:41:53.215] b0e29f6c7f0a: Pull complete
I1021 21:41:53.239] Digest: sha256:76b52857546f070cc3ac499accb27b8c411b10ff6d45c0b1da2a8aab7b61fe29
I1021 21:41:53.261] Status: Downloaded newer image for golang:1.12.9-stretch
I1021 21:41:53.262]  ---> 2c4a601e5da9
I1021 21:41:53.262] Step 2/7 : WORKDIR /go/src/k8s.io/cloud-provider-azure
I1021 21:42:05.810]  ---> Running in 90b0cf9fcfd6
I1021 21:42:07.031] Removing intermediate container 90b0cf9fcfd6
I1021 21:42:07.031]  ---> 991ea49dcc73
I1021 21:42:07.031] Step 3/7 : COPY . .
I1021 21:42:12.962]  ---> 27c34b0d9e9b
I1021 21:42:12.962] Step 4/7 : RUN make
I1021 21:42:13.180]  ---> Running in 3bcdbc257709
I1021 21:42:14.021] hack/pkg-config.sh > .pkg_config
I1021 21:42:14.049] go build -o bin/azure-cloud-controller-manager -ldflags '-s -w -X k8s.io/cloud-provider-azure/pkg/version.gitVersion=v0.3.0-11-gb6a51653d -X k8s.io/cloud-provider-azure/pkg/version.gitCommit=b6a51653dac907e44dbc7f4d147fa6b8cd50faab -X k8s.io/cloud-provider-azure/pkg/version.buildDate=2019-10-21T21:42:14Z' ./cmd/cloud-controller-manager
I1021 21:42:55.940] go build -o bin/azure-cloud-node-manager -ldflags '-s -w -X k8s.io/cloud-provider-azure/pkg/version.gitVersion=v0.3.0-11-gb6a51653d -X k8s.io/cloud-provider-azure/pkg/version.gitCommit=b6a51653dac907e44dbc7f4d147fa6b8cd50faab -X k8s.io/cloud-provider-azure/pkg/version.buildDate=2019-10-21T21:42:14Z' ./cmd/cloud-node-manager
I1021 21:43:19.485] Removing intermediate container 3bcdbc257709
I1021 21:43:19.486]  ---> c99ebf701b13
I1021 21:43:19.486] Step 5/7 : FROM k8s.gcr.io/debian-base:v1.0.0
I1021 21:43:19.802] v1.0.0: Pulling from debian-base
I1021 21:43:19.969] 39fafc05754f: Pulling fs layer
I1021 21:43:20.376] 39fafc05754f: Verifying Checksum
I1021 21:43:20.377] 39fafc05754f: Download complete
I1021 21:43:22.939] 39fafc05754f: Pull complete
I1021 21:43:22.962] Digest: sha256:3801f944c765dc1b54900826ca67b1380bb8c73b9caf4a2a27ce613b3ba3e742
I1021 21:43:22.981] Status: Downloaded newer image for k8s.gcr.io/debian-base:v1.0.0
I1021 21:43:22.982]  ---> 204e96332c91
I1021 21:43:22.982] Step 6/7 : COPY --from=build /go/src/k8s.io/cloud-provider-azure/bin/azure-cloud-controller-manager /usr/local/bin
I1021 21:43:26.054]  ---> 671f89da17ec
I1021 21:43:26.054] Step 7/7 : RUN ln -s /usr/local/bin/azure-cloud-controller-manager /usr/local/bin/cloud-controller-manager
I1021 21:43:26.195]  ---> Running in d1dc53caf7f0
I1021 21:43:28.064] Removing intermediate container d1dc53caf7f0
I1021 21:43:28.064]  ---> c638291592a3
I1021 21:43:28.174] Successfully built c638291592a3
I1021 21:43:28.305] Successfully tagged k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1186396794708299776-89199b85
W1021 21:43:28.406] 2019/10/21 21:43:28 process.go:155: Step 'docker build -t k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1186396794708299776-89199b85 .' finished in 2m0.181376312s
W1021 21:43:28.406] 2019/10/21 21:43:28 process.go:153: Running: docker push k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1186396794708299776-89199b85
W1021 21:43:37.258] 2019/10/21 21:43:37 process.go:155: Step 'docker push k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1186396794708299776-89199b85' finished in 8.949211642s
W1021 21:43:37.258] 2019/10/21 21:43:37 azure.go:686: Docker logout.
W1021 21:43:37.326] 2019/10/21 21:43:37 azure.go:716: Custom cloud controller manager URL: k8sprowinternal.azurecr.io/azure-cloud-controller-manager:1186396794708299776-89199b85 .
W1021 21:43:37.327] 2019/10/21 21:43:37 azure.go:654: CWD /go/src/k8s.io/kubernetes
W1021 21:43:37.327] 2019/10/21 21:43:37 azure.go:673: Attempting Docker login with azure cred.
W1021 21:43:38.349] 2019/10/21 21:43:38 azure.go:682: Docker login success.
W1021 21:43:38.350] 2019/10/21 21:43:38 azure.go:726: Building hyperkube.
W1021 21:43:38.350] 2019/10/21 21:43:38 process.go:153: Running: make -C /go/src/k8s.io/kubernetes WHAT=cmd/hyperkube
W1021 21:46:25.903] 2019/10/21 21:46:25 process.go:155: Step 'make -C /go/src/k8s.io/kubernetes WHAT=cmd/hyperkube' finished in 2m47.553275403s
W1021 21:46:25.903] 2019/10/21 21:46:25 azure.go:733: Pushing hyperkube.
W1021 21:46:25.903] 2019/10/21 21:46:25 process.go:153: Running: make -C /go/src/k8s.io/kubernetes/cluster/images/hyperkube push HYPERKUBE_BIN=/go/src/k8s.io/kubernetes/_output/bin/hyperkube
I1021 21:46:26.004] make: Entering directory '/go/src/k8s.io/kubernetes/cluster/images/hyperkube'
I1021 21:46:26.004] cp -r ./* /tmp/hyperkubeogkzfE
I1021 21:46:26.004] cp /go/src/k8s.io/kubernetes/_output/bin/hyperkube /tmp/hyperkubeogkzfE
I1021 21:46:26.079] chmod a+rx /tmp/hyperkubeogkzfE/hyperkube
I1021 21:46:26.080] cd /tmp/hyperkubeogkzfE && sed -i.back "s|BASEIMAGE|k8s.gcr.io/debian-hyperkube-base-amd64:0.12.1|g" Dockerfile
I1021 21:46:26.082] docker build --pull -t k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1186396794708299776-d6b29efb /tmp/hyperkubeogkzfE
I1021 21:46:27.282] Sending build context to Docker daemon  212.1MB

I1021 21:46:27.307] Step 1/2 : FROM k8s.gcr.io/debian-hyperkube-base-amd64:0.12.1
I1021 21:46:27.596] 0.12.1: Pulling from debian-hyperkube-base-amd64
I1021 21:46:27.596] 346aee5ea5bc: Pulling fs layer
I1021 21:46:27.596] 9c47fde751af: Pulling fs layer
I1021 21:46:27.597] be2693a52daf: Pulling fs layer
I1021 21:46:27.597] 6b69eb11d043: Pulling fs layer
I1021 21:46:27.597] 0abeb1500767: Pulling fs layer
I1021 21:46:27.597] 4062d80041b7: Pulling fs layer
I1021 21:46:27.597] 23b6daf06fc2: Pulling fs layer
I1021 21:46:27.597] 6b69eb11d043: Waiting
I1021 21:46:27.597] 0abeb1500767: Waiting
I1021 21:46:27.733] 9c47fde751af: Download complete
I1021 21:46:27.762] be2693a52daf: Verifying Checksum
I1021 21:46:27.762] be2693a52daf: Download complete
I1021 21:46:27.867] 6b69eb11d043: Verifying Checksum
I1021 21:46:27.868] 6b69eb11d043: Download complete
I1021 21:46:27.902] 0abeb1500767: Verifying Checksum
I1021 21:46:27.902] 0abeb1500767: Download complete
I1021 21:46:27.961] 346aee5ea5bc: Verifying Checksum
I1021 21:46:27.962] 346aee5ea5bc: Download complete
I1021 21:46:28.320] 23b6daf06fc2: Verifying Checksum
I1021 21:46:28.321] 23b6daf06fc2: Download complete
I1021 21:46:29.064] 4062d80041b7: Verifying Checksum
I1021 21:46:29.064] 4062d80041b7: Download complete
I1021 21:46:31.980] 346aee5ea5bc: Pull complete
I1021 21:46:32.118] 9c47fde751af: Pull complete
I1021 21:46:32.883] be2693a52daf: Pull complete
I1021 21:46:33.020] 6b69eb11d043: Pull complete
I1021 21:46:33.188] 0abeb1500767: Pull complete
I1021 21:46:40.391] 4062d80041b7: Pull complete
I1021 21:46:41.392] 23b6daf06fc2: Pull complete
I1021 21:46:41.420] Digest: sha256:5d4ea2fb5fbe9a9a9da74f67cf2faefc881968bc39f2ac5d62d9167e575812a1
I1021 21:46:41.444] Status: Downloaded newer image for k8s.gcr.io/debian-hyperkube-base-amd64:0.12.1
I1021 21:46:41.445]  ---> a46476511725
I1021 21:46:41.445] Step 2/2 : COPY hyperkube /hyperkube
I1021 21:47:05.493]  ---> c96b6a0aed00
I1021 21:47:05.520] Successfully built c96b6a0aed00
I1021 21:47:05.582] Successfully tagged k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1186396794708299776-d6b29efb
I1021 21:47:05.584] rm -rf "/tmp/hyperkubeogkzfE"
I1021 21:47:05.612] docker push k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1186396794708299776-d6b29efb
I1021 21:47:05.677] The push refers to repository [k8sprowinternal.azurecr.io/hyperkube-amd64]
I1021 21:47:05.689] 5ec01a53133d: Preparing
I1021 21:47:05.689] 39b3ac6d96e9: Preparing
I1021 21:47:05.689] 7bbae4dddb88: Preparing
I1021 21:47:05.689] a00defcfe869: Preparing
I1021 21:47:05.689] 2ab0ae805c74: Preparing
I1021 21:47:05.690] 43a8fe7d2382: Preparing
I1021 21:47:05.690] 3f6a6f542637: Preparing
I1021 21:47:05.690] 5ba3be777c2d: Preparing
I1021 21:47:05.690] 43a8fe7d2382: Waiting
I1021 21:47:05.690] 3f6a6f542637: Waiting
I1021 21:47:05.690] 5ba3be777c2d: Waiting
I1021 21:47:05.915] 39b3ac6d96e9: Layer already exists
I1021 21:47:05.937] 7bbae4dddb88: Layer already exists
I1021 21:47:05.957] 2ab0ae805c74: Layer already exists
I1021 21:47:06.013] 43a8fe7d2382: Layer already exists
I1021 21:47:06.047] 5ba3be777c2d: Layer already exists
I1021 21:47:06.070] 3f6a6f542637: Layer already exists
I1021 21:47:07.715] a00defcfe869: Layer already exists
I1021 21:47:32.923] 5ec01a53133d: Pushed
I1021 21:47:33.950] azure-e2e-1186396794708299776-d6b29efb: digest: sha256:49f12df545814914f6e92a5783cc969432adebfa27ec22465aadd1938d84c058 size: 1998
I1021 21:47:33.961] docker rmi k8sprowinternal.azurecr.io/hyperkube:azure-e2e-1186396794708299776-d6b29efb 2>/dev/null || true
I1021 21:47:34.000] docker tag k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1186396794708299776-d6b29efb k8sprowinternal.azurecr.io/hyperkube:azure-e2e-1186396794708299776-d6b29efb
I1021 21:47:34.063] docker push k8sprowinternal.azurecr.io/hyperkube:azure-e2e-1186396794708299776-d6b29efb
I1021 21:47:34.124] The push refers to repository [k8sprowinternal.azurecr.io/hyperkube]
I1021 21:47:34.137] 5ec01a53133d: Preparing
I1021 21:47:34.137] 39b3ac6d96e9: Preparing
I1021 21:47:34.137] 7bbae4dddb88: Preparing
I1021 21:47:34.137] a00defcfe869: Preparing
I1021 21:47:34.138] 2ab0ae805c74: Preparing
I1021 21:47:34.138] 43a8fe7d2382: Preparing
I1021 21:47:34.138] 3f6a6f542637: Preparing
I1021 21:47:34.138] 5ba3be777c2d: Preparing
I1021 21:47:34.138] 3f6a6f542637: Waiting
I1021 21:47:34.138] 43a8fe7d2382: Waiting
I1021 21:47:34.138] 5ba3be777c2d: Waiting
I1021 21:47:34.235] 39b3ac6d96e9: Layer already exists
I1021 21:47:34.259] 2ab0ae805c74: Layer already exists
I1021 21:47:34.283] a00defcfe869: Layer already exists
I1021 21:47:34.315] 3f6a6f542637: Layer already exists
I1021 21:47:34.339] 7bbae4dddb88: Layer already exists
I1021 21:47:34.360] 43a8fe7d2382: Layer already exists
I1021 21:47:34.367] 5ec01a53133d: Mounted from hyperkube-amd64
I1021 21:47:34.381] 5ba3be777c2d: Layer already exists
I1021 21:47:39.735] azure-e2e-1186396794708299776-d6b29efb: digest: sha256:49f12df545814914f6e92a5783cc969432adebfa27ec22465aadd1938d84c058 size: 1998
I1021 21:47:39.767] make: Leaving directory '/go/src/k8s.io/kubernetes/cluster/images/hyperkube'
W1021 21:47:39.868] 2019/10/21 21:47:39 process.go:155: Step 'make -C /go/src/k8s.io/kubernetes/cluster/images/hyperkube push HYPERKUBE_BIN=/go/src/k8s.io/kubernetes/_output/bin/hyperkube' finished in 1m13.864158767s
W1021 21:47:39.868] 2019/10/21 21:47:39 azure.go:686: Docker logout.
W1021 21:47:39.868] 2019/10/21 21:47:39 azure.go:744: Custom hyperkube URL: k8sprowinternal.azurecr.io/hyperkube-amd64:azure-e2e-1186396794708299776-d6b29efb .
W1021 21:47:39.868] 2019/10/21 21:47:39 azure.go:787: downloading /workspace/aks755164186/kubernetes.json from https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json.
W1021 21:47:39.869] 2019/10/21 21:47:39 util.go:42: curl https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json
W1021 21:47:40.104] 2019/10/21 21:47:40 azure.go:529: downloading /workspace/aks-engine.tar.gz from https://github.com/Azure/aks-engine/releases/download/v0.42.0/aks-engine-v0.42.0-linux-amd64.tar.gz.
W1021 21:47:40.104] 2019/10/21 21:47:40 util.go:42: curl https://github.com/Azure/aks-engine/releases/download/v0.42.0/aks-engine-v0.42.0-linux-amd64.tar.gz
W1021 21:47:41.416] 2019/10/21 21:47:41 azure.go:556: Extracting tar file /workspace/aks-engine.tar.gz into directory /go/src/k8s.io/kubernetes .
W1021 21:47:41.417] 2019/10/21 21:47:41 process.go:153: Running: tar -xzf /workspace/aks-engine.tar.gz --strip 1
W1021 21:47:41.556] 2019/10/21 21:47:41 process.go:155: Step 'tar -xzf /workspace/aks-engine.tar.gz --strip 1' finished in 139.04998ms
W1021 21:47:41.556] 2019/10/21 21:47:41 process.go:153: Running: /go/src/k8s.io/kubernetes/aks-engine generate /workspace/aks755164186/kubernetes.json --output-directory /workspace/aks755164186
I1021 21:47:41.727] INFO[0000] Generating assets into /workspace/aks755164186... 
W1021 21:47:53.598] 2019/10/21 21:47:53 process.go:155: Step '/go/src/k8s.io/kubernetes/aks-engine generate /workspace/aks755164186/kubernetes.json --output-directory /workspace/aks755164186' finished in 12.042566777s
W1021 21:47:53.601] 2019/10/21 21:47:53 azure.go:627: Setting kubeconfig env variable: kubeconfig path: /workspace/aks755164186/kubeconfig/kubeconfig.eastus2.json.
W1021 21:47:53.602] 2019/10/21 21:47:53 azure.go:629: Creating resource group: kubetest-88cc52da-f44b-11e9-bc2b-024237dc7795.
W1021 21:47:53.602] 2019/10/21 21:47:53 azure.go:631: Creating Azure resource group: kubetest-88cc52da-f44b-11e9-bc2b-024237dc7795 for cluster deployment.
W1021 21:47:55.648] 2019/10/21 21:47:55 azure.go:636: Validating deployment ARM templates.
W1021 21:47:57.812] 2019/10/21 21:47:57 azure.go:642: Deploying cluster kubetest-88cc52da-f44b-11e9-bc2b-024237dc7795 in resource group kubetest-88cc52da-f44b-11e9-bc2b-024237dc7795.
W1021 21:50:02.063] 2019/10/21 21:50:02 process.go:153: Running: bash -c ./log-dump.sh
I1021 21:50:02.163] Installing log-dump-daemonset.yaml via kubectl
W1021 21:51:02.127] error: unable to recognize "/go/src/k8s.io/cloud-provider-azure/hack/log-dump/log-dump-daemonset.yaml": Get https://kubetest-88cc52da-f44b-11e9-bc2b-024237dc7795.eastus2.cloudapp.azure.com/api?timeout=32s: dial tcp 104.209.213.106:443: i/o timeout
I1021 21:51:02.228] Uninstalling log-dump-daemonset.yaml via kubectl
W1021 21:51:32.185] error: unable to recognize "/go/src/k8s.io/cloud-provider-azure/hack/log-dump/log-dump-daemonset.yaml": Get https://kubetest-88cc52da-f44b-11e9-bc2b-024237dc7795.eastus2.cloudapp.azure.com/api?timeout=32s: dial tcp 104.209.213.106:443: i/o timeout
W1021 21:51:32.187] 2019/10/21 21:51:32 process.go:155: Step 'bash -c ./log-dump.sh' finished in 1m30.123998736s
W1021 21:51:32.187] 2019/10/21 21:51:32 azure.go:906: Deleting resource group: kubetest-88cc52da-f44b-11e9-bc2b-024237dc7795.
W1021 21:57:53.787] 2019/10/21 21:57:53 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml.
W1021 21:57:53.787] 2019/10/21 21:57:53 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"
W1021 21:57:53.948] 2019/10/21 21:57:53 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 160.394938ms
W1021 21:57:53.948] 2019/10/21 21:57:53 main.go:319: Something went wrong: starting e2e cluster: error creating cluster: cannot deploy: cannot get the create deployment future response: Code="DeploymentFailed" Message="At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-debug for usage details." Details=[{"code":"BadRequest","message":"{\r\n  \"error\": {\r\n    \"code\": \"InvalidParameter\",\r\n    \"message\": \"The value of parameter linuxConfiguration.ssh.publicKeys.path is invalid.\",\r\n    \"target\": \"linuxConfiguration.ssh.publicKeys.path\"\r\n  }\r\n}"},{"code":"BadRequest","message":"{\r\n  \"error\": {\r\n    \"code\": \"InvalidParameter\",\r\n    \"message\": \"The value of parameter linuxConfiguration.ssh.publicKeys.path is invalid.\",\r\n    \"target\": \"linuxConfiguration.ssh.publicKeys.path\"\r\n  }\r\n}"}]
W1021 21:57:53.950] Traceback (most recent call last):
W1021 21:57:53.950]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module>
W1021 21:57:53.950]     main(parse_args())
W1021 21:57:53.951]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main
W1021 21:57:53.951]     mode.start(runner_args)
W1021 21:57:53.951]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start
W1021 21:57:53.951]     check_env(env, self.command, *args)
W1021 21:57:53.951]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env
W1021 21:57:53.951]     subprocess.check_call(cmd, env=env)
W1021 21:57:53.952]   File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
W1021 21:57:53.952]     raise CalledProcessError(retcode, cmd)
W1021 21:57:53.952] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=30', '--test-ccm=True', '--acsengine-agentpoolcount=1', '--acsengine-admin-username=$AZURE_SSH_USER', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.16', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_D4s_v3', '--acsengine-hyperkube=True', '--acsengine-ccm=True', '--acsengine-location=eastus2', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://raw.githubusercontent.com/kubernetes/cloud-provider-azure/master/tests/k8s-azure/manifest/linux.json', '--acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.42.0/aks-engine-v0.42.0-linux-amd64.tar.gz', '--timeout=420m')' returned non-zero exit status 1
E1021 21:57:53.957] Command failed
I1021 21:57:53.957] process 687 exited with code 1 after 16.5m
E1021 21:57:53.957] FAIL: chewong-e2e-ccm
I1021 21:57:53.957] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W1021 21:57:54.518] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com]
I1021 21:57:54.550] process 29153 exited with code 0 after 0.0m
I1021 21:57:54.550] Call:  gcloud config get-value account
I1021 21:57:54.806] process 29165 exited with code 0 after 0.0m
I1021 21:57:54.806] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com
I1021 21:57:54.806] Upload result and artifacts...
I1021 21:57:54.806] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186396794708299776
I1021 21:57:54.806] Call:  gsutil ls gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186396794708299776/artifacts
W1021 21:57:55.814] CommandException: One or more URLs matched no objects.
E1021 21:57:55.895] Command failed
I1021 21:57:55.895] process 29177 exited with code 1 after 0.0m
W1021 21:57:55.895] Remote dir gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186396794708299776/artifacts not exist yet
I1021 21:57:55.895] Call:  gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186396794708299776/artifacts
I1021 21:57:57.532] process 29319 exited with code 0 after 0.0m
I1021 21:57:57.533] Call:  git rev-parse HEAD
I1021 21:57:57.535] process 29843 exited with code 0 after 0.0m
I1021 21:57:57.536] Call:  git rev-parse HEAD
I1021 21:57:57.538] process 29844 exited with code 0 after 0.0m
I1021 21:57:57.538] Call:  gsutil stat gs://kubernetes-upstream/pr-logs/directory/chewong-e2e-ccm/jobResultsCache.json
I1021 21:57:58.528] process 29845 exited with code 0 after 0.0m
I1021 21:57:58.529] Call:  gsutil -q cat 'gs://kubernetes-upstream/pr-logs/directory/chewong-e2e-ccm/jobResultsCache.json#1571693235720573'
I1021 21:57:59.939] process 29987 exited with code 0 after 0.0m
I1021 21:57:59.940] Call:  gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1571693235720573 cp /tmp/gsutil_78fW6X gs://kubernetes-upstream/pr-logs/directory/chewong-e2e-ccm/jobResultsCache.json
I1021 21:58:01.310] process 30131 exited with code 0 after 0.0m
I1021 21:58:01.310] Call:  gsutil stat gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/jobResultsCache.json
I1021 21:58:02.314] process 30309 exited with code 0 after 0.0m
I1021 21:58:02.314] Call:  gsutil -q cat 'gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/jobResultsCache.json#1571693239263134'
I1021 21:58:03.585] process 30451 exited with code 0 after 0.0m
I1021 21:58:03.586] Call:  gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1571693239263134 cp /tmp/gsutil_BxF6j0 gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/jobResultsCache.json
I1021 21:58:04.987] process 30595 exited with code 0 after 0.0m
I1021 21:58:04.988] Call:  gsutil -q -h Content-Type:application/json cp /tmp/gsutil_2SVTzd gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/1186396794708299776/finished.json
I1021 21:58:06.408] process 30773 exited with code 0 after 0.0m
I1021 21:58:06.409] Call:  gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_63XcQc gs://kubernetes-upstream/pr-logs/directory/chewong-e2e-ccm/latest-build.txt
I1021 21:58:07.801] process 30951 exited with code 0 after 0.0m
I1021 21:58:07.801] Call:  gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_6KlvxB gs://kubernetes-upstream/pr-logs/pull/cloud-provider-azure/248/chewong-e2e-ccm/latest-build.txt
I1021 21:58:09.200] process 31129 exited with code 0 after 0.0m