W1105 22:59:02.044] ************************************************************************** bootstrap.py is deprecated! test-infra oncall does not support any job still using bootstrap.py. Please migrate your job to podutils! https://github.com/kubernetes/test-infra/blob/master/prow/pod-utilities.md ************************************************************************** I1105 22:59:02.045] Args: --job=chewong-pull-azuredisk-csi-driver-e2e-multi-az --service-account=/etc/service-account/service-account.json --upload=gs://kubernetes-jenkins/logs --job=chewong-pull-azuredisk-csi-driver-e2e-multi-az --root=/go/src --service-account=/etc/service-account/service-account.json --repo=k8s.io/kubernetes=master --repo=sigs.k8s.io/azuredisk-csi-driver=master:b7c03af8eae7388e84115ace30cf2ff3285b0dc9,180:3d974a552d3f3a8ed615de3a6a819edc818404e4 --upload=gs://kubernetes-upstream/pr-logs --timeout=460 --scenario=kubernetes_e2e -- --gce-ssh= --test=true --up=true --down=true --deployment=acsengine --build=bazel --provider=skeleton --ginkgo-parallel=1 --acsengine-agentpoolcount=2 --acsengine-admin-username=azureuser '--acsengine-creds=$AZURE_CREDENTIALS' --acsengine-orchestratorRelease=1.16 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_D4s_v3 --acsengine-location=eastus2 '--acsengine-public-key=$AZURE_SSH_PUBLIC_KEY_FILE' --acsengine-template-url=https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/da4b9f5e9696ab00a5b1ac08606218f9f352d324/tests/k8s-azure/manifest/linux-vmss-multi-zones.json --acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz --test-azure-disk-csi-driver=True '--test_args=--ginkgo.focus=\[multi-az\]' --timeout=420m I1105 22:59:02.045] Bootstrap chewong-pull-azuredisk-csi-driver-e2e-multi-az... I1105 22:59:02.048] Builder: c9b9dbb4-001f-11ea-918b-16773c0c7aed I1105 22:59:02.048] Image: chewong/kubekins-e2e:v20191105-test-2 I1105 22:59:02.048] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191852367847362560 I1105 22:59:02.049] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1105 22:59:02.564] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I1105 22:59:02.596] process 192 exited with code 0 after 0.0m I1105 22:59:02.596] Call: gcloud config get-value account I1105 22:59:02.842] process 204 exited with code 0 after 0.0m I1105 22:59:02.842] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I1105 22:59:02.842] Root: /go/src I1105 22:59:02.842] cd to /go/src I1105 22:59:02.843] Checkout: /go/src/k8s.io/kubernetes master to /go/src/k8s.io/kubernetes I1105 22:59:02.843] Call: git init k8s.io/kubernetes I1105 22:59:02.846] Initialized empty Git repository in /go/src/k8s.io/kubernetes/.git/ I1105 22:59:02.847] process 216 exited with code 0 after 0.0m I1105 22:59:02.847] Call: git config --local user.name 'K8S Bootstrap' I1105 22:59:02.849] process 217 exited with code 0 after 0.0m I1105 22:59:02.850] Call: git config --local user.email k8s_bootstrap@localhost I1105 22:59:02.852] process 218 exited with code 0 after 0.0m I1105 22:59:02.852] Call: git fetch --quiet --tags https://github.com/kubernetes/kubernetes master I1105 23:00:01.346] process 219 exited with code 0 after 1.0m I1105 23:00:01.347] Call: git checkout -B test FETCH_HEAD W1105 23:00:03.586] Switched to a new branch 'test' I1105 23:00:03.596] process 230 exited with code 0 after 0.0m I1105 23:00:03.597] Call: git show -s --format=format:%ct HEAD I1105 23:00:03.602] process 231 exited with code 0 after 0.0m I1105 23:00:03.602] Checkout: /go/src/sigs.k8s.io/azuredisk-csi-driver master:b7c03af8eae7388e84115ace30cf2ff3285b0dc9,180:3d974a552d3f3a8ed615de3a6a819edc818404e4 to /go/src/sigs.k8s.io/azuredisk-csi-driver I1105 23:00:03.603] Call: git init sigs.k8s.io/azuredisk-csi-driver I1105 23:00:03.607] Initialized empty Git repository in /go/src/sigs.k8s.io/azuredisk-csi-driver/.git/ I1105 23:00:03.607] process 232 exited with code 0 after 0.0m I1105 23:00:03.607] Call: git config --local user.name 'K8S Bootstrap' I1105 23:00:03.610] process 233 exited with code 0 after 0.0m I1105 23:00:03.610] Call: git config --local user.email k8s_bootstrap@localhost I1105 23:00:03.613] process 234 exited with code 0 after 0.0m I1105 23:00:03.613] Call: git fetch --quiet --tags https://github.com/kubernetes-sigs/azuredisk-csi-driver master +refs/pull/180/head:refs/pr/180 I1105 23:00:10.320] process 235 exited with code 0 after 0.1m I1105 23:00:10.321] Call: git checkout -B test b7c03af8eae7388e84115ace30cf2ff3285b0dc9 W1105 23:00:10.890] Switched to a new branch 'test' I1105 23:00:10.894] process 246 exited with code 0 after 0.0m I1105 23:00:10.894] Call: git show -s --format=format:%ct HEAD I1105 23:00:10.897] process 247 exited with code 0 after 0.0m I1105 23:00:10.897] Call: git merge --no-ff -m 'Merge +refs/pull/180/head:refs/pr/180' 3d974a552d3f3a8ed615de3a6a819edc818404e4 I1105 23:00:11.652] Merge made by the 'recursive' strategy. I1105 23:00:11.655] .../templates/csi-azuredisk-controller.yaml | 5 +- I1105 23:00:11.655] deploy/csi-azuredisk-controller.yaml | 3 +- I1105 23:00:11.655] .../storageclass-azuredisk-csi-topology.yaml | 17 +++ I1105 23:00:11.656] pkg/azuredisk/azuredisk.go | 1 + I1105 23:00:11.656] pkg/azuredisk/identityserver.go | 7 ++ I1105 23:00:11.656] pkg/azuredisk/nodeserver.go | 23 +++- I1105 23:00:11.656] test/e2e/driver/azuredisk_csi_driver.go | 20 ++- I1105 23:00:11.656] test/e2e/dynamic_provisioning.go | 134 +++++++++++++++------ I1105 23:00:11.656] ...ynamically_provisioned_reclaim_policy_tester.go | 4 + I1105 23:00:11.656] test/e2e/testsuites/specs.go | 6 +- I1105 23:00:11.657] test/e2e/testsuites/testsuites.go | 8 ++ I1105 23:00:11.657] 11 files changed, 179 insertions(+), 49 deletions(-) I1105 23:00:11.657] create mode 100644 deploy/example/storageclass-azuredisk-csi-topology.yaml I1105 23:00:11.657] process 248 exited with code 0 after 0.0m I1105 23:00:11.657] Configure environment... I1105 23:00:11.657] Call: git show -s --format=format:%ct HEAD I1105 23:00:11.663] process 264 exited with code 0 after 0.0m I1105 23:00:11.663] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1105 23:00:12.262] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I1105 23:00:12.368] process 265 exited with code 0 after 0.0m I1105 23:00:12.369] Call: gcloud config get-value account I1105 23:00:12.612] process 277 exited with code 0 after 0.0m I1105 23:00:12.613] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I1105 23:00:12.613] Call: bash -c ' set -o errexit set -o nounset export KUBE_ROOT=. source hack/lib/version.sh kube::version::get_version_vars echo $KUBE_GIT_VERSION ' I1105 23:00:13.209] process 289 exited with code 0 after 0.0m I1105 23:00:13.209] Start 1191852367847362560 at v1.18.0-alpha.0.273+75aca1fe03763d... I1105 23:00:13.211] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_c52ZFZ gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191852367847362560/started.json I1105 23:00:14.646] process 322 exited with code 0 after 0.0m I1105 23:00:14.646] Call: gsutil -q -h Content-Type:text/plain -h 'x-goog-meta-link: gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191852367847362560' cp /tmp/gsutil_dgc15x gs://kubernetes-upstream/pr-logs/directory/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191852367847362560.txt I1105 23:00:15.870] process 502 exited with code 0 after 0.0m I1105 23:00:15.871] Call: /workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py --gce-ssh= --test=true --up=true --down=true --deployment=acsengine --build=bazel --provider=skeleton --ginkgo-parallel=1 --acsengine-agentpoolcount=2 --acsengine-admin-username=azureuser --acsengine-creds=/etc/azure-cred/credentials --acsengine-orchestratorRelease=1.16 --acsengine-mastervmsize=Standard_DS2_v2 --acsengine-agentvmsize=Standard_D4s_v3 --acsengine-location=eastus2 --acsengine-public-key=/etc/azure-ssh/azure-ssh-pub --acsengine-template-url=https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/da4b9f5e9696ab00a5b1ac08606218f9f352d324/tests/k8s-azure/manifest/linux-vmss-multi-zones.json --acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz --test-azure-disk-csi-driver=True '--test_args=--ginkgo.focus=\[multi-az\]' --timeout=420m W1105 23:00:15.910] starts with local mode W1105 23:00:15.910] Environment: W1105 23:00:15.910] ARTIFACTS=/workspace/_artifacts W1105 23:00:15.910] AWS_SSH_PRIVATE_KEY_FILE=/root/.ssh/kube_aws_rsa W1105 23:00:15.911] AWS_SSH_PUBLIC_KEY_FILE=/root/.ssh/kube_aws_rsa.pub W1105 23:00:15.911] AZURE_CREDENTIALS=/etc/azure-cred/credentials W1105 23:00:15.911] AZURE_SSH_PUBLIC_KEY_FILE=/etc/azure-ssh/azure-ssh-pub W1105 23:00:15.911] AZ_STORAGE_CONTAINER_NAME=mystoragecontainer W1105 23:00:15.911] BAZEL_REMOTE_CACHE_ENABLED=false W1105 23:00:15.911] BAZEL_VERSION=0.23.2 W1105 23:00:15.911] BOOTSTRAP_MIGRATION=yes W1105 23:00:15.911] BUILD_ID=1191852367847362560 W1105 23:00:15.911] BUILD_NUMBER=1191852367847362560 W1105 23:00:15.911] CLOUDSDK_COMPONENT_MANAGER_DISABLE_UPDATE_CHECK=true W1105 23:00:15.912] CLOUDSDK_CONFIG=/go/src/k8s.io/kubernetes/.config/gcloud W1105 23:00:15.912] CLOUDSDK_CORE_DISABLE_PROMPTS=1 W1105 23:00:15.912] CLOUDSDK_EXPERIMENTAL_FAST_COMPONENT_UPDATE=false W1105 23:00:15.912] CLOUD_CONFIG=random W1105 23:00:15.912] DECK_PORT=tcp://10.0.160.83:80 W1105 23:00:15.912] DECK_PORT_80_TCP=tcp://10.0.160.83:80 W1105 23:00:15.912] DECK_PORT_80_TCP_ADDR=10.0.160.83 W1105 23:00:15.912] DECK_PORT_80_TCP_PORT=80 W1105 23:00:15.912] DECK_PORT_80_TCP_PROTO=tcp W1105 23:00:15.912] DECK_SERVICE_HOST=10.0.160.83 W1105 23:00:15.913] DECK_SERVICE_PORT=80 W1105 23:00:15.913] DOCKER_IN_DOCKER_ENABLED=true W1105 23:00:15.913] DOCKER_IN_DOCKER_IPV6_ENABLED=false W1105 23:00:15.913] GCS_ARTIFACTS_DIR=gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191852367847362560/artifacts W1105 23:00:15.913] GOOGLE_APPLICATION_CREDENTIALS=/etc/service-account/service-account.json W1105 23:00:15.913] GOPATH=/go W1105 23:00:15.913] GO_TARBALL=go1.12.10.linux-amd64.tar.gz W1105 23:00:15.913] HOME=/workspace W1105 23:00:15.913] HOOK_PORT=tcp://10.0.144.133:8888 W1105 23:00:15.914] HOOK_PORT_8888_TCP=tcp://10.0.144.133:8888 W1105 23:00:15.914] HOOK_PORT_8888_TCP_ADDR=10.0.144.133 W1105 23:00:15.914] HOOK_PORT_8888_TCP_PORT=8888 W1105 23:00:15.914] HOOK_PORT_8888_TCP_PROTO=tcp W1105 23:00:15.914] HOOK_SERVICE_HOST=10.0.144.133 W1105 23:00:15.914] HOOK_SERVICE_PORT=8888 W1105 23:00:15.914] HOSTNAME=c9b9dbb4-001f-11ea-918b-16773c0c7aed W1105 23:00:15.914] IMAGE=chewong/kubekins-e2e:v20191105-test-2 W1105 23:00:15.914] INSTANCE_PREFIX=bootstrap-e2e W1105 23:00:15.914] JENKINS_GCE_SSH_PRIVATE_KEY_FILE=/root/.ssh/google_compute_engine W1105 23:00:15.915] JENKINS_GCE_SSH_PUBLIC_KEY_FILE=/root/.ssh/google_compute_engine.pub W1105 23:00:15.915] JOB_NAME=chewong-pull-azuredisk-csi-driver-e2e-multi-az W1105 23:00:15.915] JOB_SPEC={"type":"presubmit","job":"chewong-pull-azuredisk-csi-driver-e2e-multi-az","buildid":"1191852367847362560","prowjobid":"c9b9dbb4-001f-11ea-918b-16773c0c7aed","refs":{"org":"Azure","repo":"kubernetes","repo_link":"https://github.com/Azure/kubernetes","base_ref":"master","base_sha":"75aca1fe03763db8f02bc3b2ec1f0b630fa08ac6","base_link":"https://github.com/Azure/kubernetes/commit/75aca1fe03763db8f02bc3b2ec1f0b630fa08ac6","pulls":[{"number":113,"author":"chewong","sha":"879465972041635fd7bc8269da49153b67e63822","link":"https://github.com/Azure/kubernetes/pull/113","commit_link":"https://github.com/Azure/kubernetes/pull/113/commits/879465972041635fd7bc8269da49153b67e63822","author_link":"https://github.com/chewong"}]}} W1105 23:00:15.915] JOB_TYPE=presubmit W1105 23:00:15.915] KUBERNETES_PORT=tcp://10.0.0.1:443 W1105 23:00:15.915] KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443 W1105 23:00:15.916] KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1 W1105 23:00:15.916] KUBERNETES_PORT_443_TCP_PORT=443 W1105 23:00:15.916] KUBERNETES_PORT_443_TCP_PROTO=tcp W1105 23:00:15.916] KUBERNETES_SERVICE_HOST=10.0.0.1 W1105 23:00:15.916] KUBERNETES_SERVICE_PORT=443 W1105 23:00:15.916] KUBERNETES_SERVICE_PORT_HTTPS=443 W1105 23:00:15.916] KUBETEST_IN_DOCKER=true W1105 23:00:15.916] KUBETEST_MANUAL_DUMP=y W1105 23:00:15.916] KUBE_AWS_INSTANCE_PREFIX=bootstrap-e2e W1105 23:00:15.916] KUBE_GCE_INSTANCE_PREFIX=bootstrap-e2e W1105 23:00:15.917] KUBE_SSH_KEY_PATH=/etc/ssh-key-secret/ssh-private W1105 23:00:15.917] KUBE_SSH_PUBLIC_KEY_PATH=/etc/ssh-key-secret/ssh-public W1105 23:00:15.917] KUBE_SSH_USER=azureuser W1105 23:00:15.917] KUBE_VERBOSE=0 W1105 23:00:15.917] NODE_NAME=c9b9dbb4-001f-11ea-918b-16773c0c7aed W1105 23:00:15.917] PATH=/go/bin:/go/bin:/usr/local/go/bin:/google-cloud-sdk/bin:/workspace:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin W1105 23:00:15.917] PROW_JOB_ID=c9b9dbb4-001f-11ea-918b-16773c0c7aed W1105 23:00:15.917] PULL_BASE_REF=master W1105 23:00:15.917] PULL_BASE_SHA=75aca1fe03763db8f02bc3b2ec1f0b630fa08ac6 W1105 23:00:15.917] PULL_NUMBER=113 W1105 23:00:15.918] PULL_PULL_SHA=879465972041635fd7bc8269da49153b67e63822 W1105 23:00:15.918] PULL_REFS=master:75aca1fe03763db8f02bc3b2ec1f0b630fa08ac6,113:879465972041635fd7bc8269da49153b67e63822 W1105 23:00:15.918] PWD=/workspace W1105 23:00:15.918] REGISTRY=k8sprowinternal.azurecr.io W1105 23:00:15.918] REPO_NAME=kubernetes W1105 23:00:15.918] REPO_OWNER=Azure W1105 23:00:15.918] SHLVL=2 W1105 23:00:15.918] SOURCE_DATE_EPOCH=1572983111 W1105 23:00:15.918] TERM=xterm W1105 23:00:15.918] TIDE_PORT=tcp://10.0.180.53:80 W1105 23:00:15.919] TIDE_PORT_80_TCP=tcp://10.0.180.53:80 W1105 23:00:15.919] TIDE_PORT_80_TCP_ADDR=10.0.180.53 W1105 23:00:15.919] TIDE_PORT_80_TCP_PORT=80 W1105 23:00:15.919] TIDE_PORT_80_TCP_PROTO=tcp W1105 23:00:15.919] TIDE_SERVICE_HOST=10.0.180.53 W1105 23:00:15.919] TIDE_SERVICE_PORT=80 W1105 23:00:15.919] WORKSPACE=/workspace W1105 23:00:15.919] _=./test-infra/jenkins/bootstrap.py W1105 23:00:15.920] Run: ('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=1', '--acsengine-agentpoolcount=2', '--acsengine-admin-username=azureuser', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.16', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_D4s_v3', '--acsengine-location=eastus2', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/da4b9f5e9696ab00a5b1ac08606218f9f352d324/tests/k8s-azure/manifest/linux-vmss-multi-zones.json', '--acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz', '--test-azure-disk-csi-driver=True', '--test_args=--ginkgo.focus=\\[multi-az\\]', '--timeout=420m') W1105 23:00:15.933] 2019/11/05 23:00:15 main.go:332: Limiting testing to 7h0m0s W1105 23:00:15.934] 2019/11/05 23:00:15 azure.go:232: Reading credentials file /etc/azure-cred/credentials W1105 23:00:15.934] 2019/11/05 23:00:15 process.go:153: Running: make -C /go/src/k8s.io/kubernetes bazel-release W1105 23:00:15.998] Extracting Bazel installation... I1105 23:00:16.099] make: Entering directory '/go/src/k8s.io/kubernetes' W1105 23:00:24.411] Starting local Bazel server and connecting to it... W1105 23:00:26.112] Loading: W1105 23:00:26.115] Loading: 0 packages loaded W1105 23:00:27.118] Loading: 0 packages loaded W1105 23:00:28.735] Loading: 0 packages loaded W1105 23:00:30.119] Loading: 0 packages loaded W1105 23:00:32.390] Loading: 0 packages loaded W1105 23:00:34.121] Loading: 0 packages loaded W1105 23:00:34.121] currently loading: build/release-tars W1105 23:00:35.786] Loading: 0 packages loaded W1105 23:00:35.786] currently loading: build/release-tars W1105 23:00:36.090] Analyzing: target //build/release-tars:release-tars (1 packages loaded, 0 targets configured) W1105 23:00:37.607] Analyzing: target //build/release-tars:release-tars (150 packages loaded, 750 targets configured) W1105 23:00:39.356] Analyzing: target //build/release-tars:release-tars (1095 packages loaded, 4139 targets configured) W1105 23:00:41.364] Analyzing: target //build/release-tars:release-tars (1870 packages loaded, 12121 targets configured) W1105 23:00:43.682] Analyzing: target //build/release-tars:release-tars (2717 packages loaded, 22778 targets configured) W1105 23:00:47.422] Analyzing: target //build/release-tars:release-tars (3059 packages loaded, 27338 targets configured) W1105 23:00:52.295] Analyzing: target //build/release-tars:release-tars (3098 packages loaded, 34116 targets configured) W1105 23:00:56.477] Analyzing: target //build/release-tars:release-tars (3104 packages loaded, 35716 targets configured) W1105 23:01:02.852] INFO: Analysed target //build/release-tars:release-tars (3104 packages loaded, 36821 targets configured). W1105 23:01:02.855] Building: checking cached actions W1105 23:01:02.855] INFO: Found 1 target... W1105 23:01:03.098] [0 / 10] [-----] BazelWorkspaceStatusAction stable-status.txt W1105 23:01:08.671] [104 / 4,429] GoCompilePkg vendor/github.com/magiconair/properties/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/magiconair/properties.a; 0s linux-sandbox ... (8 actions, 7 running) W1105 23:01:16.525] [140 / 4,429] GoCompilePkg vendor/golang.org/x/net/bpf/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/golang.org/x/net/bpf.a; 3s linux-sandbox ... (8 actions, 7 running) W1105 23:01:25.182] [192 / 4,429] GoCompilePkg vendor/github.com/daviddengcn/go-colortext/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/daviddengcn/go-colortext.a; 4s linux-sandbox ... (8 actions running) W1105 23:01:34.063] [258 / 4,429] GoCompilePkg vendor/golang.org/x/crypto/cryptobyte/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/golang.org/x/crypto/cryptobyte.a; 2s linux-sandbox ... (8 actions running) W1105 23:01:44.279] [338 / 4,429] GoCompilePkg vendor/gopkg.in/square/go-jose.v2/jwt/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/gopkg.in/square/go-jose.v2/jwt.a; 2s linux-sandbox ... (8 actions running) W1105 23:01:57.143] [444 / 4,429] GoCompilePkg vendor/github.com/gogo/protobuf/proto/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/gogo/protobuf/proto.a; 3s linux-sandbox ... (8 actions, 7 running) W1105 23:02:12.636] [506 / 4,429] GoCompilePkg vendor/github.com/mindprince/gonvml/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/mindprince/gonvml.a; 2s linux-sandbox ... (8 actions running) W1105 23:02:28.648] [595 / 4,429] GoCompilePkg vendor/github.com/vmware/govmomi/vim25/types/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/vmware/govmomi/vim25/types.a; 5s linux-sandbox ... (8 actions running) W1105 23:02:48.390] [748 / 4,429] GoCompilePkg vendor/github.com/Azure/go-autorest/autorest/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/Azure/go-autorest/autorest.a; 2s linux-sandbox ... (8 actions, 7 running) W1105 23:03:09.755] [957 / 4,429] GoCompilePkg vendor/github.com/heketi/heketi/client/api/go-client/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/heketi/heketi/client/api/go-client.a; 1s linux-sandbox ... (8 actions, 7 running) W1105 23:03:34.379] [1,079 / 4,429] GoStdlib external/io_bazel_rules_go/linux_amd64_pure_stripped/stdlib%/pkg; 23s linux-sandbox ... (4 actions, 3 running) W1105 23:04:02.952] [1,168 / 4,429] ; 15s linux-sandbox ... (7 actions, 6 running) W1105 23:04:35.591] [1,318 / 4,429] GoCompilePkg vendor/github.com/vmware/govmomi/vim25/types/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/vmware/govmomi/vim25/types.a; 16s linux-sandbox ... (8 actions running) W1105 23:05:13.900] [1,565 / 4,429] GoCompilePkg vendor/github.com/golang/protobuf/proto/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/golang/protobuf/proto.a; 3s linux-sandbox ... (8 actions running) W1105 23:05:57.091] [1,927 / 4,429] GoCompilePkg vendor/github.com/GoogleCloudPlatform/k8s-cloud-provider/pkg/cloud/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/github.com/GoogleCloudPlatform/k8s-cloud-provider/pkg/cloud.a; 6s linux-sandbox ... (8 actions running) W1105 23:06:46.760] [2,241 / 4,429] GoCompilePkg staging/src/k8s.io/apiextensions-apiserver/pkg/generated/openapi/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/apiextensions-apiserver/pkg/generated/openapi.a; 9s linux-sandbox ... (8 actions, 7 running) W1105 23:07:43.945] [2,701 / 4,429] GoCompilePkg staging/src/k8s.io/client-go/tools/cache/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/client-go/tools/cache.a; 1s linux-sandbox ... (8 actions, 7 running) W1105 23:08:49.760] [3,056 / 4,429] GoCompilePkg staging/src/k8s.io/kubectl/pkg/describe/versioned/linux_amd64_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/describe/versioned.a; 2s linux-sandbox ... (8 actions, 7 running) W1105 23:10:05.380] [3,431 / 4,429] GoCompilePkg staging/src/k8s.io/apiextensions-apiserver/pkg/registry/customresource/linux_amd64_pure_stripped/go_default_library%/k8s.io/kubernetes/vendor/k8s.io/apiextensions-apiserver/pkg/registry/customresource.a; 0s linux-sandbox ... (8 actions, 7 running) W1105 23:11:32.853] [3,807 / 4,429] GoLink cmd/kubectl/linux_amd64_pure_stripped/kubectl; 6s linux-sandbox ... (8 actions, 7 running) W1105 23:13:13.289] [4,191 / 4,429] GoLink cmd/kube-controller-manager/linux_amd64_pure_stripped/kube-controller-manager; 25s linux-sandbox ... (8 actions, 7 running) W1105 23:15:14.526] [4,416 / 4,429] GoLink cmd/genkubedocs/genkubedocs; 49s linux-sandbox ... (7 actions, 5 running) W1105 23:15:14.530] [4,416 / 4,429] GoLink cmd/genkubedocs/genkubedocs; 49s linux-sandbox ... (7 actions, 5 running) W1105 23:17:19.592] Slow read: a 297910543-byte read from /workspace/.cache/bazel/_bazel_root/48d5366022b4e3197674c8d6e2bee219/execroot/io_k8s_kubernetes/bazel-out/k8-fastbuild/bin/cmd/genkubedocs/genkubedocs took 38465 ms. W1105 23:17:35.363] [4,426 / 4,429] PackageTar build/release-tars/kubernetes-server-linux-amd64.tar.gz; 93s linux-sandbox ... (2 actions running) W1105 23:17:48.722] Target //build/release-tars:release-tars up-to-date: W1105 23:17:48.722] bazel-bin/build/release-tars/kubernetes-client-linux-amd64.tar.gz W1105 23:17:48.723] bazel-bin/build/release-tars/kubernetes-node-linux-amd64.tar.gz W1105 23:17:48.723] bazel-bin/build/release-tars/kubernetes-server-linux-amd64.tar.gz W1105 23:17:48.723] bazel-bin/build/release-tars/kubernetes-manifests.tar.gz W1105 23:17:48.724] bazel-bin/build/release-tars/kubernetes-test-portable.tar.gz W1105 23:17:48.724] bazel-bin/build/release-tars/kubernetes-test-linux-amd64.tar.gz W1105 23:17:48.724] bazel-bin/build/release-tars/kubernetes.tar.gz W1105 23:17:48.724] bazel-bin/build/release-tars/kubernetes-src.tar.gz W1105 23:17:48.756] INFO: Elapsed time: 1052.738s, Critical Path: 356.40s W1105 23:17:48.756] INFO: 4364 processes: 4364 linux-sandbox. W1105 23:17:48.761] INFO: Build completed successfully, 4429 total actions W1105 23:17:48.762] INFO: Build completed successfully, 4429 total actions W1105 23:17:48.770] 2019/11/05 23:17:48 process.go:155: Step 'make -C /go/src/k8s.io/kubernetes bazel-release' finished in 17m32.836206271s W1105 23:17:48.771] 2019/11/05 23:17:48 util.go:265: Flushing memory. I1105 23:17:48.871] make: Leaving directory '/go/src/k8s.io/kubernetes' W1105 23:18:13.133] 2019/11/05 23:18:13 azure.go:906: Deleting resource group: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973. W1105 23:18:13.629] 2019/11/05 23:18:13 azure.go:787: downloading /workspace/aks761846597/kubernetes.json from https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/da4b9f5e9696ab00a5b1ac08606218f9f352d324/tests/k8s-azure/manifest/linux-vmss-multi-zones.json. W1105 23:18:13.629] 2019/11/05 23:18:13 util.go:42: curl https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/da4b9f5e9696ab00a5b1ac08606218f9f352d324/tests/k8s-azure/manifest/linux-vmss-multi-zones.json W1105 23:18:13.862] 2019/11/05 23:18:13 azure.go:529: downloading /workspace/aks-engine.tar.gz from https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz. W1105 23:18:13.863] 2019/11/05 23:18:13 util.go:42: curl https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz W1105 23:18:15.075] 2019/11/05 23:18:15 azure.go:556: Extracting tar file /workspace/aks-engine.tar.gz into directory /go/src/k8s.io/kubernetes . W1105 23:18:15.075] 2019/11/05 23:18:15 process.go:153: Running: tar -xzf /workspace/aks-engine.tar.gz --strip 1 W1105 23:18:15.223] 2019/11/05 23:18:15 process.go:155: Step 'tar -xzf /workspace/aks-engine.tar.gz --strip 1' finished in 148.013359ms W1105 23:18:15.223] 2019/11/05 23:18:15 process.go:153: Running: /go/src/k8s.io/kubernetes/aks-engine generate /workspace/aks761846597/kubernetes.json --output-directory /workspace/aks761846597 I1105 23:18:15.433] WARN[0000] Clusters with VMSS masters are not yet upgradable! You will not be able to upgrade your cluster until a future version of aks-engine! I1105 23:18:15.433] INFO[0000] Generating assets into /workspace/aks761846597... W1105 23:18:26.917] 2019/11/05 23:18:26 process.go:155: Step '/go/src/k8s.io/kubernetes/aks-engine generate /workspace/aks761846597/kubernetes.json --output-directory /workspace/aks761846597' finished in 11.693648255s W1105 23:18:26.921] 2019/11/05 23:18:26 azure.go:627: Setting kubeconfig env variable: kubeconfig path: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json. W1105 23:18:26.921] 2019/11/05 23:18:26 azure.go:629: Creating resource group: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973. W1105 23:18:26.921] 2019/11/05 23:18:26 azure.go:631: Creating Azure resource group: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973 for cluster deployment. W1105 23:18:28.515] 2019/11/05 23:18:28 azure.go:636: Validating deployment ARM templates. W1105 23:18:30.365] 2019/11/05 23:18:30 azure.go:642: Deploying cluster kubetest-07e0acb7-0020-11ea-802a-02428e4d9973 in resource group kubetest-07e0acb7-0020-11ea-802a-02428e4d9973. W1105 23:28:39.769] 2019/11/05 23:28:39 process.go:153: Running: ./cluster/kubectl.sh --match-server-version=false version W1105 23:28:40.473] 2019/11/05 23:28:40 process.go:155: Step './cluster/kubectl.sh --match-server-version=false version' finished in 703.751733ms W1105 23:28:40.473] 2019/11/05 23:28:40 process.go:153: Running: ./cluster/kubectl.sh --match-server-version=false get nodes -oyaml W1105 23:28:41.770] 2019/11/05 23:28:41 process.go:155: Step './cluster/kubectl.sh --match-server-version=false get nodes -oyaml' finished in 1.297357116s W1105 23:28:41.770] 2019/11/05 23:28:41 azure.go:970: KUBE_TEST_REPO_LIST_DOWNLOAD_LOCATION not set. Using default test image repos. W1105 23:28:41.770] 2019/11/05 23:28:41 azure.go:970: KUBE_TEST_REPO_LIST_DOWNLOAD_LOCATION not set. Using default test image repos. W1105 23:28:41.771] 2019/11/05 23:28:41 process.go:153: Running: kubectl get nodes --no-headers W1105 23:28:42.411] 2019/11/05 23:28:42 process.go:155: Step 'kubectl get nodes --no-headers' finished in 639.206335ms W1105 23:28:42.411] 2019/11/05 23:28:42 e2e.go:474: Cluster nodes: W1105 23:28:42.411] k8s-agentpool-73731178-vmss000000 Ready agent 70s v1.15.0 W1105 23:28:42.411] k8s-agentpool-73731178-vmss000001 Ready agent 71s v1.15.0 W1105 23:28:42.411] k8s-master-73731178-vmss000000 Ready master 72s v1.15.0 W1105 23:28:42.412] k8s-master-73731178-vmss000001 Ready master 60s v1.15.0 W1105 23:28:42.412] k8s-master-73731178-vmss000002 Ready master 70s v1.15.0 W1105 23:28:42.412] k8s-master-73731178-vmss000003 Ready master 73s v1.15.0 W1105 23:28:42.412] k8s-master-73731178-vmss000004 Ready master 73s v1.15.0 W1105 23:28:42.413] 2019/11/05 23:28:42 process.go:153: Running: ./cluster/kubectl.sh --match-server-version=false version W1105 23:28:42.853] 2019/11/05 23:28:42 process.go:155: Step './cluster/kubectl.sh --match-server-version=false version' finished in 442.589717ms W1105 23:28:42.854] 2019/11/05 23:28:42 process.go:153: Running: make e2e-test I1105 23:28:42.954] go test -v -timeout=0 ./test/e2e "-ginkgo.noColor" I1105 23:29:31.348] Nov 5 23:29:31.347: INFO: The --provider flag is not set. Continuing as if --provider=skeleton had been used. I1105 23:29:31.348] === RUN TestE2E I1105 23:29:31.348] Running Suite: AzureDisk CSI Driver End-to-End Tests I1105 23:29:31.348] ==================================================== I1105 23:29:31.349] Random Seed: 1572996571 - Will randomize all specs I1105 23:29:31.349] Will run 16 of 16 specs I1105 23:29:31.349] I1105 23:29:33.063] 2019/11/05 23:29:33 Attempting docker login with Azure service principal I1105 23:29:34.530] 2019/11/05 23:29:34 docker login is successful I1105 23:29:34.530] 2019/11/05 23:29:34 Installing Azure Disk CSI Driver... I1105 23:29:34.531] make[1]: Entering directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1105 23:29:34.533] # Use v2.11.0 helm to match tiller's version in clusters made by aks-engine I1105 23:29:34.533] curl https://raw.githubusercontent.com/helm/helm/master/scripts/get | DESIRED_VERSION=v2.11.0 bash I1105 23:29:34.580] % Total % Received % Xferd Average Speed Time Time Time Current I1105 23:29:34.580] Dload Upload Total Spent Left Speed I1105 23:29:34.619] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7034 100 7034 0 0 176k 0 --:--:-- --:--:-- --:--:-- 176k I1105 23:29:34.636] Downloading https://get.helm.sh/helm-v2.11.0-linux-amd64.tar.gz I1105 23:29:35.994] Preparing to install helm and tiller into /usr/local/bin I1105 23:29:36.021] helm installed into /usr/local/bin/helm I1105 23:29:36.047] tiller installed into /usr/local/bin/tiller I1105 23:29:36.050] Run 'helm init' to configure helm. I1105 23:29:36.066] # Make sure tiller is ready I1105 23:29:36.066] kubectl wait pod -l name=tiller --namespace kube-system --for condition=ready --timeout 5m I1105 23:29:36.592] pod/tiller-deploy-54c96cb5df-wlzbj condition met I1105 23:29:36.594] helm version I1105 23:29:36.643] Client: &version.Version{SemVer:"v2.11.0", GitCommit:"2e55dbe1fdb5fdb96b75ff144a339489417b146b", GitTreeState:"clean"} I1105 23:29:37.669] Server: &version.Version{SemVer:"v2.11.0", GitCommit:"2e55dbe1fdb5fdb96b75ff144a339489417b146b", GitTreeState:"clean"} I1105 23:29:37.671] # Only build and push the image if it does not exist in the registry I1105 23:29:37.672] docker pull k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093 || make azuredisk-container push I1105 23:29:37.881] Error response from daemon: manifest for k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093 not found: manifest unknown: manifest unknown I1105 23:29:37.886] make[2]: Entering directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1105 23:29:37.892] if [ ! -d ./vendor ]; then dep ensure -vendor-only; fi I1105 23:29:37.893] CGO_ENABLED=0 GOOS=linux go build -a -ldflags "-X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.driverVersion=e2e-9f289d4c7792de742a1ded20837778e2acb91093 -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.gitCommit=9f289d4c7792de742a1ded20837778e2acb91093 -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.buildDate=2019-11-05T23:29:37Z -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.DriverName=disk.csi.azure.com -X sigs.k8s.io/azuredisk-csi-driver/pkg/azuredisk.topologyKey=topology.disk.csi.azure.com/zone -extldflags "-static"" -o _output/azurediskplugin ./pkg/azurediskplugin I1105 23:30:13.197] docker build --no-cache -t k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093 -f ./pkg/azurediskplugin/Dockerfile . I1105 23:30:15.229] Sending build context to Docker daemon 214.4MB I1105 23:30:15.259] Step 1/6 : FROM aksrepos.azurecr.io/fundamental/base-ubuntu:v0.0.5 I1105 23:30:15.631] v0.0.5: Pulling from fundamental/base-ubuntu I1105 23:30:15.631] 5667fdb72017: Pulling fs layer I1105 23:30:15.632] d83811f270d5: Pulling fs layer I1105 23:30:15.632] ee671aafb583: Pulling fs layer I1105 23:30:15.632] 7fc152dfb3a6: Pulling fs layer I1105 23:30:15.632] 7940edb1bae7: Pulling fs layer I1105 23:30:15.632] 2ac04aec52fc: Pulling fs layer I1105 23:30:15.632] 3d25cb8b687d: Pulling fs layer I1105 23:30:15.632] 2ac04aec52fc: Waiting I1105 23:30:15.632] 3d25cb8b687d: Waiting I1105 23:30:15.632] 7940edb1bae7: Waiting I1105 23:30:15.633] 7fc152dfb3a6: Waiting I1105 23:30:15.766] d83811f270d5: Verifying Checksum I1105 23:30:15.766] d83811f270d5: Download complete I1105 23:30:15.852] 7fc152dfb3a6: Download complete I1105 23:30:15.982] 7940edb1bae7: Download complete I1105 23:30:16.014] ee671aafb583: Download complete I1105 23:30:16.097] 5667fdb72017: Verifying Checksum I1105 23:30:16.098] 5667fdb72017: Download complete I1105 23:30:16.452] 2ac04aec52fc: Verifying Checksum I1105 23:30:16.452] 2ac04aec52fc: Download complete I1105 23:30:16.685] 3d25cb8b687d: Verifying Checksum I1105 23:30:16.685] 3d25cb8b687d: Download complete I1105 23:30:17.953] 5667fdb72017: Pull complete I1105 23:30:18.120] d83811f270d5: Pull complete I1105 23:30:18.281] ee671aafb583: Pull complete I1105 23:30:18.436] 7fc152dfb3a6: Pull complete I1105 23:30:18.584] 7940edb1bae7: Pull complete I1105 23:30:21.305] 2ac04aec52fc: Pull complete I1105 23:30:22.243] 3d25cb8b687d: Pull complete I1105 23:30:22.266] Digest: sha256:786f291c07d8b7a063d1cabd1a143a217767b34deeca1188565c46f496e50f03 I1105 23:30:22.283] Status: Downloaded newer image for aksrepos.azurecr.io/fundamental/base-ubuntu:v0.0.5 I1105 23:30:22.284] ---> 7730e8d0ed58 I1105 23:30:22.284] Step 2/6 : RUN apt-get update && apt-get install -y util-linux e2fsprogs mount ca-certificates udev xfsprogs I1105 23:30:29.189] ---> Running in 5834d6accbbd I1105 23:30:30.226] Hit:1 http://azure.archive.ubuntu.com/ubuntu bionic InRelease I1105 23:30:30.226] Get:2 http://azure.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] I1105 23:30:30.228] Get:3 http://azure.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] I1105 23:30:30.386] Get:4 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] I1105 23:30:30.412] Get:5 http://azure.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1305 kB] I1105 23:30:30.430] Get:6 http://azure.archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [9022 B] I1105 23:30:30.431] Get:7 http://azure.archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [995 kB] I1105 23:30:30.457] Get:8 http://azure.archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [23.2 kB] I1105 23:30:30.552] Get:9 http://azure.archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4234 B] I1105 23:30:31.182] Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [783 kB] I1105 23:30:32.320] Get:11 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [700 kB] I1105 23:30:33.442] Get:12 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [12.6 kB] I1105 23:30:33.780] Get:13 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [5944 B] I1105 23:30:33.819] Fetched 4089 kB in 4s (1099 kB/s) I1105 23:30:34.738] Reading package lists... I1105 23:30:35.741] Reading package lists... I1105 23:30:35.939] Building dependency tree... I1105 23:30:35.939] Reading state information... I1105 23:30:36.065] ca-certificates is already the newest version (20180409). I1105 23:30:36.066] e2fsprogs is already the newest version (1.44.1-1ubuntu1.2). I1105 23:30:36.066] mount is already the newest version (2.31.1-0.4ubuntu3.4). I1105 23:30:36.066] util-linux is already the newest version (2.31.1-0.4ubuntu3.4). I1105 23:30:36.066] The following additional packages will be installed: I1105 23:30:36.066] libreadline5 I1105 23:30:36.066] Suggested packages: I1105 23:30:36.067] xfsdump acl attr quota I1105 23:30:36.090] The following NEW packages will be installed: I1105 23:30:36.091] libreadline5 udev xfsprogs I1105 23:30:36.109] 0 upgraded, 3 newly installed, 0 to remove and 1 not upgraded. I1105 23:30:36.109] Need to get 1884 kB of archives. I1105 23:30:36.109] After this operation, 12.2 MB of additional disk space will be used. I1105 23:30:36.109] Get:1 http://azure.archive.ubuntu.com/ubuntu bionic-updates/main amd64 udev amd64 237-3ubuntu10.31 [1102 kB] I1105 23:30:36.312] Get:2 http://azure.archive.ubuntu.com/ubuntu bionic/main amd64 libreadline5 amd64 5.2+dfsg-3build1 [99.5 kB] I1105 23:30:36.667] Get:3 http://azure.archive.ubuntu.com/ubuntu bionic/main amd64 xfsprogs amd64 4.9.0+nmu1ubuntu2 [683 kB] I1105 23:30:37.367] debconf: delaying package configuration, since apt-utils is not installed I1105 23:30:37.404] Fetched 1884 kB in 1s (1834 kB/s) I1105 23:30:37.498] Selecting previously unselected package udev. I1105 23:30:37.504] (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 6917 files and directories currently installed.) I1105 23:30:37.504] Preparing to unpack .../udev_237-3ubuntu10.31_amd64.deb ... I1105 23:30:37.551] Unpacking udev (237-3ubuntu10.31) ... I1105 23:30:37.863] Selecting previously unselected package libreadline5:amd64. I1105 23:30:37.864] Preparing to unpack .../libreadline5_5.2+dfsg-3build1_amd64.deb ... I1105 23:30:37.892] Unpacking libreadline5:amd64 (5.2+dfsg-3build1) ... I1105 23:30:38.016] Selecting previously unselected package xfsprogs. I1105 23:30:38.017] Preparing to unpack .../xfsprogs_4.9.0+nmu1ubuntu2_amd64.deb ... I1105 23:30:38.033] Unpacking xfsprogs (4.9.0+nmu1ubuntu2) ... I1105 23:30:38.260] Setting up udev (237-3ubuntu10.31) ... I1105 23:30:38.703] invoke-rc.d: could not determine current runlevel I1105 23:30:38.706] invoke-rc.d: policy-rc.d denied execution of start. I1105 23:30:38.761] Setting up libreadline5:amd64 (5.2+dfsg-3build1) ... I1105 23:30:38.802] Setting up xfsprogs (4.9.0+nmu1ubuntu2) ... I1105 23:30:38.846] Processing triggers for systemd (237-3ubuntu10.31) ... I1105 23:30:38.878] Processing triggers for libc-bin (2.27-3ubuntu1) ... I1105 23:30:40.476] Removing intermediate container 5834d6accbbd I1105 23:30:40.476] ---> 6ec2723eb438 I1105 23:30:40.476] Step 3/6 : LABEL maintainers="andyzhangx" I1105 23:30:40.764] ---> Running in 89f849ada97a I1105 23:30:41.260] Removing intermediate container 89f849ada97a I1105 23:30:41.261] ---> 6a579f6963c0 I1105 23:30:41.261] Step 4/6 : LABEL description="Azure Disk CSI Driver" I1105 23:30:41.487] ---> Running in d232d5b7d2b2 I1105 23:30:42.087] Removing intermediate container d232d5b7d2b2 I1105 23:30:42.088] ---> 9d2066412134 I1105 23:30:42.088] Step 5/6 : COPY ./_output/azurediskplugin /azurediskplugin I1105 23:30:44.458] ---> e9c7a67aba15 I1105 23:30:44.459] Step 6/6 : ENTRYPOINT ["/azurediskplugin"] I1105 23:30:44.608] ---> Running in 9952cd922375 I1105 23:30:45.077] Removing intermediate container 9952cd922375 I1105 23:30:45.077] ---> 83de4e1de105 I1105 23:30:45.201] Successfully built 83de4e1de105 I1105 23:30:45.430] Successfully tagged k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093 I1105 23:30:45.433] docker push k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093 I1105 23:30:45.511] The push refers to repository [k8sprowinternal.azurecr.io/azuredisk-csi] I1105 23:30:45.525] a3f97fc5b0a4: Preparing I1105 23:30:45.525] 51c8bdb5fa59: Preparing I1105 23:30:45.525] 77098f020d77: Preparing I1105 23:30:45.525] f780fac61456: Preparing I1105 23:30:45.525] f89c15b53b76: Preparing I1105 23:30:45.526] e80c789bc6ac: Preparing I1105 23:30:45.526] 6c3332381368: Preparing I1105 23:30:45.526] ef1a1ec5bba9: Preparing I1105 23:30:45.526] a1aa3da2a80a: Preparing I1105 23:30:45.526] ef1a1ec5bba9: Waiting I1105 23:30:45.526] e80c789bc6ac: Waiting I1105 23:30:45.526] a1aa3da2a80a: Waiting I1105 23:30:45.526] 6c3332381368: Waiting I1105 23:30:45.739] f780fac61456: Layer already exists I1105 23:30:45.771] 77098f020d77: Layer already exists I1105 23:30:45.818] f89c15b53b76: Layer already exists I1105 23:30:45.838] e80c789bc6ac: Layer already exists I1105 23:30:45.862] 6c3332381368: Layer already exists I1105 23:30:45.936] a1aa3da2a80a: Layer already exists I1105 23:30:45.956] ef1a1ec5bba9: Layer already exists I1105 23:30:47.426] 51c8bdb5fa59: Pushed I1105 23:30:49.190] a3f97fc5b0a4: Pushed I1105 23:30:49.906] e2e-9f289d4c7792de742a1ded20837778e2acb91093: digest: sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 size: 2206 I1105 23:30:49.918] make[2]: Leaving directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1105 23:30:49.918] helm install charts/latest/azuredisk-csi-driver -n azuredisk-csi-driver --namespace kube-system --wait \ I1105 23:30:49.919] --set image.pullPolicy=IfNotPresent \ I1105 23:30:49.919] --set image.repository=k8sprowinternal.azurecr.io/azuredisk-csi \ I1105 23:30:49.919] --set image.tag=e2e-9f289d4c7792de742a1ded20837778e2acb91093 I1105 23:31:52.246] NAME: azuredisk-csi-driver I1105 23:31:53.582] LAST DEPLOYED: Tue Nov 5 23:30:51 2019 I1105 23:31:53.582] NAMESPACE: kube-system I1105 23:31:53.582] STATUS: DEPLOYED I1105 23:31:53.582] I1105 23:31:53.582] RESOURCES: I1105 23:31:53.583] ==> v1/DaemonSet I1105 23:31:53.583] NAME AGE I1105 23:31:53.583] csi-azuredisk-node 56s I1105 23:31:53.583] I1105 23:31:53.583] ==> v1/Deployment I1105 23:31:53.583] csi-azuredisk-controller 56s I1105 23:31:53.583] I1105 23:31:53.583] ==> v1/Pod(related) I1105 23:31:53.583] I1105 23:31:53.584] NAME READY STATUS RESTARTS AGE I1105 23:31:53.584] csi-azuredisk-node-g6wbm 3/3 Running 0 56s I1105 23:31:53.584] csi-azuredisk-node-ml68k 3/3 Running 0 56s I1105 23:31:53.584] csi-azuredisk-controller-59bf945f54-k2p5m 6/6 Running 0 56s I1105 23:31:53.584] I1105 23:31:53.584] ==> v1/ServiceAccount I1105 23:31:53.584] I1105 23:31:53.584] NAME AGE I1105 23:31:53.585] csi-azuredisk-controller-sa 56s I1105 23:31:53.585] I1105 23:31:53.585] ==> v1beta1/CustomResourceDefinition I1105 23:31:53.585] csidrivers.csi.storage.k8s.io 56s I1105 23:31:53.585] csinodeinfos.csi.storage.k8s.io 56s I1105 23:31:53.585] I1105 23:31:53.586] ==> v1/ClusterRole I1105 23:31:53.586] azuredisk-external-attacher-role 56s I1105 23:31:53.586] azuredisk-external-provisioner-role 56s I1105 23:31:53.586] azuredisk-cluster-driver-registrar-role 56s I1105 23:31:53.586] azuredisk-external-snapshotter-role 56s I1105 23:31:53.587] I1105 23:31:53.587] ==> v1/ClusterRoleBinding I1105 23:31:53.587] azuredisk-csi-provisioner-binding 56s I1105 23:31:53.587] azuredisk-csi-snapshotter-binding 56s I1105 23:31:53.587] azuredisk-csi-attacher-binding 56s I1105 23:31:53.587] azuredisk-csi-driver-registrar-binding 56s I1105 23:31:53.587] I1105 23:31:53.587] ==> v1/Service I1105 23:31:53.588] csi-azuredisk-controller 56s I1105 23:31:53.588] I1105 23:31:53.588] I1105 23:31:53.588] NOTES: I1105 23:31:53.588] The Azure Disk CSI Driver is getting deployed to your cluster. I1105 23:31:53.588] I1105 23:31:53.588] To check Azure Disk CSI Driver pods status, please run: I1105 23:31:53.588] I1105 23:31:53.588] kubectl --namespace=kube-system get pods --selector="release=azuredisk-csi-driver" --watch I1105 23:31:53.589] I1105 23:31:53.589] make[1]: Leaving directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1105 23:31:53.589] 2019/11/05 23:31:53 Azure Disk CSI Driver installed I1105 23:31:53.589] [azuredisk-csi-e2e] Dynamic Provisioning [single-az] I1105 23:31:53.589] should create a raw block volume on demand I1105 23:31:53.589] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:101 I1105 23:31:53.589] [BeforeEach] [single-az] I1105 23:31:53.590] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1105 23:31:53.590] STEP: Creating a kubernetes client I1105 23:31:53.590] Nov 5 23:31:53.585: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1105 23:31:53.590] STEP: Building a namespace api object, basename azuredisk I1105 23:31:54.233] Nov 5 23:31:54.233: INFO: Found PodSecurityPolicies; assuming PodSecurityPolicy is enabled. I1105 23:31:54.611] Nov 5 23:31:54.611: INFO: Found ClusterRoles; assuming RBAC is enabled. I1105 23:31:54.702] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-6016 I1105 23:31:54.976] STEP: Waiting for a default service account to be provisioned in namespace I1105 23:31:55.057] [BeforeEach] [single-az] I1105 23:31:55.057] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:58 I1105 23:31:55.057] [It] should create a raw block volume on demand I1105 23:31:55.057] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:101 I1105 23:31:55.058] STEP: setting up the StorageClass I1105 23:31:55.058] STEP: creating a StorageClass I1105 23:31:55.144] STEP: setting up the PVC and PV I1105 23:31:55.144] STEP: creating a PVC I1105 23:31:55.235] STEP: waiting for PVC to be in phase "Bound" I1105 23:31:55.235] Nov 5 23:31:55.235: INFO: Waiting up to 5m0s for PersistentVolumeClaims [pvc-4v87q] to have phase Bound I1105 23:31:55.318] Nov 5 23:31:55.318: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:31:57.402] Nov 5 23:31:57.402: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:31:59.487] Nov 5 23:31:59.487: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:01.572] Nov 5 23:32:01.571: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:03.657] Nov 5 23:32:03.657: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:05.743] Nov 5 23:32:05.743: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:07.828] Nov 5 23:32:07.828: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:09.912] Nov 5 23:32:09.912: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:11.996] Nov 5 23:32:11.996: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:14.080] Nov 5 23:32:14.080: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:16.165] Nov 5 23:32:16.164: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:18.249] Nov 5 23:32:18.249: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:20.333] Nov 5 23:32:20.333: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:22.417] Nov 5 23:32:22.417: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:24.501] Nov 5 23:32:24.501: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:26.585] Nov 5 23:32:26.585: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:28.669] Nov 5 23:32:28.669: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:30.763] Nov 5 23:32:30.763: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:32.848] Nov 5 23:32:32.848: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:34.933] Nov 5 23:32:34.932: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:37.017] Nov 5 23:32:37.017: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:39.102] Nov 5 23:32:39.101: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:41.186] Nov 5 23:32:41.186: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:43.270] Nov 5 23:32:43.270: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:45.354] Nov 5 23:32:45.354: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:47.439] Nov 5 23:32:47.439: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:49.525] Nov 5 23:32:49.525: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:51.609] Nov 5 23:32:51.609: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:53.693] Nov 5 23:32:53.693: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:55.778] Nov 5 23:32:55.777: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:57.862] Nov 5 23:32:57.862: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:32:59.946] Nov 5 23:32:59.946: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:02.031] Nov 5 23:33:02.031: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:04.115] Nov 5 23:33:04.115: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:06.199] Nov 5 23:33:06.199: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:08.283] Nov 5 23:33:08.283: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:10.368] Nov 5 23:33:10.367: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:12.452] Nov 5 23:33:12.452: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:14.536] Nov 5 23:33:14.536: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:16.621] Nov 5 23:33:16.620: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:18.705] Nov 5 23:33:18.705: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:20.827] Nov 5 23:33:20.827: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:22.911] Nov 5 23:33:22.911: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:24.996] Nov 5 23:33:24.996: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:27.081] Nov 5 23:33:27.080: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:29.165] Nov 5 23:33:29.165: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:31.250] Nov 5 23:33:31.250: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:33.334] Nov 5 23:33:33.334: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:35.418] Nov 5 23:33:35.418: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:37.503] Nov 5 23:33:37.503: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:39.587] Nov 5 23:33:39.587: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:41.671] Nov 5 23:33:41.671: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:43.756] Nov 5 23:33:43.756: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:45.840] Nov 5 23:33:45.840: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:47.924] Nov 5 23:33:47.924: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:50.008] Nov 5 23:33:50.008: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:52.092] Nov 5 23:33:52.092: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:54.177] Nov 5 23:33:54.176: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:56.261] Nov 5 23:33:56.261: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:33:58.346] Nov 5 23:33:58.345: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:00.429] Nov 5 23:34:00.429: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:02.513] Nov 5 23:34:02.513: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:04.602] Nov 5 23:34:04.602: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:06.686] Nov 5 23:34:06.686: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:08.771] Nov 5 23:34:08.771: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:10.857] Nov 5 23:34:10.856: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:12.943] Nov 5 23:34:12.943: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:15.028] Nov 5 23:34:15.028: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:17.113] Nov 5 23:34:17.113: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:19.198] Nov 5 23:34:19.198: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:21.282] Nov 5 23:34:21.282: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:23.366] Nov 5 23:34:23.366: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:25.451] Nov 5 23:34:25.451: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:27.536] Nov 5 23:34:27.536: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:29.621] Nov 5 23:34:29.621: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:31.705] Nov 5 23:34:31.705: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:33.789] Nov 5 23:34:33.789: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:35.874] Nov 5 23:34:35.873: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:37.957] Nov 5 23:34:37.957: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:40.060] Nov 5 23:34:40.060: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:42.145] Nov 5 23:34:42.145: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:44.243] Nov 5 23:34:44.243: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:46.328] Nov 5 23:34:46.328: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:48.412] Nov 5 23:34:48.412: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:50.494] Nov 5 23:34:50.494: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:52.571] Nov 5 23:34:52.571: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:54.649] Nov 5 23:34:54.649: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:56.727] Nov 5 23:34:56.727: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:34:58.804] Nov 5 23:34:58.804: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:00.881] Nov 5 23:35:00.881: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:02.958] Nov 5 23:35:02.958: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:05.036] Nov 5 23:35:05.035: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:07.113] Nov 5 23:35:07.112: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:09.190] Nov 5 23:35:09.190: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:11.268] Nov 5 23:35:11.268: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:13.345] Nov 5 23:35:13.345: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:15.423] Nov 5 23:35:15.423: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:17.501] Nov 5 23:35:17.500: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:19.578] Nov 5 23:35:19.577: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:21.658] Nov 5 23:35:21.658: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:23.735] Nov 5 23:35:23.735: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:25.812] Nov 5 23:35:25.812: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:27.889] Nov 5 23:35:27.889: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:29.967] Nov 5 23:35:29.967: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:32.065] Nov 5 23:35:32.064: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:34.142] Nov 5 23:35:34.142: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:36.239] Nov 5 23:35:36.239: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:38.317] Nov 5 23:35:38.317: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:40.394] Nov 5 23:35:40.394: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:42.471] Nov 5 23:35:42.471: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:44.548] Nov 5 23:35:44.548: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:46.626] Nov 5 23:35:46.626: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:48.703] Nov 5 23:35:48.703: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:50.781] Nov 5 23:35:50.781: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:52.858] Nov 5 23:35:52.857: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:54.935] Nov 5 23:35:54.935: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:57.012] Nov 5 23:35:57.012: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:35:59.089] Nov 5 23:35:59.089: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:01.166] Nov 5 23:36:01.166: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:03.247] Nov 5 23:36:03.247: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:05.324] Nov 5 23:36:05.324: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:07.401] Nov 5 23:36:07.400: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:09.478] Nov 5 23:36:09.477: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:11.555] Nov 5 23:36:11.554: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:13.634] Nov 5 23:36:13.634: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:15.712] Nov 5 23:36:15.712: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:17.789] Nov 5 23:36:17.789: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:19.866] Nov 5 23:36:19.866: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:21.943] Nov 5 23:36:21.943: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:24.048] Nov 5 23:36:24.048: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:26.125] Nov 5 23:36:26.125: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:28.203] Nov 5 23:36:28.202: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:30.280] Nov 5 23:36:30.279: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:32.357] Nov 5 23:36:32.357: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:34.434] Nov 5 23:36:34.434: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:36.512] Nov 5 23:36:36.512: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:38.589] Nov 5 23:36:38.589: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:40.666] Nov 5 23:36:40.666: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:42.747] Nov 5 23:36:42.747: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:44.824] Nov 5 23:36:44.824: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:46.911] Nov 5 23:36:46.911: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:48.993] Nov 5 23:36:48.993: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:51.070] Nov 5 23:36:51.070: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:53.149] Nov 5 23:36:53.149: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:55.227] Nov 5 23:36:55.227: INFO: PersistentVolumeClaim pvc-4v87q found but phase is Pending instead of Bound. I1105 23:36:57.228] Nov 5 23:36:57.227: INFO: Unexpected error occurred: PersistentVolumeClaims [pvc-4v87q] not all in phase Bound within 5m0s I1105 23:36:57.228] [AfterEach] [single-az] I1105 23:36:57.228] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1105 23:36:57.228] STEP: Collecting events from namespace "azuredisk-6016". I1105 23:36:57.305] STEP: Found 3 events. I1105 23:36:57.305] Nov 5 23:36:57.305: INFO: At 2019-11-05 23:31:55 +0000 UTC - event for pvc-4v87q: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator I1105 23:36:57.306] Nov 5 23:36:57.305: INFO: At 2019-11-05 23:31:55 +0000 UTC - event for pvc-4v87q: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } Provisioning: External provisioner is provisioning volume for claim "azuredisk-6016/pvc-4v87q" I1105 23:36:57.306] Nov 5 23:36:57.305: INFO: At 2019-11-05 23:32:05 +0000 UTC - event for pvc-4v87q: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-6016-disk.csi.azure.com-dynamic-sc-t8bq6": rpc error: code = DeadlineExceeded desc = context deadline exceeded I1105 23:36:57.382] Nov 5 23:36:57.382: INFO: POD NODE PHASE GRACE CONDITIONS I1105 23:36:57.382] Nov 5 23:36:57.382: INFO: I1105 23:36:57.611] Nov 5 23:36:57.611: INFO: I1105 23:36:57.611] Logging node info for node k8s-agentpool-73731178-vmss000000 I1105 23:36:57.691] Nov 5 23:36:57.688: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000000,UID:e9bc0b16-6756-4155-b49c-e223c0ba9499,ResourceVersion:2698,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-1,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000000"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:18 +0000 UTC 2019-11-05 23:28:18 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:36:33 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:36:33 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:36:33 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:36:33 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.4} {Hostname k8s-agentpool-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:956ad861ae4a42099801f8e840b4e502,SystemUUID:439CF4B9-2B9F-B74E-9ED7-7379FD8BD0DF,BootID:bd3476e5-4fd4-4437-9b56-54fbe38a3a49,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1] 121711221} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/metrics-server-amd64@sha256:49a9f12f7067d11f42c803dbe61ed2c1299959ad85cb315b25ff7eef8e6b8892 k8s.gcr.io/metrics-server-amd64:v0.2.1] 42541759} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:36:57.692] Nov 5 23:36:57.689: INFO: I1105 23:36:57.692] Logging kubelet events for node k8s-agentpool-73731178-vmss000000 I1105 23:36:57.770] Nov 5 23:36:57.770: INFO: I1105 23:36:57.771] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000000 I1105 23:36:57.885] Nov 5 23:36:57.885: INFO: blobfuse-flexvol-installer-cvgkv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:57.885] Nov 5 23:36:57.885: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1105 23:36:57.886] Nov 5 23:36:57.885: INFO: azure-ip-masq-agent-vn5zc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:57.886] Nov 5 23:36:57.885: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:36:57.886] Nov 5 23:36:57.885: INFO: keyvault-flexvolume-xr7v6 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:57.886] Nov 5 23:36:57.885: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1105 23:36:57.886] Nov 5 23:36:57.885: INFO: metrics-server-864ffbc5c-kb9cz started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:57.886] Nov 5 23:36:57.885: INFO: Container metrics-server ready: true, restart count 0 I1105 23:36:57.887] Nov 5 23:36:57.885: INFO: kube-proxy-jnqp8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:57.887] Nov 5 23:36:57.885: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:36:57.887] Nov 5 23:36:57.885: INFO: kubernetes-dashboard-66dd8b8df7-4rnsp started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:36:57.887] Nov 5 23:36:57.885: INFO: Container kubernetes-dashboard ready: true, restart count 1 I1105 23:36:57.887] Nov 5 23:36:57.885: INFO: csi-azuredisk-node-g6wbm started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1105 23:36:57.887] Nov 5 23:36:57.885: INFO: Container azuredisk ready: true, restart count 0 I1105 23:36:57.887] Nov 5 23:36:57.885: INFO: Container liveness-probe ready: true, restart count 0 I1105 23:36:57.888] Nov 5 23:36:57.885: INFO: Container node-driver-registrar ready: true, restart count 0 I1105 23:36:58.133] Nov 5 23:36:58.133: INFO: I1105 23:36:58.134] Latency metrics for node k8s-agentpool-73731178-vmss000000 I1105 23:36:58.134] Nov 5 23:36:58.133: INFO: I1105 23:36:58.134] Logging node info for node k8s-agentpool-73731178-vmss000001 I1105 23:36:58.213] Nov 5 23:36:58.210: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000001,UID:ab75ba9d-ec23-4ff7-ae5a-d1a19974c05d,ResourceVersion:2604,Generation:0,CreationTimestamp:2019-11-05 23:27:31 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-2,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000001"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.5.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:17 +0000 UTC 2019-11-05 23:28:17 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:36:02 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:36:02 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:36:02 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:36:02 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.5} {Hostname k8s-agentpool-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f0eae5e73d0f4ccb82dd0f22701c288f,SystemUUID:7E54C533-AED3-744D-8D17-EFF5E62EA06D,BootID:6d58e5a6-45fb-4a41-a491-bc2f3799f411,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[gcr.io/kubernetes-helm/tiller@sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1 gcr.io/kubernetes-helm/tiller:v2.11.0] 71821984} {[quay.io/k8scsi/csi-provisioner@sha256:d657c839dce87324fe2b677302913f9386f885f8746be7bea0ced5b0844e3433 quay.io/k8scsi/csi-provisioner:v1.3.1] 50596998} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0] 46226754} {[quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1] 45874691} {[quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb quay.io/k8scsi/csi-snapshotter:v1.1.0] 44325352} {[k8s.gcr.io/coredns@sha256:e83beb5e43f8513fa735e77ffc5859640baea30a882a11cc75c4c3244a737d3c k8s.gcr.io/coredns:1.5.0] 42488424} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0] 14967303} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:36:58.213] Nov 5 23:36:58.210: INFO: I1105 23:36:58.214] Logging kubelet events for node k8s-agentpool-73731178-vmss000001 I1105 23:36:58.291] Nov 5 23:36:58.291: INFO: I1105 23:36:58.291] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000001 I1105 23:36:58.396] Nov 5 23:36:58.396: INFO: tiller-deploy-54c96cb5df-wlzbj started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:36:58.396] Nov 5 23:36:58.396: INFO: Container tiller ready: true, restart count 0 I1105 23:36:58.397] Nov 5 23:36:58.396: INFO: csi-azuredisk-node-ml68k started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1105 23:36:58.397] Nov 5 23:36:58.396: INFO: Container azuredisk ready: true, restart count 0 I1105 23:36:58.397] Nov 5 23:36:58.396: INFO: Container liveness-probe ready: true, restart count 0 I1105 23:36:58.397] Nov 5 23:36:58.396: INFO: Container node-driver-registrar ready: true, restart count 0 I1105 23:36:58.397] Nov 5 23:36:58.396: INFO: csi-azuredisk-controller-59bf945f54-k2p5m started at 2019-11-05 23:30:58 +0000 UTC (0+6 container statuses recorded) I1105 23:36:58.398] Nov 5 23:36:58.396: INFO: Container azuredisk ready: true, restart count 0 I1105 23:36:58.398] Nov 5 23:36:58.396: INFO: Container cluster-driver-registrar ready: true, restart count 0 I1105 23:36:58.398] Nov 5 23:36:58.396: INFO: Container csi-attacher ready: true, restart count 0 I1105 23:36:58.398] Nov 5 23:36:58.396: INFO: Container csi-provisioner ready: true, restart count 0 I1105 23:36:58.398] Nov 5 23:36:58.396: INFO: Container csi-snapshotter ready: true, restart count 0 I1105 23:36:58.398] Nov 5 23:36:58.396: INFO: Container liveness-probe ready: true, restart count 0 I1105 23:36:58.399] Nov 5 23:36:58.396: INFO: blobfuse-flexvol-installer-589vv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:58.399] Nov 5 23:36:58.396: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1105 23:36:58.399] Nov 5 23:36:58.396: INFO: coredns-7f68dcdbdb-f98nq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:58.399] Nov 5 23:36:58.396: INFO: Container coredns ready: true, restart count 0 I1105 23:36:58.399] Nov 5 23:36:58.396: INFO: azure-ip-masq-agent-6qqgc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:58.400] Nov 5 23:36:58.396: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:36:58.400] Nov 5 23:36:58.396: INFO: keyvault-flexvolume-7tztj started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:58.400] Nov 5 23:36:58.396: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1105 23:36:58.400] Nov 5 23:36:58.396: INFO: kube-proxy-z4hf8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:58.400] Nov 5 23:36:58.396: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:36:58.646] Nov 5 23:36:58.646: INFO: I1105 23:36:58.647] Latency metrics for node k8s-agentpool-73731178-vmss000001 I1105 23:36:58.647] Nov 5 23:36:58.646: INFO: I1105 23:36:58.647] Logging node info for node k8s-master-73731178-vmss000000 I1105 23:36:58.726] Nov 5 23:36:58.723: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000000,UID:1f765350-accc-4e67-898b-e4d84be84901,ResourceVersion:2659,Generation:0,CreationTimestamp:2019-11-05 23:27:30 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:36:21 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:36:21 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:36:21 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:36:21 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.4} {Hostname k8s-master-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:836af7329e85492184d73f1ea7f63a4e,SystemUUID:D1C68207-4499-C24D-B9D6-ADA0554A1BE5,BootID:a29dde5d-b4dc-483e-a50e-76e79359d759,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:36:58.726] Nov 5 23:36:58.724: INFO: I1105 23:36:58.726] Logging kubelet events for node k8s-master-73731178-vmss000000 I1105 23:36:58.806] Nov 5 23:36:58.806: INFO: I1105 23:36:58.806] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000000 I1105 23:36:58.910] Nov 5 23:36:58.909: INFO: kube-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:36:58.910] Nov 5 23:36:58.909: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:36:58.910] Nov 5 23:36:58.909: INFO: kube-scheduler-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:36:58.910] Nov 5 23:36:58.909: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:36:58.910] Nov 5 23:36:58.909: INFO: cloud-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:36:58.911] Nov 5 23:36:58.909: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:36:58.911] Nov 5 23:36:58.909: INFO: kube-addon-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:36:58.911] Nov 5 23:36:58.909: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:36:58.911] Nov 5 23:36:58.909: INFO: kube-apiserver-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:36:58.911] Nov 5 23:36:58.909: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:36:58.911] Nov 5 23:36:58.909: INFO: azure-ip-masq-agent-xmkx2 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:58.911] Nov 5 23:36:58.910: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:36:58.912] Nov 5 23:36:58.910: INFO: kube-proxy-2fwv9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:58.912] Nov 5 23:36:58.910: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:36:59.162] Nov 5 23:36:59.162: INFO: I1105 23:36:59.163] Latency metrics for node k8s-master-73731178-vmss000000 I1105 23:36:59.163] Nov 5 23:36:59.162: INFO: I1105 23:36:59.163] Logging node info for node k8s-master-73731178-vmss000001 I1105 23:36:59.243] Nov 5 23:36:59.241: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000001,UID:442cf114-6b0a-4c80-a9e5-be62e184f94c,ResourceVersion:2613,Generation:0,CreationTimestamp:2019-11-05 23:27:42 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:19 +0000 UTC 2019-11-05 23:28:19 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:36:03 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:36:03 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:36:03 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:36:03 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.5} {Hostname k8s-master-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1a9da6632c314858a31bccaea0be0f50,SystemUUID:8F48A76E-30E1-B948-89B2-33C0048059B4,BootID:1597124c-68a3-452c-ae03-6cfe9bc1e57f,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:36:59.244] Nov 5 23:36:59.241: INFO: I1105 23:36:59.244] Logging kubelet events for node k8s-master-73731178-vmss000001 I1105 23:36:59.323] Nov 5 23:36:59.323: INFO: I1105 23:36:59.323] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000001 I1105 23:36:59.428] Nov 5 23:36:59.428: INFO: kube-scheduler-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:36:59.428] Nov 5 23:36:59.428: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:36:59.429] Nov 5 23:36:59.428: INFO: cloud-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:36:59.429] Nov 5 23:36:59.428: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:36:59.429] Nov 5 23:36:59.428: INFO: kube-addon-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:36:59.429] Nov 5 23:36:59.428: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:36:59.429] Nov 5 23:36:59.428: INFO: kube-apiserver-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:36:59.430] Nov 5 23:36:59.428: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:36:59.430] Nov 5 23:36:59.428: INFO: kube-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:36:59.430] Nov 5 23:36:59.428: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:36:59.430] Nov 5 23:36:59.428: INFO: azure-ip-masq-agent-825g9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:59.430] Nov 5 23:36:59.428: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:36:59.431] Nov 5 23:36:59.428: INFO: kube-proxy-8924t started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:59.431] Nov 5 23:36:59.428: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:36:59.679] Nov 5 23:36:59.678: INFO: I1105 23:36:59.679] Latency metrics for node k8s-master-73731178-vmss000001 I1105 23:36:59.679] Nov 5 23:36:59.678: INFO: I1105 23:36:59.679] Logging node info for node k8s-master-73731178-vmss000002 I1105 23:36:59.758] Nov 5 23:36:59.756: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000002,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000002,UID:6cf1398e-1b6b-4537-837d-9ffceb9a4f00,ResourceVersion:2671,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000002,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.6.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/2,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:27:55 +0000 UTC 2019-11-05 23:27:55 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:36:23 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:36:23 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:36:23 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:36:23 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.6} {Hostname k8s-master-73731178-vmss000002}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7964689c8ba4f448e6f435b3d4fefac,SystemUUID:9369535A-87BF-1E4B-86DF-5D1A23713C9F,BootID:74f93904-298f-454d-8df6-8d4bba193331,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:36:59.758] Nov 5 23:36:59.756: INFO: I1105 23:36:59.758] Logging kubelet events for node k8s-master-73731178-vmss000002 I1105 23:36:59.836] Nov 5 23:36:59.836: INFO: I1105 23:36:59.837] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000002 I1105 23:36:59.941] Nov 5 23:36:59.941: INFO: kube-addon-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:18 +0000 UTC (0+1 container statuses recorded) I1105 23:36:59.941] Nov 5 23:36:59.941: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:36:59.941] Nov 5 23:36:59.941: INFO: kube-apiserver-k8s-master-73731178-vmss000002 started at 2019-11-05 23:28:42 +0000 UTC (0+1 container statuses recorded) I1105 23:36:59.942] Nov 5 23:36:59.941: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:36:59.942] Nov 5 23:36:59.941: INFO: kube-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1105 23:36:59.942] Nov 5 23:36:59.941: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:36:59.942] Nov 5 23:36:59.941: INFO: kube-scheduler-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1105 23:36:59.942] Nov 5 23:36:59.941: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:36:59.942] Nov 5 23:36:59.941: INFO: cloud-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1105 23:36:59.943] Nov 5 23:36:59.941: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:36:59.943] Nov 5 23:36:59.941: INFO: azure-ip-masq-agent-74xks started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:59.943] Nov 5 23:36:59.941: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:36:59.943] Nov 5 23:36:59.941: INFO: kube-proxy-t958f started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:36:59.943] Nov 5 23:36:59.941: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:37:00.201] Nov 5 23:37:00.200: INFO: I1105 23:37:00.201] Latency metrics for node k8s-master-73731178-vmss000002 I1105 23:37:00.201] Nov 5 23:37:00.201: INFO: I1105 23:37:00.201] Logging node info for node k8s-master-73731178-vmss000003 I1105 23:37:00.280] Nov 5 23:37:00.278: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000003,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000003,UID:54efc1b0-183c-4153-b804-31d0d42ce204,ResourceVersion:2657,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000003,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/3,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:36:21 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:36:21 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:36:21 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:36:21 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{Hostname k8s-master-73731178-vmss000003} {InternalIP 10.240.0.7}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a448072d2d27400fa2252a0cb3c8ff37,SystemUUID:98F6A517-FFCA-8E4D-A914-52A5F1482433,BootID:50c0f9e6-7c4d-45ec-8984-248ea540d637,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:37:00.280] Nov 5 23:37:00.278: INFO: I1105 23:37:00.280] Logging kubelet events for node k8s-master-73731178-vmss000003 I1105 23:37:00.360] Nov 5 23:37:00.360: INFO: I1105 23:37:00.360] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000003 I1105 23:37:00.463] Nov 5 23:37:00.463: INFO: azure-ip-masq-agent-4nshf started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:37:00.463] Nov 5 23:37:00.463: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:37:00.463] Nov 5 23:37:00.463: INFO: kube-proxy-qm7rq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:37:00.463] Nov 5 23:37:00.463: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:37:00.464] Nov 5 23:37:00.463: INFO: cloud-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:37:00.464] Nov 5 23:37:00.463: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:37:00.464] Nov 5 23:37:00.463: INFO: kube-addon-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:43 +0000 UTC (0+1 container statuses recorded) I1105 23:37:00.464] Nov 5 23:37:00.463: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:37:00.464] Nov 5 23:37:00.463: INFO: kube-apiserver-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:37:00.464] Nov 5 23:37:00.463: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:37:00.465] Nov 5 23:37:00.463: INFO: kube-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:37:00.465] Nov 5 23:37:00.463: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:37:00.465] Nov 5 23:37:00.463: INFO: kube-scheduler-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:37:00.465] Nov 5 23:37:00.463: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:37:00.710] Nov 5 23:37:00.710: INFO: I1105 23:37:00.710] Latency metrics for node k8s-master-73731178-vmss000003 I1105 23:37:00.710] Nov 5 23:37:00.710: INFO: I1105 23:37:00.711] Logging node info for node k8s-master-73731178-vmss000004 I1105 23:37:00.793] Nov 5 23:37:00.791: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000004,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000004,UID:4a582f8b-6cf2-4e91-8770-fde6f9c22194,ResourceVersion:2653,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000004,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/4,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:32 +0000 UTC 2019-11-05 23:28:32 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:36:20 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:36:20 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:36:20 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:36:20 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.8} {Hostname k8s-master-73731178-vmss000004}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:252c632059f2483d87e2d8d689053e48,SystemUUID:5BBFFB00-FBAB-0F4A-8F63-6B99DE219F64,BootID:165ca62a-8171-48e8-92f7-3ad786cb6b9a,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:37:00.793] Nov 5 23:37:00.791: INFO: I1105 23:37:00.793] Logging kubelet events for node k8s-master-73731178-vmss000004 I1105 23:37:00.871] Nov 5 23:37:00.871: INFO: I1105 23:37:00.872] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000004 I1105 23:37:00.981] Nov 5 23:37:00.980: INFO: kube-apiserver-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:37:00.981] Nov 5 23:37:00.980: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:37:00.981] Nov 5 23:37:00.980: INFO: kube-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:37:00.981] Nov 5 23:37:00.980: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:37:00.981] Nov 5 23:37:00.980: INFO: kube-scheduler-k8s-master-73731178-vmss000004 started at 2019-11-05 23:28:31 +0000 UTC (0+1 container statuses recorded) I1105 23:37:00.981] Nov 5 23:37:00.980: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:37:00.981] Nov 5 23:37:00.980: INFO: azure-ip-masq-agent-rh9pr started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:37:00.982] Nov 5 23:37:00.980: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:37:00.982] Nov 5 23:37:00.980: INFO: kube-proxy-rk5r6 started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:37:00.982] Nov 5 23:37:00.980: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:37:00.982] Nov 5 23:37:00.980: INFO: cloud-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:37:00.982] Nov 5 23:37:00.980: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:37:00.982] Nov 5 23:37:00.980: INFO: kube-addon-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:37:00.982] Nov 5 23:37:00.980: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:37:01.237] Nov 5 23:37:01.237: INFO: I1105 23:37:01.238] Latency metrics for node k8s-master-73731178-vmss000004 I1105 23:37:01.238] Nov 5 23:37:01.237: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1105 23:37:01.316] STEP: Destroying namespace "azuredisk-6016" for this suite. I1105 23:37:15.552] Nov 5 23:37:15.552: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1105 23:37:18.521] Nov 5 23:37:18.520: INFO: namespace azuredisk-6016 deletion completed in 17.204348427s I1105 23:37:18.521] I1105 23:37:18.521] • Failure [324.936 seconds] I1105 23:37:18.521] [azuredisk-csi-e2e] Dynamic Provisioning I1105 23:37:18.521] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:33 I1105 23:37:18.521] [single-az] I1105 23:37:18.522] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:36 I1105 23:37:18.522] should create a raw block volume on demand [It] I1105 23:37:18.522] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:101 I1105 23:37:18.522] I1105 23:37:18.522] Unexpected error: I1105 23:37:18.522] <*errors.errorString | 0xc000238480>: { I1105 23:37:18.522] s: "PersistentVolumeClaims [pvc-4v87q] not all in phase Bound within 5m0s", I1105 23:37:18.523] } I1105 23:37:18.523] PersistentVolumeClaims [pvc-4v87q] not all in phase Bound within 5m0s I1105 23:37:18.523] occurred I1105 23:37:18.524] I1105 23:37:18.524] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1105 23:37:18.524] ------------------------------ I1105 23:37:18.524] [azuredisk-csi-e2e] Dynamic Provisioning [single-az] I1105 23:37:18.525] should create multiple PV objects, bind to PVCs and attach all to different pods on the same node I1105 23:37:18.525] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:151 I1105 23:37:18.525] [BeforeEach] [single-az] I1105 23:37:18.525] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1105 23:37:18.525] STEP: Creating a kubernetes client I1105 23:37:18.525] Nov 5 23:37:18.521: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1105 23:37:18.525] STEP: Building a namespace api object, basename azuredisk I1105 23:37:18.754] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-8925 I1105 23:37:19.011] STEP: Waiting for a default service account to be provisioned in namespace I1105 23:37:19.085] [BeforeEach] [single-az] I1105 23:37:19.086] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:58 I1105 23:37:19.086] [It] should create multiple PV objects, bind to PVCs and attach all to different pods on the same node I1105 23:37:19.086] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:151 I1105 23:37:19.086] STEP: setting up the StorageClass I1105 23:37:19.086] STEP: creating a StorageClass I1105 23:37:19.170] STEP: setting up the PVC and PV I1105 23:37:19.170] STEP: creating a PVC I1105 23:37:19.256] STEP: waiting for PVC to be in phase "Bound" I1105 23:37:19.256] Nov 5 23:37:19.256: INFO: Waiting up to 5m0s for PersistentVolumeClaims [pvc-n72lg] to have phase Bound I1105 23:37:19.332] Nov 5 23:37:19.332: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:21.410] Nov 5 23:37:21.409: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:23.486] Nov 5 23:37:23.486: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:25.563] Nov 5 23:37:25.563: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:27.640] Nov 5 23:37:27.640: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:29.717] Nov 5 23:37:29.717: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:31.796] Nov 5 23:37:31.796: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:33.873] Nov 5 23:37:33.873: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:35.951] Nov 5 23:37:35.951: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:38.029] Nov 5 23:37:38.029: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:40.106] Nov 5 23:37:40.106: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:42.184] Nov 5 23:37:42.183: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:44.261] Nov 5 23:37:44.261: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:46.339] Nov 5 23:37:46.339: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:48.417] Nov 5 23:37:48.416: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:50.494] Nov 5 23:37:50.494: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:52.571] Nov 5 23:37:52.571: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:54.648] Nov 5 23:37:54.648: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:56.726] Nov 5 23:37:56.726: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:37:58.803] Nov 5 23:37:58.803: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:00.880] Nov 5 23:38:00.880: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:02.957] Nov 5 23:38:02.957: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:05.035] Nov 5 23:38:05.035: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:07.112] Nov 5 23:38:07.112: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:09.189] Nov 5 23:38:09.189: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:11.266] Nov 5 23:38:11.266: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:13.343] Nov 5 23:38:13.343: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:15.420] Nov 5 23:38:15.420: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:17.498] Nov 5 23:38:17.498: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:19.575] Nov 5 23:38:19.575: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:21.653] Nov 5 23:38:21.653: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:23.779] Nov 5 23:38:23.779: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:25.857] Nov 5 23:38:25.856: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:27.933] Nov 5 23:38:27.933: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:30.011] Nov 5 23:38:30.011: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:32.089] Nov 5 23:38:32.089: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:34.166] Nov 5 23:38:34.166: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:36.248] Nov 5 23:38:36.248: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:38.325] Nov 5 23:38:38.325: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:40.402] Nov 5 23:38:40.402: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:42.485] Nov 5 23:38:42.485: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:44.562] Nov 5 23:38:44.562: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:46.639] Nov 5 23:38:46.639: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:48.717] Nov 5 23:38:48.717: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:50.794] Nov 5 23:38:50.794: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:52.872] Nov 5 23:38:52.872: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:54.949] Nov 5 23:38:54.949: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:57.026] Nov 5 23:38:57.026: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:38:59.105] Nov 5 23:38:59.105: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:01.183] Nov 5 23:39:01.182: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:03.272] Nov 5 23:39:03.272: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:05.350] Nov 5 23:39:05.349: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:07.427] Nov 5 23:39:07.427: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:09.504] Nov 5 23:39:09.504: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:11.580] Nov 5 23:39:11.580: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:13.657] Nov 5 23:39:13.657: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:15.735] Nov 5 23:39:15.735: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:17.812] Nov 5 23:39:17.812: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:19.890] Nov 5 23:39:19.889: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:21.967] Nov 5 23:39:21.967: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:24.048] Nov 5 23:39:24.048: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:26.125] Nov 5 23:39:26.125: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:28.205] Nov 5 23:39:28.205: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:30.282] Nov 5 23:39:30.282: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:32.359] Nov 5 23:39:32.359: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:34.435] Nov 5 23:39:34.435: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:36.513] Nov 5 23:39:36.512: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:38.589] Nov 5 23:39:38.589: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:40.666] Nov 5 23:39:40.666: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:42.747] Nov 5 23:39:42.747: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:44.825] Nov 5 23:39:44.825: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:46.903] Nov 5 23:39:46.902: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:48.980] Nov 5 23:39:48.980: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:51.057] Nov 5 23:39:51.057: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:53.134] Nov 5 23:39:53.134: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:55.212] Nov 5 23:39:55.212: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:57.289] Nov 5 23:39:57.289: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:39:59.366] Nov 5 23:39:59.366: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:01.444] Nov 5 23:40:01.444: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:03.521] Nov 5 23:40:03.521: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:05.598] Nov 5 23:40:05.598: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:07.675] Nov 5 23:40:07.675: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:09.752] Nov 5 23:40:09.752: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:11.830] Nov 5 23:40:11.830: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:13.907] Nov 5 23:40:13.907: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:15.984] Nov 5 23:40:15.984: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:18.062] Nov 5 23:40:18.062: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:20.140] Nov 5 23:40:20.140: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:22.218] Nov 5 23:40:22.217: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:24.295] Nov 5 23:40:24.295: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:26.372] Nov 5 23:40:26.372: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:28.451] Nov 5 23:40:28.451: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:30.528] Nov 5 23:40:30.528: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:32.605] Nov 5 23:40:32.605: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:34.682] Nov 5 23:40:34.682: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:36.759] Nov 5 23:40:36.759: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:38.836] Nov 5 23:40:38.836: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:40.913] Nov 5 23:40:40.912: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:42.990] Nov 5 23:40:42.989: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:45.066] Nov 5 23:40:45.066: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:47.143] Nov 5 23:40:47.143: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:49.230] Nov 5 23:40:49.229: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:51.308] Nov 5 23:40:51.308: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:53.385] Nov 5 23:40:53.385: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:55.463] Nov 5 23:40:55.462: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:57.540] Nov 5 23:40:57.539: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:40:59.617] Nov 5 23:40:59.617: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:01.696] Nov 5 23:41:01.695: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:03.773] Nov 5 23:41:03.772: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:05.850] Nov 5 23:41:05.850: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:07.927] Nov 5 23:41:07.927: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:10.004] Nov 5 23:41:10.004: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:12.082] Nov 5 23:41:12.082: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:14.160] Nov 5 23:41:14.160: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:16.241] Nov 5 23:41:16.240: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:18.318] Nov 5 23:41:18.318: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:20.396] Nov 5 23:41:20.396: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:22.474] Nov 5 23:41:22.473: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:24.551] Nov 5 23:41:24.551: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:26.629] Nov 5 23:41:26.629: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:28.706] Nov 5 23:41:28.706: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:30.784] Nov 5 23:41:30.784: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:32.861] Nov 5 23:41:32.861: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:34.939] Nov 5 23:41:34.939: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:37.016] Nov 5 23:41:37.016: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:39.101] Nov 5 23:41:39.101: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:41.186] Nov 5 23:41:41.186: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:43.272] Nov 5 23:41:43.272: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:45.356] Nov 5 23:41:45.356: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:47.444] Nov 5 23:41:47.444: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:49.528] Nov 5 23:41:49.528: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:51.613] Nov 5 23:41:51.613: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:53.698] Nov 5 23:41:53.697: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:55.782] Nov 5 23:41:55.781: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:57.866] Nov 5 23:41:57.866: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:41:59.950] Nov 5 23:41:59.950: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:42:02.034] Nov 5 23:42:02.034: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:42:04.118] Nov 5 23:42:04.118: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:42:06.202] Nov 5 23:42:06.202: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:42:08.286] Nov 5 23:42:08.286: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:42:10.370] Nov 5 23:42:10.370: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:42:12.454] Nov 5 23:42:12.454: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:42:14.539] Nov 5 23:42:14.538: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:42:16.624] Nov 5 23:42:16.624: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:42:18.708] Nov 5 23:42:18.708: INFO: PersistentVolumeClaim pvc-n72lg found but phase is Pending instead of Bound. I1105 23:42:20.709] Nov 5 23:42:20.708: INFO: Unexpected error occurred: PersistentVolumeClaims [pvc-n72lg] not all in phase Bound within 5m0s I1105 23:42:20.709] [AfterEach] [single-az] I1105 23:42:20.710] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1105 23:42:20.710] STEP: Collecting events from namespace "azuredisk-8925". I1105 23:42:20.793] STEP: Found 3 events. I1105 23:42:20.794] Nov 5 23:42:20.793: INFO: At 2019-11-05 23:37:19 +0000 UTC - event for pvc-n72lg: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator I1105 23:42:20.794] Nov 5 23:42:20.793: INFO: At 2019-11-05 23:37:19 +0000 UTC - event for pvc-n72lg: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } Provisioning: External provisioner is provisioning volume for claim "azuredisk-8925/pvc-n72lg" I1105 23:42:20.794] Nov 5 23:42:20.793: INFO: At 2019-11-05 23:37:29 +0000 UTC - event for pvc-n72lg: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-8925-disk.csi.azure.com-dynamic-sc-28z88": rpc error: code = DeadlineExceeded desc = context deadline exceeded I1105 23:42:20.877] Nov 5 23:42:20.877: INFO: POD NODE PHASE GRACE CONDITIONS I1105 23:42:20.877] Nov 5 23:42:20.877: INFO: I1105 23:42:21.126] Nov 5 23:42:21.126: INFO: I1105 23:42:21.126] Logging node info for node k8s-agentpool-73731178-vmss000000 I1105 23:42:21.213] Nov 5 23:42:21.210: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000000,UID:e9bc0b16-6756-4155-b49c-e223c0ba9499,ResourceVersion:3600,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-1,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000000"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:18 +0000 UTC 2019-11-05 23:28:18 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:41:34 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:41:34 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:41:34 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:41:34 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.4} {Hostname k8s-agentpool-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:956ad861ae4a42099801f8e840b4e502,SystemUUID:439CF4B9-2B9F-B74E-9ED7-7379FD8BD0DF,BootID:bd3476e5-4fd4-4437-9b56-54fbe38a3a49,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1] 121711221} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/metrics-server-amd64@sha256:49a9f12f7067d11f42c803dbe61ed2c1299959ad85cb315b25ff7eef8e6b8892 k8s.gcr.io/metrics-server-amd64:v0.2.1] 42541759} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:42:21.214] Nov 5 23:42:21.211: INFO: I1105 23:42:21.214] Logging kubelet events for node k8s-agentpool-73731178-vmss000000 I1105 23:42:21.298] Nov 5 23:42:21.298: INFO: I1105 23:42:21.299] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000000 I1105 23:42:21.388] Nov 5 23:42:21.388: INFO: keyvault-flexvolume-xr7v6 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:21.389] Nov 5 23:42:21.388: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1105 23:42:21.389] Nov 5 23:42:21.388: INFO: metrics-server-864ffbc5c-kb9cz started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:21.389] Nov 5 23:42:21.388: INFO: Container metrics-server ready: true, restart count 0 I1105 23:42:21.389] Nov 5 23:42:21.388: INFO: kube-proxy-jnqp8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:21.389] Nov 5 23:42:21.388: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:42:21.389] Nov 5 23:42:21.388: INFO: kubernetes-dashboard-66dd8b8df7-4rnsp started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:42:21.390] Nov 5 23:42:21.388: INFO: Container kubernetes-dashboard ready: true, restart count 1 I1105 23:42:21.390] Nov 5 23:42:21.388: INFO: csi-azuredisk-node-g6wbm started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1105 23:42:21.390] Nov 5 23:42:21.388: INFO: Container azuredisk ready: true, restart count 0 I1105 23:42:21.390] Nov 5 23:42:21.388: INFO: Container liveness-probe ready: true, restart count 0 I1105 23:42:21.390] Nov 5 23:42:21.388: INFO: Container node-driver-registrar ready: true, restart count 0 I1105 23:42:21.390] Nov 5 23:42:21.388: INFO: blobfuse-flexvol-installer-cvgkv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:21.391] Nov 5 23:42:21.388: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1105 23:42:21.391] Nov 5 23:42:21.388: INFO: azure-ip-masq-agent-vn5zc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:21.391] Nov 5 23:42:21.388: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:42:21.658] Nov 5 23:42:21.658: INFO: I1105 23:42:21.658] Latency metrics for node k8s-agentpool-73731178-vmss000000 I1105 23:42:21.658] Nov 5 23:42:21.658: INFO: I1105 23:42:21.658] Logging node info for node k8s-agentpool-73731178-vmss000001 I1105 23:42:21.744] Nov 5 23:42:21.741: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000001,UID:ab75ba9d-ec23-4ff7-ae5a-d1a19974c05d,ResourceVersion:3681,Generation:0,CreationTimestamp:2019-11-05 23:27:31 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-2,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000001"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.5.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:17 +0000 UTC 2019-11-05 23:28:17 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:42:03 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:42:03 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:42:03 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:42:03 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.5} {Hostname k8s-agentpool-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f0eae5e73d0f4ccb82dd0f22701c288f,SystemUUID:7E54C533-AED3-744D-8D17-EFF5E62EA06D,BootID:6d58e5a6-45fb-4a41-a491-bc2f3799f411,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[gcr.io/kubernetes-helm/tiller@sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1 gcr.io/kubernetes-helm/tiller:v2.11.0] 71821984} {[quay.io/k8scsi/csi-provisioner@sha256:d657c839dce87324fe2b677302913f9386f885f8746be7bea0ced5b0844e3433 quay.io/k8scsi/csi-provisioner:v1.3.1] 50596998} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0] 46226754} {[quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1] 45874691} {[quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb quay.io/k8scsi/csi-snapshotter:v1.1.0] 44325352} {[k8s.gcr.io/coredns@sha256:e83beb5e43f8513fa735e77ffc5859640baea30a882a11cc75c4c3244a737d3c k8s.gcr.io/coredns:1.5.0] 42488424} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0] 14967303} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:42:21.744] Nov 5 23:42:21.741: INFO: I1105 23:42:21.745] Logging kubelet events for node k8s-agentpool-73731178-vmss000001 I1105 23:42:21.829] Nov 5 23:42:21.829: INFO: I1105 23:42:21.829] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000001 I1105 23:42:21.919] Nov 5 23:42:21.919: INFO: kube-proxy-z4hf8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:21.920] Nov 5 23:42:21.919: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:42:21.920] Nov 5 23:42:21.919: INFO: tiller-deploy-54c96cb5df-wlzbj started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:42:21.920] Nov 5 23:42:21.919: INFO: Container tiller ready: true, restart count 0 I1105 23:42:21.920] Nov 5 23:42:21.919: INFO: csi-azuredisk-node-ml68k started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1105 23:42:21.920] Nov 5 23:42:21.919: INFO: Container azuredisk ready: true, restart count 0 I1105 23:42:21.920] Nov 5 23:42:21.919: INFO: Container liveness-probe ready: true, restart count 0 I1105 23:42:21.921] Nov 5 23:42:21.919: INFO: Container node-driver-registrar ready: true, restart count 0 I1105 23:42:21.921] Nov 5 23:42:21.919: INFO: csi-azuredisk-controller-59bf945f54-k2p5m started at 2019-11-05 23:30:58 +0000 UTC (0+6 container statuses recorded) I1105 23:42:21.921] Nov 5 23:42:21.919: INFO: Container azuredisk ready: true, restart count 0 I1105 23:42:21.921] Nov 5 23:42:21.919: INFO: Container cluster-driver-registrar ready: true, restart count 0 I1105 23:42:21.921] Nov 5 23:42:21.919: INFO: Container csi-attacher ready: true, restart count 0 I1105 23:42:21.921] Nov 5 23:42:21.919: INFO: Container csi-provisioner ready: true, restart count 0 I1105 23:42:21.921] Nov 5 23:42:21.919: INFO: Container csi-snapshotter ready: true, restart count 0 I1105 23:42:21.922] Nov 5 23:42:21.919: INFO: Container liveness-probe ready: true, restart count 0 I1105 23:42:21.922] Nov 5 23:42:21.919: INFO: blobfuse-flexvol-installer-589vv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:21.922] Nov 5 23:42:21.919: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1105 23:42:21.922] Nov 5 23:42:21.919: INFO: coredns-7f68dcdbdb-f98nq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:21.922] Nov 5 23:42:21.919: INFO: Container coredns ready: true, restart count 0 I1105 23:42:21.922] Nov 5 23:42:21.919: INFO: azure-ip-masq-agent-6qqgc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:21.922] Nov 5 23:42:21.919: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:42:21.923] Nov 5 23:42:21.919: INFO: keyvault-flexvolume-7tztj started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:21.923] Nov 5 23:42:21.919: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1105 23:42:22.201] Nov 5 23:42:22.201: INFO: I1105 23:42:22.201] Latency metrics for node k8s-agentpool-73731178-vmss000001 I1105 23:42:22.202] Nov 5 23:42:22.201: INFO: I1105 23:42:22.202] Logging node info for node k8s-master-73731178-vmss000000 I1105 23:42:22.287] Nov 5 23:42:22.285: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000000,UID:1f765350-accc-4e67-898b-e4d84be84901,ResourceVersion:3562,Generation:0,CreationTimestamp:2019-11-05 23:27:30 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:41:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:41:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:41:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:41:22 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.4} {Hostname k8s-master-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:836af7329e85492184d73f1ea7f63a4e,SystemUUID:D1C68207-4499-C24D-B9D6-ADA0554A1BE5,BootID:a29dde5d-b4dc-483e-a50e-76e79359d759,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:42:22.288] Nov 5 23:42:22.285: INFO: I1105 23:42:22.288] Logging kubelet events for node k8s-master-73731178-vmss000000 I1105 23:42:22.374] Nov 5 23:42:22.374: INFO: I1105 23:42:22.374] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000000 I1105 23:42:22.463] Nov 5 23:42:22.463: INFO: kube-proxy-2fwv9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:22.464] Nov 5 23:42:22.463: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:42:22.464] Nov 5 23:42:22.463: INFO: kube-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:42:22.464] Nov 5 23:42:22.463: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:42:22.464] Nov 5 23:42:22.463: INFO: kube-scheduler-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:42:22.464] Nov 5 23:42:22.463: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:42:22.464] Nov 5 23:42:22.463: INFO: cloud-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:42:22.465] Nov 5 23:42:22.463: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:42:22.465] Nov 5 23:42:22.463: INFO: kube-addon-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:42:22.465] Nov 5 23:42:22.463: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:42:22.465] Nov 5 23:42:22.463: INFO: kube-apiserver-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:42:22.465] Nov 5 23:42:22.463: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:42:22.465] Nov 5 23:42:22.463: INFO: azure-ip-masq-agent-xmkx2 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:22.466] Nov 5 23:42:22.463: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:42:22.735] Nov 5 23:42:22.735: INFO: I1105 23:42:22.735] Latency metrics for node k8s-master-73731178-vmss000000 I1105 23:42:22.735] Nov 5 23:42:22.735: INFO: I1105 23:42:22.736] Logging node info for node k8s-master-73731178-vmss000001 I1105 23:42:22.822] Nov 5 23:42:22.819: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000001,UID:442cf114-6b0a-4c80-a9e5-be62e184f94c,ResourceVersion:3685,Generation:0,CreationTimestamp:2019-11-05 23:27:42 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:19 +0000 UTC 2019-11-05 23:28:19 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:42:04 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:42:04 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:42:04 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:42:04 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.5} {Hostname k8s-master-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1a9da6632c314858a31bccaea0be0f50,SystemUUID:8F48A76E-30E1-B948-89B2-33C0048059B4,BootID:1597124c-68a3-452c-ae03-6cfe9bc1e57f,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:42:22.822] Nov 5 23:42:22.820: INFO: I1105 23:42:22.822] Logging kubelet events for node k8s-master-73731178-vmss000001 I1105 23:42:22.908] Nov 5 23:42:22.908: INFO: I1105 23:42:22.908] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000001 I1105 23:42:22.997] Nov 5 23:42:22.997: INFO: kube-addon-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:42:22.997] Nov 5 23:42:22.997: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:42:22.997] Nov 5 23:42:22.997: INFO: kube-apiserver-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:42:22.998] Nov 5 23:42:22.997: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:42:22.998] Nov 5 23:42:22.997: INFO: kube-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:42:22.998] Nov 5 23:42:22.997: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:42:22.998] Nov 5 23:42:22.997: INFO: azure-ip-masq-agent-825g9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:22.998] Nov 5 23:42:22.997: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:42:22.998] Nov 5 23:42:22.997: INFO: kube-proxy-8924t started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:22.999] Nov 5 23:42:22.997: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:42:22.999] Nov 5 23:42:22.997: INFO: kube-scheduler-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:42:22.999] Nov 5 23:42:22.997: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:42:22.999] Nov 5 23:42:22.997: INFO: cloud-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:42:22.999] Nov 5 23:42:22.997: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:42:23.268] Nov 5 23:42:23.267: INFO: I1105 23:42:23.268] Latency metrics for node k8s-master-73731178-vmss000001 I1105 23:42:23.268] Nov 5 23:42:23.267: INFO: I1105 23:42:23.269] Logging node info for node k8s-master-73731178-vmss000002 I1105 23:42:23.353] Nov 5 23:42:23.351: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000002,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000002,UID:6cf1398e-1b6b-4537-837d-9ffceb9a4f00,ResourceVersion:3571,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000002,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.6.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/2,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:27:55 +0000 UTC 2019-11-05 23:27:55 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:41:24 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:41:24 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:41:24 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:41:24 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.6} {Hostname k8s-master-73731178-vmss000002}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7964689c8ba4f448e6f435b3d4fefac,SystemUUID:9369535A-87BF-1E4B-86DF-5D1A23713C9F,BootID:74f93904-298f-454d-8df6-8d4bba193331,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:42:23.354] Nov 5 23:42:23.351: INFO: I1105 23:42:23.354] Logging kubelet events for node k8s-master-73731178-vmss000002 I1105 23:42:23.448] Nov 5 23:42:23.448: INFO: I1105 23:42:23.449] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000002 I1105 23:42:23.537] Nov 5 23:42:23.537: INFO: azure-ip-masq-agent-74xks started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:23.537] Nov 5 23:42:23.537: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:42:23.538] Nov 5 23:42:23.537: INFO: kube-proxy-t958f started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:23.538] Nov 5 23:42:23.537: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:42:23.538] Nov 5 23:42:23.537: INFO: kube-addon-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:18 +0000 UTC (0+1 container statuses recorded) I1105 23:42:23.538] Nov 5 23:42:23.537: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:42:23.538] Nov 5 23:42:23.537: INFO: kube-apiserver-k8s-master-73731178-vmss000002 started at 2019-11-05 23:28:42 +0000 UTC (0+1 container statuses recorded) I1105 23:42:23.539] Nov 5 23:42:23.537: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:42:23.539] Nov 5 23:42:23.537: INFO: kube-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1105 23:42:23.539] Nov 5 23:42:23.537: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:42:23.539] Nov 5 23:42:23.537: INFO: kube-scheduler-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1105 23:42:23.539] Nov 5 23:42:23.537: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:42:23.540] Nov 5 23:42:23.537: INFO: cloud-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1105 23:42:23.540] Nov 5 23:42:23.537: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:42:23.806] Nov 5 23:42:23.806: INFO: I1105 23:42:23.807] Latency metrics for node k8s-master-73731178-vmss000002 I1105 23:42:23.807] Nov 5 23:42:23.806: INFO: I1105 23:42:23.807] Logging node info for node k8s-master-73731178-vmss000003 I1105 23:42:23.894] Nov 5 23:42:23.891: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000003,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000003,UID:54efc1b0-183c-4153-b804-31d0d42ce204,ResourceVersion:3734,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000003,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/3,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:42:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:42:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:42:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:42:22 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{Hostname k8s-master-73731178-vmss000003} {InternalIP 10.240.0.7}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a448072d2d27400fa2252a0cb3c8ff37,SystemUUID:98F6A517-FFCA-8E4D-A914-52A5F1482433,BootID:50c0f9e6-7c4d-45ec-8984-248ea540d637,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:42:23.894] Nov 5 23:42:23.891: INFO: I1105 23:42:23.894] Logging kubelet events for node k8s-master-73731178-vmss000003 I1105 23:42:23.980] Nov 5 23:42:23.980: INFO: I1105 23:42:23.980] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000003 I1105 23:42:24.071] Nov 5 23:42:24.071: INFO: cloud-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:42:24.071] Nov 5 23:42:24.071: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:42:24.071] Nov 5 23:42:24.071: INFO: kube-addon-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:43 +0000 UTC (0+1 container statuses recorded) I1105 23:42:24.071] Nov 5 23:42:24.071: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:42:24.071] Nov 5 23:42:24.071: INFO: kube-apiserver-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:42:24.072] Nov 5 23:42:24.071: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:42:24.072] Nov 5 23:42:24.071: INFO: kube-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:42:24.072] Nov 5 23:42:24.071: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:42:24.072] Nov 5 23:42:24.071: INFO: kube-scheduler-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:42:24.072] Nov 5 23:42:24.071: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:42:24.072] Nov 5 23:42:24.071: INFO: azure-ip-masq-agent-4nshf started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:24.072] Nov 5 23:42:24.071: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:42:24.072] Nov 5 23:42:24.071: INFO: kube-proxy-qm7rq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:42:24.073] Nov 5 23:42:24.071: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:42:24.351] Nov 5 23:42:24.351: INFO: I1105 23:42:24.352] Latency metrics for node k8s-master-73731178-vmss000003 I1105 23:42:24.352] Nov 5 23:42:24.351: INFO: I1105 23:42:24.352] Logging node info for node k8s-master-73731178-vmss000004 I1105 23:42:24.438] Nov 5 23:42:24.435: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000004,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000004,UID:4a582f8b-6cf2-4e91-8770-fde6f9c22194,ResourceVersion:3727,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000004,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/4,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:32 +0000 UTC 2019-11-05 23:28:32 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:42:21 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:42:21 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:42:21 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:42:21 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.8} {Hostname k8s-master-73731178-vmss000004}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:252c632059f2483d87e2d8d689053e48,SystemUUID:5BBFFB00-FBAB-0F4A-8F63-6B99DE219F64,BootID:165ca62a-8171-48e8-92f7-3ad786cb6b9a,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:42:24.438] Nov 5 23:42:24.435: INFO: I1105 23:42:24.438] Logging kubelet events for node k8s-master-73731178-vmss000004 I1105 23:42:24.523] Nov 5 23:42:24.523: INFO: I1105 23:42:24.523] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000004 I1105 23:42:24.610] Nov 5 23:42:24.610: INFO: cloud-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:42:24.611] Nov 5 23:42:24.610: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:42:24.611] Nov 5 23:42:24.610: INFO: kube-addon-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:42:24.611] Nov 5 23:42:24.610: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:42:24.611] Nov 5 23:42:24.610: INFO: kube-apiserver-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:42:24.611] Nov 5 23:42:24.610: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:42:24.612] Nov 5 23:42:24.610: INFO: kube-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:42:24.612] Nov 5 23:42:24.610: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:42:24.612] Nov 5 23:42:24.610: INFO: kube-scheduler-k8s-master-73731178-vmss000004 started at 2019-11-05 23:28:31 +0000 UTC (0+1 container statuses recorded) I1105 23:42:24.612] Nov 5 23:42:24.610: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:42:24.612] Nov 5 23:42:24.610: INFO: azure-ip-masq-agent-rh9pr started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:42:24.612] Nov 5 23:42:24.610: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:42:24.613] Nov 5 23:42:24.610: INFO: kube-proxy-rk5r6 started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:42:24.613] Nov 5 23:42:24.610: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:42:24.882] Nov 5 23:42:24.882: INFO: I1105 23:42:24.882] Latency metrics for node k8s-master-73731178-vmss000004 I1105 23:42:24.882] Nov 5 23:42:24.882: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1105 23:42:24.967] STEP: Destroying namespace "azuredisk-8925" for this suite. I1105 23:42:39.228] Nov 5 23:42:39.228: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1105 23:42:42.415] Nov 5 23:42:42.414: INFO: namespace azuredisk-8925 deletion completed in 17.447587358s I1105 23:42:42.415] I1105 23:42:42.415] • Failure [323.894 seconds] I1105 23:42:42.415] [azuredisk-csi-e2e] Dynamic Provisioning I1105 23:42:42.415] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:33 I1105 23:42:42.416] [single-az] I1105 23:42:42.416] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:36 I1105 23:42:42.416] should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [It] I1105 23:42:42.416] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:151 I1105 23:42:42.416] I1105 23:42:42.416] Unexpected error: I1105 23:42:42.416] <*errors.errorString | 0xc000dbc950>: { I1105 23:42:42.417] s: "PersistentVolumeClaims [pvc-n72lg] not all in phase Bound within 5m0s", I1105 23:42:42.417] } I1105 23:42:42.417] PersistentVolumeClaims [pvc-n72lg] not all in phase Bound within 5m0s I1105 23:42:42.417] occurred I1105 23:42:42.417] I1105 23:42:42.417] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1105 23:42:42.418] ------------------------------ I1105 23:42:42.418] [azuredisk-csi-e2e] Dynamic Provisioning [single-az] I1105 23:42:42.418] should create a volume on demand and mount it as readOnly in a pod I1105 23:42:42.418] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:126 I1105 23:42:42.418] [BeforeEach] [single-az] I1105 23:42:42.419] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1105 23:42:42.419] STEP: Creating a kubernetes client I1105 23:42:42.419] Nov 5 23:42:42.415: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1105 23:42:42.419] STEP: Building a namespace api object, basename azuredisk I1105 23:42:42.669] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-2836 I1105 23:42:42.942] STEP: Waiting for a default service account to be provisioned in namespace I1105 23:42:43.023] [BeforeEach] [single-az] I1105 23:42:43.024] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:58 I1105 23:42:43.024] [It] should create a volume on demand and mount it as readOnly in a pod I1105 23:42:43.024] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:126 I1105 23:42:43.024] STEP: setting up the StorageClass I1105 23:42:43.024] STEP: creating a StorageClass I1105 23:42:43.112] STEP: setting up the PVC and PV I1105 23:42:43.112] STEP: creating a PVC I1105 23:42:43.202] STEP: waiting for PVC to be in phase "Bound" I1105 23:42:43.203] Nov 5 23:42:43.202: INFO: Waiting up to 5m0s for PersistentVolumeClaims [pvc-25lxh] to have phase Bound I1105 23:42:43.286] Nov 5 23:42:43.286: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:42:45.370] Nov 5 23:42:45.370: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:42:47.463] Nov 5 23:42:47.463: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:42:49.548] Nov 5 23:42:49.547: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:42:51.633] Nov 5 23:42:51.632: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:42:53.717] Nov 5 23:42:53.717: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:42:55.802] Nov 5 23:42:55.801: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:42:57.886] Nov 5 23:42:57.886: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:42:59.971] Nov 5 23:42:59.970: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:02.056] Nov 5 23:43:02.055: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:04.139] Nov 5 23:43:04.139: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:06.224] Nov 5 23:43:06.224: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:08.310] Nov 5 23:43:08.310: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:10.395] Nov 5 23:43:10.395: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:12.480] Nov 5 23:43:12.480: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:14.564] Nov 5 23:43:14.564: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:16.649] Nov 5 23:43:16.649: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:18.734] Nov 5 23:43:18.734: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:20.818] Nov 5 23:43:20.818: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:22.902] Nov 5 23:43:22.902: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:24.986] Nov 5 23:43:24.986: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:27.071] Nov 5 23:43:27.070: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:29.155] Nov 5 23:43:29.155: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:31.240] Nov 5 23:43:31.240: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:33.324] Nov 5 23:43:33.324: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:35.408] Nov 5 23:43:35.408: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:37.493] Nov 5 23:43:37.493: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:39.577] Nov 5 23:43:39.577: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:41.661] Nov 5 23:43:41.661: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:43.746] Nov 5 23:43:43.745: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:45.830] Nov 5 23:43:45.830: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:47.915] Nov 5 23:43:47.915: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:50.001] Nov 5 23:43:50.001: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:52.086] Nov 5 23:43:52.086: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:54.171] Nov 5 23:43:54.170: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:56.256] Nov 5 23:43:56.255: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:43:58.339] Nov 5 23:43:58.339: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:00.423] Nov 5 23:44:00.423: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:02.508] Nov 5 23:44:02.508: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:04.592] Nov 5 23:44:04.592: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:06.676] Nov 5 23:44:06.676: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:08.760] Nov 5 23:44:08.760: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:10.844] Nov 5 23:44:10.844: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:12.929] Nov 5 23:44:12.929: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:15.013] Nov 5 23:44:15.013: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:17.097] Nov 5 23:44:17.097: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:19.181] Nov 5 23:44:19.181: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:21.265] Nov 5 23:44:21.265: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:23.350] Nov 5 23:44:23.350: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:25.435] Nov 5 23:44:25.434: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:27.519] Nov 5 23:44:27.519: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:29.603] Nov 5 23:44:29.603: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:31.688] Nov 5 23:44:31.687: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:33.773] Nov 5 23:44:33.773: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:35.857] Nov 5 23:44:35.857: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:37.944] Nov 5 23:44:37.943: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:40.032] Nov 5 23:44:40.032: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:42.117] Nov 5 23:44:42.117: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:44.201] Nov 5 23:44:44.201: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:46.285] Nov 5 23:44:46.285: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:48.369] Nov 5 23:44:48.369: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:50.454] Nov 5 23:44:50.453: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:52.538] Nov 5 23:44:52.538: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:54.623] Nov 5 23:44:54.622: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:56.706] Nov 5 23:44:56.706: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:44:58.790] Nov 5 23:44:58.790: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:00.874] Nov 5 23:45:00.874: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:02.959] Nov 5 23:45:02.958: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:05.044] Nov 5 23:45:05.043: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:07.128] Nov 5 23:45:07.128: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:09.212] Nov 5 23:45:09.212: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:11.297] Nov 5 23:45:11.297: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:13.382] Nov 5 23:45:13.381: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:15.467] Nov 5 23:45:15.466: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:17.551] Nov 5 23:45:17.550: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:19.635] Nov 5 23:45:19.634: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:21.718] Nov 5 23:45:21.718: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:23.803] Nov 5 23:45:23.802: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:25.887] Nov 5 23:45:25.887: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:27.972] Nov 5 23:45:27.972: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:30.056] Nov 5 23:45:30.056: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:32.140] Nov 5 23:45:32.140: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:34.223] Nov 5 23:45:34.223: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:36.307] Nov 5 23:45:36.307: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:38.391] Nov 5 23:45:38.391: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:40.477] Nov 5 23:45:40.476: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:42.560] Nov 5 23:45:42.560: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:44.645] Nov 5 23:45:44.645: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:46.729] Nov 5 23:45:46.729: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:48.814] Nov 5 23:45:48.814: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:50.898] Nov 5 23:45:50.898: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:52.982] Nov 5 23:45:52.982: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:55.067] Nov 5 23:45:55.067: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:57.151] Nov 5 23:45:57.151: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:45:59.235] Nov 5 23:45:59.235: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:01.319] Nov 5 23:46:01.319: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:03.403] Nov 5 23:46:03.402: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:05.486] Nov 5 23:46:05.486: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:07.572] Nov 5 23:46:07.571: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:09.656] Nov 5 23:46:09.656: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:11.742] Nov 5 23:46:11.742: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:13.828] Nov 5 23:46:13.828: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:15.912] Nov 5 23:46:15.912: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:17.996] Nov 5 23:46:17.996: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:20.080] Nov 5 23:46:20.080: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:22.164] Nov 5 23:46:22.164: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:24.248] Nov 5 23:46:24.248: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:26.332] Nov 5 23:46:26.332: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:28.416] Nov 5 23:46:28.416: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:30.501] Nov 5 23:46:30.501: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:32.585] Nov 5 23:46:32.585: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:34.670] Nov 5 23:46:34.670: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:36.754] Nov 5 23:46:36.754: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:38.840] Nov 5 23:46:38.839: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:40.929] Nov 5 23:46:40.929: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:43.014] Nov 5 23:46:43.014: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:45.098] Nov 5 23:46:45.097: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:47.183] Nov 5 23:46:47.182: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:49.266] Nov 5 23:46:49.266: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:51.350] Nov 5 23:46:51.350: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:53.434] Nov 5 23:46:53.434: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:55.518] Nov 5 23:46:55.518: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:57.602] Nov 5 23:46:57.602: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:46:59.686] Nov 5 23:46:59.686: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:01.770] Nov 5 23:47:01.770: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:03.854] Nov 5 23:47:03.854: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:05.938] Nov 5 23:47:05.938: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:08.030] Nov 5 23:47:08.030: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:10.114] Nov 5 23:47:10.114: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:12.198] Nov 5 23:47:12.198: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:14.282] Nov 5 23:47:14.282: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:16.366] Nov 5 23:47:16.366: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:18.451] Nov 5 23:47:18.451: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:20.535] Nov 5 23:47:20.535: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:22.619] Nov 5 23:47:22.619: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:24.704] Nov 5 23:47:24.703: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:26.788] Nov 5 23:47:26.788: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:28.872] Nov 5 23:47:28.872: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:30.950] Nov 5 23:47:30.950: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:33.027] Nov 5 23:47:33.027: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:35.104] Nov 5 23:47:35.104: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:37.181] Nov 5 23:47:37.181: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:39.258] Nov 5 23:47:39.257: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:41.335] Nov 5 23:47:41.334: INFO: PersistentVolumeClaim pvc-25lxh found but phase is Pending instead of Bound. I1105 23:47:43.335] Nov 5 23:47:43.335: INFO: Unexpected error occurred: PersistentVolumeClaims [pvc-25lxh] not all in phase Bound within 5m0s I1105 23:47:43.335] [AfterEach] [single-az] I1105 23:47:43.336] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1105 23:47:43.336] STEP: Collecting events from namespace "azuredisk-2836". I1105 23:47:43.413] STEP: Found 3 events. I1105 23:47:43.413] Nov 5 23:47:43.413: INFO: At 2019-11-05 23:42:43 +0000 UTC - event for pvc-25lxh: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator I1105 23:47:43.413] Nov 5 23:47:43.413: INFO: At 2019-11-05 23:42:43 +0000 UTC - event for pvc-25lxh: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } Provisioning: External provisioner is provisioning volume for claim "azuredisk-2836/pvc-25lxh" I1105 23:47:43.414] Nov 5 23:47:43.413: INFO: At 2019-11-05 23:42:53 +0000 UTC - event for pvc-25lxh: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-2836-disk.csi.azure.com-dynamic-sc-6rtz6": rpc error: code = DeadlineExceeded desc = context deadline exceeded I1105 23:47:43.489] Nov 5 23:47:43.489: INFO: POD NODE PHASE GRACE CONDITIONS I1105 23:47:43.490] Nov 5 23:47:43.489: INFO: I1105 23:47:43.717] Nov 5 23:47:43.717: INFO: I1105 23:47:43.717] Logging node info for node k8s-agentpool-73731178-vmss000000 I1105 23:47:43.796] Nov 5 23:47:43.793: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000000,UID:e9bc0b16-6756-4155-b49c-e223c0ba9499,ResourceVersion:4671,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-1,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000000"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:18 +0000 UTC 2019-11-05 23:28:18 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:47:35 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:47:35 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:47:35 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:47:35 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.4} {Hostname k8s-agentpool-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:956ad861ae4a42099801f8e840b4e502,SystemUUID:439CF4B9-2B9F-B74E-9ED7-7379FD8BD0DF,BootID:bd3476e5-4fd4-4437-9b56-54fbe38a3a49,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1] 121711221} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/metrics-server-amd64@sha256:49a9f12f7067d11f42c803dbe61ed2c1299959ad85cb315b25ff7eef8e6b8892 k8s.gcr.io/metrics-server-amd64:v0.2.1] 42541759} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:47:43.796] Nov 5 23:47:43.793: INFO: I1105 23:47:43.796] Logging kubelet events for node k8s-agentpool-73731178-vmss000000 I1105 23:47:43.874] Nov 5 23:47:43.873: INFO: I1105 23:47:43.874] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000000 I1105 23:47:43.955] Nov 5 23:47:43.954: INFO: keyvault-flexvolume-xr7v6 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:43.955] Nov 5 23:47:43.954: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1105 23:47:43.955] Nov 5 23:47:43.954: INFO: metrics-server-864ffbc5c-kb9cz started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:43.955] Nov 5 23:47:43.954: INFO: Container metrics-server ready: true, restart count 0 I1105 23:47:43.955] Nov 5 23:47:43.954: INFO: kube-proxy-jnqp8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:43.955] Nov 5 23:47:43.954: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:47:43.955] Nov 5 23:47:43.954: INFO: kubernetes-dashboard-66dd8b8df7-4rnsp started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:47:43.956] Nov 5 23:47:43.954: INFO: Container kubernetes-dashboard ready: true, restart count 1 I1105 23:47:43.956] Nov 5 23:47:43.954: INFO: csi-azuredisk-node-g6wbm started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1105 23:47:43.956] Nov 5 23:47:43.954: INFO: Container azuredisk ready: true, restart count 0 I1105 23:47:43.956] Nov 5 23:47:43.954: INFO: Container liveness-probe ready: true, restart count 0 I1105 23:47:43.956] Nov 5 23:47:43.954: INFO: Container node-driver-registrar ready: true, restart count 0 I1105 23:47:43.956] Nov 5 23:47:43.954: INFO: blobfuse-flexvol-installer-cvgkv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:43.956] Nov 5 23:47:43.954: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1105 23:47:43.956] Nov 5 23:47:43.954: INFO: azure-ip-masq-agent-vn5zc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:43.957] Nov 5 23:47:43.954: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:47:44.222] Nov 5 23:47:44.222: INFO: I1105 23:47:44.222] Latency metrics for node k8s-agentpool-73731178-vmss000000 I1105 23:47:44.222] Nov 5 23:47:44.222: INFO: I1105 23:47:44.222] Logging node info for node k8s-agentpool-73731178-vmss000001 I1105 23:47:44.302] Nov 5 23:47:44.298: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000001,UID:ab75ba9d-ec23-4ff7-ae5a-d1a19974c05d,ResourceVersion:4580,Generation:0,CreationTimestamp:2019-11-05 23:27:31 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-2,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000001"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.5.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:17 +0000 UTC 2019-11-05 23:28:17 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:47:04 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:47:04 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:47:04 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:47:04 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.5} {Hostname k8s-agentpool-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f0eae5e73d0f4ccb82dd0f22701c288f,SystemUUID:7E54C533-AED3-744D-8D17-EFF5E62EA06D,BootID:6d58e5a6-45fb-4a41-a491-bc2f3799f411,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[gcr.io/kubernetes-helm/tiller@sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1 gcr.io/kubernetes-helm/tiller:v2.11.0] 71821984} {[quay.io/k8scsi/csi-provisioner@sha256:d657c839dce87324fe2b677302913f9386f885f8746be7bea0ced5b0844e3433 quay.io/k8scsi/csi-provisioner:v1.3.1] 50596998} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0] 46226754} {[quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1] 45874691} {[quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb quay.io/k8scsi/csi-snapshotter:v1.1.0] 44325352} {[k8s.gcr.io/coredns@sha256:e83beb5e43f8513fa735e77ffc5859640baea30a882a11cc75c4c3244a737d3c k8s.gcr.io/coredns:1.5.0] 42488424} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0] 14967303} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:47:44.302] Nov 5 23:47:44.299: INFO: I1105 23:47:44.303] Logging kubelet events for node k8s-agentpool-73731178-vmss000001 I1105 23:47:44.379] Nov 5 23:47:44.379: INFO: I1105 23:47:44.379] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000001 I1105 23:47:44.461] Nov 5 23:47:44.461: INFO: blobfuse-flexvol-installer-589vv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:44.461] Nov 5 23:47:44.461: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1105 23:47:44.462] Nov 5 23:47:44.461: INFO: coredns-7f68dcdbdb-f98nq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:44.462] Nov 5 23:47:44.461: INFO: Container coredns ready: true, restart count 0 I1105 23:47:44.462] Nov 5 23:47:44.461: INFO: azure-ip-masq-agent-6qqgc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:44.462] Nov 5 23:47:44.461: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:47:44.462] Nov 5 23:47:44.461: INFO: keyvault-flexvolume-7tztj started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:44.462] Nov 5 23:47:44.461: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1105 23:47:44.462] Nov 5 23:47:44.461: INFO: kube-proxy-z4hf8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:44.463] Nov 5 23:47:44.461: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:47:44.463] Nov 5 23:47:44.461: INFO: tiller-deploy-54c96cb5df-wlzbj started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:47:44.463] Nov 5 23:47:44.461: INFO: Container tiller ready: true, restart count 0 I1105 23:47:44.463] Nov 5 23:47:44.461: INFO: csi-azuredisk-node-ml68k started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1105 23:47:44.463] Nov 5 23:47:44.461: INFO: Container azuredisk ready: true, restart count 0 I1105 23:47:44.463] Nov 5 23:47:44.461: INFO: Container liveness-probe ready: true, restart count 0 I1105 23:47:44.463] Nov 5 23:47:44.461: INFO: Container node-driver-registrar ready: true, restart count 0 I1105 23:47:44.463] Nov 5 23:47:44.461: INFO: csi-azuredisk-controller-59bf945f54-k2p5m started at 2019-11-05 23:30:58 +0000 UTC (0+6 container statuses recorded) I1105 23:47:44.464] Nov 5 23:47:44.461: INFO: Container azuredisk ready: true, restart count 0 I1105 23:47:44.464] Nov 5 23:47:44.461: INFO: Container cluster-driver-registrar ready: true, restart count 0 I1105 23:47:44.464] Nov 5 23:47:44.461: INFO: Container csi-attacher ready: true, restart count 0 I1105 23:47:44.464] Nov 5 23:47:44.461: INFO: Container csi-provisioner ready: true, restart count 0 I1105 23:47:44.464] Nov 5 23:47:44.461: INFO: Container csi-snapshotter ready: true, restart count 0 I1105 23:47:44.464] Nov 5 23:47:44.461: INFO: Container liveness-probe ready: true, restart count 0 I1105 23:47:44.721] Nov 5 23:47:44.721: INFO: I1105 23:47:44.722] Latency metrics for node k8s-agentpool-73731178-vmss000001 I1105 23:47:44.722] Nov 5 23:47:44.721: INFO: I1105 23:47:44.722] Logging node info for node k8s-master-73731178-vmss000000 I1105 23:47:44.800] Nov 5 23:47:44.798: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000000,UID:1f765350-accc-4e67-898b-e4d84be84901,ResourceVersion:4633,Generation:0,CreationTimestamp:2019-11-05 23:27:30 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:47:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:47:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:47:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:47:22 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.4} {Hostname k8s-master-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:836af7329e85492184d73f1ea7f63a4e,SystemUUID:D1C68207-4499-C24D-B9D6-ADA0554A1BE5,BootID:a29dde5d-b4dc-483e-a50e-76e79359d759,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:47:44.800] Nov 5 23:47:44.798: INFO: I1105 23:47:44.801] Logging kubelet events for node k8s-master-73731178-vmss000000 I1105 23:47:44.878] Nov 5 23:47:44.878: INFO: I1105 23:47:44.879] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000000 I1105 23:47:44.960] Nov 5 23:47:44.960: INFO: kube-apiserver-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:47:44.961] Nov 5 23:47:44.960: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:47:44.961] Nov 5 23:47:44.960: INFO: azure-ip-masq-agent-xmkx2 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:44.961] Nov 5 23:47:44.960: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:47:44.961] Nov 5 23:47:44.960: INFO: kube-proxy-2fwv9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:44.961] Nov 5 23:47:44.960: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:47:44.961] Nov 5 23:47:44.960: INFO: kube-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:47:44.962] Nov 5 23:47:44.960: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:47:44.962] Nov 5 23:47:44.960: INFO: kube-scheduler-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:47:44.962] Nov 5 23:47:44.960: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:47:44.962] Nov 5 23:47:44.960: INFO: cloud-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:47:44.962] Nov 5 23:47:44.960: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:47:44.963] Nov 5 23:47:44.960: INFO: kube-addon-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:47:44.963] Nov 5 23:47:44.960: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:47:45.221] Nov 5 23:47:45.220: INFO: I1105 23:47:45.221] Latency metrics for node k8s-master-73731178-vmss000000 I1105 23:47:45.221] Nov 5 23:47:45.220: INFO: I1105 23:47:45.221] Logging node info for node k8s-master-73731178-vmss000001 I1105 23:47:45.299] Nov 5 23:47:45.297: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000001,UID:442cf114-6b0a-4c80-a9e5-be62e184f94c,ResourceVersion:4583,Generation:0,CreationTimestamp:2019-11-05 23:27:42 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:19 +0000 UTC 2019-11-05 23:28:19 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:47:05 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:47:05 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:47:05 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:47:05 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.5} {Hostname k8s-master-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1a9da6632c314858a31bccaea0be0f50,SystemUUID:8F48A76E-30E1-B948-89B2-33C0048059B4,BootID:1597124c-68a3-452c-ae03-6cfe9bc1e57f,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:47:45.300] Nov 5 23:47:45.297: INFO: I1105 23:47:45.300] Logging kubelet events for node k8s-master-73731178-vmss000001 I1105 23:47:45.387] Nov 5 23:47:45.387: INFO: I1105 23:47:45.388] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000001 I1105 23:47:45.470] Nov 5 23:47:45.470: INFO: kube-scheduler-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:47:45.470] Nov 5 23:47:45.470: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:47:45.471] Nov 5 23:47:45.470: INFO: cloud-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:47:45.471] Nov 5 23:47:45.470: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:47:45.471] Nov 5 23:47:45.470: INFO: kube-addon-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:47:45.471] Nov 5 23:47:45.470: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:47:45.471] Nov 5 23:47:45.470: INFO: kube-apiserver-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:47:45.472] Nov 5 23:47:45.470: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:47:45.472] Nov 5 23:47:45.470: INFO: kube-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:47:45.472] Nov 5 23:47:45.470: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:47:45.472] Nov 5 23:47:45.470: INFO: azure-ip-masq-agent-825g9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:45.472] Nov 5 23:47:45.470: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:47:45.472] Nov 5 23:47:45.470: INFO: kube-proxy-8924t started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:45.473] Nov 5 23:47:45.470: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:47:45.714] Nov 5 23:47:45.714: INFO: I1105 23:47:45.715] Latency metrics for node k8s-master-73731178-vmss000001 I1105 23:47:45.715] Nov 5 23:47:45.714: INFO: I1105 23:47:45.715] Logging node info for node k8s-master-73731178-vmss000002 I1105 23:47:45.795] Nov 5 23:47:45.790: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000002,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000002,UID:6cf1398e-1b6b-4537-837d-9ffceb9a4f00,ResourceVersion:4642,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000002,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.6.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/2,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:27:55 +0000 UTC 2019-11-05 23:27:55 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:47:25 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:47:25 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:47:25 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:47:25 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.6} {Hostname k8s-master-73731178-vmss000002}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7964689c8ba4f448e6f435b3d4fefac,SystemUUID:9369535A-87BF-1E4B-86DF-5D1A23713C9F,BootID:74f93904-298f-454d-8df6-8d4bba193331,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:47:45.795] Nov 5 23:47:45.791: INFO: I1105 23:47:45.795] Logging kubelet events for node k8s-master-73731178-vmss000002 I1105 23:47:45.872] Nov 5 23:47:45.872: INFO: I1105 23:47:45.872] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000002 I1105 23:47:45.954] Nov 5 23:47:45.953: INFO: kube-proxy-t958f started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:45.954] Nov 5 23:47:45.953: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:47:45.954] Nov 5 23:47:45.953: INFO: kube-addon-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:18 +0000 UTC (0+1 container statuses recorded) I1105 23:47:45.954] Nov 5 23:47:45.953: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:47:45.954] Nov 5 23:47:45.953: INFO: kube-apiserver-k8s-master-73731178-vmss000002 started at 2019-11-05 23:28:42 +0000 UTC (0+1 container statuses recorded) I1105 23:47:45.954] Nov 5 23:47:45.953: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:47:45.955] Nov 5 23:47:45.953: INFO: kube-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1105 23:47:45.955] Nov 5 23:47:45.953: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:47:45.955] Nov 5 23:47:45.953: INFO: kube-scheduler-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1105 23:47:45.955] Nov 5 23:47:45.953: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:47:45.955] Nov 5 23:47:45.953: INFO: cloud-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1105 23:47:45.955] Nov 5 23:47:45.953: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:47:45.956] Nov 5 23:47:45.953: INFO: azure-ip-masq-agent-74xks started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:45.956] Nov 5 23:47:45.953: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:47:46.199] Nov 5 23:47:46.199: INFO: I1105 23:47:46.200] Latency metrics for node k8s-master-73731178-vmss000002 I1105 23:47:46.200] Nov 5 23:47:46.199: INFO: I1105 23:47:46.200] Logging node info for node k8s-master-73731178-vmss000003 I1105 23:47:46.278] Nov 5 23:47:46.276: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000003,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000003,UID:54efc1b0-183c-4153-b804-31d0d42ce204,ResourceVersion:4632,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000003,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/3,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:47:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:47:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:47:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:47:22 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{Hostname k8s-master-73731178-vmss000003} {InternalIP 10.240.0.7}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a448072d2d27400fa2252a0cb3c8ff37,SystemUUID:98F6A517-FFCA-8E4D-A914-52A5F1482433,BootID:50c0f9e6-7c4d-45ec-8984-248ea540d637,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:47:46.278] Nov 5 23:47:46.276: INFO: I1105 23:47:46.279] Logging kubelet events for node k8s-master-73731178-vmss000003 I1105 23:47:46.357] Nov 5 23:47:46.357: INFO: I1105 23:47:46.357] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000003 I1105 23:47:46.439] Nov 5 23:47:46.438: INFO: kube-apiserver-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:47:46.439] Nov 5 23:47:46.438: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:47:46.439] Nov 5 23:47:46.438: INFO: kube-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:47:46.439] Nov 5 23:47:46.438: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:47:46.439] Nov 5 23:47:46.438: INFO: kube-scheduler-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:47:46.440] Nov 5 23:47:46.438: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:47:46.440] Nov 5 23:47:46.438: INFO: azure-ip-masq-agent-4nshf started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:46.440] Nov 5 23:47:46.438: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:47:46.440] Nov 5 23:47:46.438: INFO: kube-proxy-qm7rq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:47:46.440] Nov 5 23:47:46.438: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:47:46.440] Nov 5 23:47:46.438: INFO: cloud-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:47:46.441] Nov 5 23:47:46.438: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:47:46.441] Nov 5 23:47:46.438: INFO: kube-addon-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:43 +0000 UTC (0+1 container statuses recorded) I1105 23:47:46.441] Nov 5 23:47:46.438: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:47:46.692] Nov 5 23:47:46.692: INFO: I1105 23:47:46.692] Latency metrics for node k8s-master-73731178-vmss000003 I1105 23:47:46.693] Nov 5 23:47:46.692: INFO: I1105 23:47:46.693] Logging node info for node k8s-master-73731178-vmss000004 I1105 23:47:46.771] Nov 5 23:47:46.768: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000004,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000004,UID:4a582f8b-6cf2-4e91-8770-fde6f9c22194,ResourceVersion:4629,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000004,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/4,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:32 +0000 UTC 2019-11-05 23:28:32 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:47:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:47:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:47:22 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:47:22 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.8} {Hostname k8s-master-73731178-vmss000004}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:252c632059f2483d87e2d8d689053e48,SystemUUID:5BBFFB00-FBAB-0F4A-8F63-6B99DE219F64,BootID:165ca62a-8171-48e8-92f7-3ad786cb6b9a,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:47:46.771] Nov 5 23:47:46.769: INFO: I1105 23:47:46.771] Logging kubelet events for node k8s-master-73731178-vmss000004 I1105 23:47:46.849] Nov 5 23:47:46.849: INFO: I1105 23:47:46.849] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000004 I1105 23:47:46.931] Nov 5 23:47:46.930: INFO: kube-scheduler-k8s-master-73731178-vmss000004 started at 2019-11-05 23:28:31 +0000 UTC (0+1 container statuses recorded) I1105 23:47:46.931] Nov 5 23:47:46.931: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:47:46.931] Nov 5 23:47:46.931: INFO: azure-ip-masq-agent-rh9pr started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:47:46.931] Nov 5 23:47:46.931: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:47:46.932] Nov 5 23:47:46.931: INFO: kube-proxy-rk5r6 started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:47:46.932] Nov 5 23:47:46.931: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:47:46.932] Nov 5 23:47:46.931: INFO: cloud-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:47:46.932] Nov 5 23:47:46.931: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:47:46.932] Nov 5 23:47:46.931: INFO: kube-addon-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:47:46.933] Nov 5 23:47:46.931: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:47:46.933] Nov 5 23:47:46.931: INFO: kube-apiserver-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:47:46.933] Nov 5 23:47:46.931: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:47:46.933] Nov 5 23:47:46.931: INFO: kube-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:47:46.933] Nov 5 23:47:46.931: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:47:47.181] Nov 5 23:47:47.181: INFO: I1105 23:47:47.181] Latency metrics for node k8s-master-73731178-vmss000004 I1105 23:47:47.181] Nov 5 23:47:47.181: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1105 23:47:47.259] STEP: Destroying namespace "azuredisk-2836" for this suite. I1105 23:48:01.494] Nov 5 23:48:01.494: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1105 23:48:04.409] Nov 5 23:48:04.409: INFO: namespace azuredisk-2836 deletion completed in 17.150154181s I1105 23:48:04.409] I1105 23:48:04.409] • Failure [321.994 seconds] I1105 23:48:04.409] [azuredisk-csi-e2e] Dynamic Provisioning I1105 23:48:04.410] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:33 I1105 23:48:04.410] [single-az] I1105 23:48:04.410] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:36 I1105 23:48:04.410] should create a volume on demand and mount it as readOnly in a pod [It] I1105 23:48:04.410] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:126 I1105 23:48:04.410] I1105 23:48:04.411] Unexpected error: I1105 23:48:04.411] <*errors.errorString | 0xc00016b4b0>: { I1105 23:48:04.411] s: "PersistentVolumeClaims [pvc-25lxh] not all in phase Bound within 5m0s", I1105 23:48:04.411] } I1105 23:48:04.411] PersistentVolumeClaims [pvc-25lxh] not all in phase Bound within 5m0s I1105 23:48:04.411] occurred I1105 23:48:04.411] I1105 23:48:04.411] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1105 23:48:04.412] ------------------------------ I1105 23:48:04.412] [azuredisk-csi-e2e] Dynamic Provisioning [multi-az] I1105 23:48:04.412] should create multiple PV objects, bind to PVCs and attach all to different pods on the same node I1105 23:48:04.412] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:151 I1105 23:48:04.412] [BeforeEach] [multi-az] I1105 23:48:04.413] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1105 23:48:04.413] STEP: Creating a kubernetes client I1105 23:48:04.413] Nov 5 23:48:04.409: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1105 23:48:04.413] STEP: Building a namespace api object, basename azuredisk I1105 23:48:04.667] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-9928 I1105 23:48:04.925] STEP: Waiting for a default service account to be provisioned in namespace I1105 23:48:04.999] [BeforeEach] [multi-az] I1105 23:48:04.999] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:58 I1105 23:48:05.078] [It] should create multiple PV objects, bind to PVCs and attach all to different pods on the same node I1105 23:48:05.078] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:151 I1105 23:48:05.079] STEP: setting up the StorageClass I1105 23:48:05.079] STEP: creating a StorageClass I1105 23:48:05.159] STEP: setting up the PVC and PV I1105 23:48:05.159] STEP: creating a PVC I1105 23:48:05.245] STEP: deploying the pod I1105 23:48:05.330] STEP: checking that the pod is running I1105 23:49:59.489] STEP: setting up the StorageClass I1105 23:49:59.489] STEP: creating a StorageClass I1105 23:49:59.570] STEP: setting up the PVC and PV I1105 23:49:59.570] STEP: creating a PVC I1105 23:49:59.656] STEP: deploying the pod I1105 23:49:59.742] STEP: checking that the pod is running I1105 23:50:27.895] Nov 5 23:50:27.895: INFO: deleting Pod "azuredisk-9928"/"azuredisk-volume-tester-xwqcz" I1105 23:50:27.977] Nov 5 23:50:27.976: INFO: Pod azuredisk-volume-tester-xwqcz has the following logs: I1105 23:50:27.977] STEP: Deleting pod azuredisk-volume-tester-xwqcz in namespace azuredisk-9928 I1105 23:50:28.155] STEP: validating provisioned PV I1105 23:50:28.242] STEP: checking the PV I1105 23:50:28.242] Nov 5 23:50:28.242: INFO: deleting PVC "azuredisk-9928"/"pvc-wlw7v" I1105 23:50:28.242] Nov 5 23:50:28.242: INFO: Deleting PersistentVolumeClaim "pvc-wlw7v" I1105 23:50:28.325] STEP: waiting for claim's PV "pvc-3cf6f807-d860-4423-a9bd-20202ef10100" to be deleted I1105 23:50:28.325] Nov 5 23:50:28.325: INFO: Waiting up to 10m0s for PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 to get deleted I1105 23:50:28.401] Nov 5 23:50:28.401: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Bound (76.099351ms) I1105 23:50:33.478] Nov 5 23:50:33.478: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Bound (5.153425267s) I1105 23:50:38.556] Nov 5 23:50:38.556: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Bound (10.230750699s) I1105 23:50:43.633] Nov 5 23:50:43.633: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Bound (15.308336151s) I1105 23:50:48.710] Nov 5 23:50:48.710: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Bound (20.385107313s) I1105 23:50:53.788] Nov 5 23:50:53.788: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Bound (25.463123101s) I1105 23:50:58.866] Nov 5 23:50:58.865: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Bound (30.540498401s) I1105 23:51:03.942] Nov 5 23:51:03.942: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Released (35.617081111s) I1105 23:51:09.019] Nov 5 23:51:09.019: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Released (40.69403904s) I1105 23:51:14.096] Nov 5 23:51:14.096: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Released (45.771107286s) I1105 23:51:19.175] Nov 5 23:51:19.175: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Released (50.84986536s) I1105 23:51:24.260] Nov 5 23:51:24.260: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Released (55.935097697s) I1105 23:51:29.345] Nov 5 23:51:29.345: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Released (1m1.020296749s) I1105 23:51:34.430] Nov 5 23:51:34.430: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Released (1m6.105091413s) I1105 23:51:39.514] Nov 5 23:51:39.514: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 found and phase=Released (1m11.189265988s) I1105 23:51:44.600] Nov 5 23:51:44.600: INFO: PersistentVolume pvc-3cf6f807-d860-4423-a9bd-20202ef10100 was removed I1105 23:51:44.600] Nov 5 23:51:44.600: INFO: Waiting up to 5m0s for PersistentVolumeClaim azuredisk-9928 to be removed I1105 23:51:44.684] Nov 5 23:51:44.684: INFO: Claim "azuredisk-9928" in namespace "pvc-wlw7v" doesn't exist in the system I1105 23:51:44.684] Nov 5 23:51:44.684: INFO: deleting StorageClass azuredisk-9928-disk.csi.azure.com-dynamic-sc-snzt7 I1105 23:51:44.778] Nov 5 23:51:44.777: INFO: deleting Pod "azuredisk-9928"/"azuredisk-volume-tester-6n9jv" I1105 23:51:44.867] Nov 5 23:51:44.867: INFO: Pod azuredisk-volume-tester-6n9jv has the following logs: I1105 23:51:44.868] STEP: Deleting pod azuredisk-volume-tester-6n9jv in namespace azuredisk-9928 I1105 23:51:45.043] STEP: validating provisioned PV I1105 23:51:45.127] STEP: checking the PV I1105 23:51:45.127] Nov 5 23:51:45.127: INFO: deleting PVC "azuredisk-9928"/"pvc-vfn89" I1105 23:51:45.127] Nov 5 23:51:45.127: INFO: Deleting PersistentVolumeClaim "pvc-vfn89" I1105 23:51:45.217] STEP: waiting for claim's PV "pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb" to be deleted I1105 23:51:45.217] Nov 5 23:51:45.217: INFO: Waiting up to 10m0s for PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb to get deleted I1105 23:51:45.301] Nov 5 23:51:45.301: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Bound (84.423016ms) I1105 23:51:50.387] Nov 5 23:51:50.386: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Bound (5.169575131s) I1105 23:51:55.473] Nov 5 23:51:55.473: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Bound (10.256185071s) I1105 23:52:00.558] Nov 5 23:52:00.558: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Bound (15.341138713s) I1105 23:52:05.643] Nov 5 23:52:05.643: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Bound (20.425975569s) I1105 23:52:10.728] Nov 5 23:52:10.728: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Bound (25.511230342s) I1105 23:52:15.813] Nov 5 23:52:15.813: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Bound (30.595732224s) I1105 23:52:20.898] Nov 5 23:52:20.897: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Released (35.680672024s) I1105 23:52:25.982] Nov 5 23:52:25.982: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Released (40.764943632s) I1105 23:52:31.067] Nov 5 23:52:31.067: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Released (45.849778358s) I1105 23:52:36.152] Nov 5 23:52:36.151: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Released (50.934648599s) I1105 23:52:41.240] Nov 5 23:52:41.240: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Released (56.023394481s) I1105 23:52:46.326] Nov 5 23:52:46.326: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Released (1m1.108955553s) I1105 23:52:51.411] Nov 5 23:52:51.411: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Released (1m6.194086435s) I1105 23:52:56.497] Nov 5 23:52:56.496: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb found and phase=Released (1m11.279706534s) I1105 23:53:01.581] Nov 5 23:53:01.581: INFO: PersistentVolume pvc-3e7bc4e7-0563-4766-9c9a-a83765ac4ebb was removed I1105 23:53:01.582] Nov 5 23:53:01.581: INFO: Waiting up to 5m0s for PersistentVolumeClaim azuredisk-9928 to be removed I1105 23:53:01.666] Nov 5 23:53:01.666: INFO: Claim "azuredisk-9928" in namespace "pvc-vfn89" doesn't exist in the system I1105 23:53:01.667] Nov 5 23:53:01.666: INFO: deleting StorageClass azuredisk-9928-disk.csi.azure.com-dynamic-sc-nl4rq I1105 23:53:01.764] [AfterEach] [multi-az] I1105 23:53:01.764] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1105 23:53:01.765] Nov 5 23:53:01.764: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1105 23:53:01.929] STEP: Destroying namespace "azuredisk-9928" for this suite. I1105 23:53:08.190] Nov 5 23:53:08.190: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1105 23:53:11.381] Nov 5 23:53:11.381: INFO: namespace azuredisk-9928 deletion completed in 9.451742781s I1105 23:53:11.381] I1105 23:53:11.381] • [SLOW TEST:306.972 seconds] I1105 23:53:11.382] [azuredisk-csi-e2e] Dynamic Provisioning I1105 23:53:11.382] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:33 I1105 23:53:11.382] [multi-az] I1105 23:53:11.382] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:40 I1105 23:53:11.382] should create multiple PV objects, bind to PVCs and attach all to different pods on the same node I1105 23:53:11.382] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:151 I1105 23:53:11.383] ------------------------------ I1105 23:53:11.383] [azuredisk-csi-e2e] Dynamic Provisioning [single-az] I1105 23:53:11.383] [env] should retain PV with reclaimPolicy "Retain" I1105 23:53:11.383] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:240 I1105 23:53:11.383] [BeforeEach] [single-az] I1105 23:53:11.383] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1105 23:53:11.383] STEP: Creating a kubernetes client I1105 23:53:11.384] Nov 5 23:53:11.381: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1105 23:53:11.384] STEP: Building a namespace api object, basename azuredisk I1105 23:53:11.637] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-180 I1105 23:53:11.910] STEP: Waiting for a default service account to be provisioned in namespace I1105 23:53:11.991] [BeforeEach] [single-az] I1105 23:53:11.991] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:58 I1105 23:53:11.992] [It] [env] should retain PV with reclaimPolicy "Retain" I1105 23:53:11.992] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:240 I1105 23:53:11.992] STEP: setting up the StorageClass I1105 23:53:11.992] STEP: creating a StorageClass I1105 23:53:12.082] STEP: setting up the PVC and PV I1105 23:53:12.082] STEP: creating a PVC I1105 23:53:12.172] STEP: waiting for PVC to be in phase "Bound" I1105 23:53:12.173] Nov 5 23:53:12.172: INFO: Waiting up to 5m0s for PersistentVolumeClaims [pvc-7xh4b] to have phase Bound I1105 23:53:12.256] Nov 5 23:53:12.256: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:14.341] Nov 5 23:53:14.341: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:16.426] Nov 5 23:53:16.426: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:18.511] Nov 5 23:53:18.511: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:20.596] Nov 5 23:53:20.596: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:22.681] Nov 5 23:53:22.680: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:24.766] Nov 5 23:53:24.766: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:26.852] Nov 5 23:53:26.851: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:28.936] Nov 5 23:53:28.936: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:31.021] Nov 5 23:53:31.021: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:33.108] Nov 5 23:53:33.107: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:35.193] Nov 5 23:53:35.193: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:37.277] Nov 5 23:53:37.277: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:39.362] Nov 5 23:53:39.362: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:41.447] Nov 5 23:53:41.447: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:43.533] Nov 5 23:53:43.533: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:45.618] Nov 5 23:53:45.618: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:47.703] Nov 5 23:53:47.703: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:49.788] Nov 5 23:53:49.788: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:51.873] Nov 5 23:53:51.872: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:53.958] Nov 5 23:53:53.958: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:56.059] Nov 5 23:53:56.059: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:53:58.144] Nov 5 23:53:58.144: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:00.239] Nov 5 23:54:00.239: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:02.324] Nov 5 23:54:02.324: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:04.402] Nov 5 23:54:04.402: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:06.480] Nov 5 23:54:06.480: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:08.563] Nov 5 23:54:08.563: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:10.640] Nov 5 23:54:10.640: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:12.718] Nov 5 23:54:12.718: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:14.796] Nov 5 23:54:14.796: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:16.873] Nov 5 23:54:16.873: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:18.950] Nov 5 23:54:18.950: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:21.027] Nov 5 23:54:21.027: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:23.104] Nov 5 23:54:23.104: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:25.182] Nov 5 23:54:25.181: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:27.259] Nov 5 23:54:27.259: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:29.336] Nov 5 23:54:29.336: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:31.414] Nov 5 23:54:31.413: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:33.491] Nov 5 23:54:33.491: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:35.568] Nov 5 23:54:35.568: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:37.646] Nov 5 23:54:37.646: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:39.724] Nov 5 23:54:39.723: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:41.801] Nov 5 23:54:41.800: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:43.879] Nov 5 23:54:43.879: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:45.957] Nov 5 23:54:45.956: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:48.035] Nov 5 23:54:48.034: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:50.112] Nov 5 23:54:50.112: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:52.190] Nov 5 23:54:52.190: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:54.268] Nov 5 23:54:54.267: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:56.348] Nov 5 23:54:56.348: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:54:58.425] Nov 5 23:54:58.425: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:00.503] Nov 5 23:55:00.502: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:02.580] Nov 5 23:55:02.580: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:04.659] Nov 5 23:55:04.659: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:06.738] Nov 5 23:55:06.738: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:08.816] Nov 5 23:55:08.816: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:10.894] Nov 5 23:55:10.894: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:12.971] Nov 5 23:55:12.971: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:15.057] Nov 5 23:55:15.057: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:17.134] Nov 5 23:55:17.134: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:19.211] Nov 5 23:55:19.211: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:21.288] Nov 5 23:55:21.288: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:23.366] Nov 5 23:55:23.366: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:25.443] Nov 5 23:55:25.443: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:27.520] Nov 5 23:55:27.520: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:29.597] Nov 5 23:55:29.597: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:31.674] Nov 5 23:55:31.674: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:33.751] Nov 5 23:55:33.751: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:35.829] Nov 5 23:55:35.829: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:37.906] Nov 5 23:55:37.906: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:39.984] Nov 5 23:55:39.984: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:42.061] Nov 5 23:55:42.061: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:44.138] Nov 5 23:55:44.138: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:46.217] Nov 5 23:55:46.217: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:48.293] Nov 5 23:55:48.293: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:50.374] Nov 5 23:55:50.374: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:52.451] Nov 5 23:55:52.451: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:54.528] Nov 5 23:55:54.528: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:56.605] Nov 5 23:55:56.605: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:55:58.682] Nov 5 23:55:58.682: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:00.759] Nov 5 23:56:00.759: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:02.835] Nov 5 23:56:02.835: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:04.912] Nov 5 23:56:04.912: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:06.989] Nov 5 23:56:06.989: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:09.066] Nov 5 23:56:09.066: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:11.144] Nov 5 23:56:11.143: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:13.229] Nov 5 23:56:13.229: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:15.306] Nov 5 23:56:15.306: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:17.384] Nov 5 23:56:17.384: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:19.461] Nov 5 23:56:19.460: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:21.538] Nov 5 23:56:21.537: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:23.615] Nov 5 23:56:23.615: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:25.692] Nov 5 23:56:25.691: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:27.768] Nov 5 23:56:27.768: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:29.845] Nov 5 23:56:29.845: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:31.922] Nov 5 23:56:31.922: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:34.000] Nov 5 23:56:34.000: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:36.092] Nov 5 23:56:36.091: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:38.169] Nov 5 23:56:38.169: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:40.249] Nov 5 23:56:40.249: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:42.326] Nov 5 23:56:42.326: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:44.403] Nov 5 23:56:44.403: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:46.480] Nov 5 23:56:46.480: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:48.559] Nov 5 23:56:48.559: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:50.636] Nov 5 23:56:50.636: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:52.713] Nov 5 23:56:52.713: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:54.790] Nov 5 23:56:54.790: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:56.868] Nov 5 23:56:56.867: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:56:58.945] Nov 5 23:56:58.945: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:01.023] Nov 5 23:57:01.023: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:03.101] Nov 5 23:57:03.101: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:05.184] Nov 5 23:57:05.183: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:07.261] Nov 5 23:57:07.261: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:09.339] Nov 5 23:57:09.338: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:11.416] Nov 5 23:57:11.416: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:13.494] Nov 5 23:57:13.494: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:15.571] Nov 5 23:57:15.571: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:17.648] Nov 5 23:57:17.648: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:19.725] Nov 5 23:57:19.725: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:21.806] Nov 5 23:57:21.806: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:23.883] Nov 5 23:57:23.883: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:25.960] Nov 5 23:57:25.960: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:28.049] Nov 5 23:57:28.049: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:30.126] Nov 5 23:57:30.126: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:32.203] Nov 5 23:57:32.203: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:34.280] Nov 5 23:57:34.280: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:36.357] Nov 5 23:57:36.357: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:38.434] Nov 5 23:57:38.434: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:40.511] Nov 5 23:57:40.510: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:42.589] Nov 5 23:57:42.588: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:44.665] Nov 5 23:57:44.665: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:46.746] Nov 5 23:57:46.746: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:48.823] Nov 5 23:57:48.823: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:50.900] Nov 5 23:57:50.900: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:52.978] Nov 5 23:57:52.978: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:55.055] Nov 5 23:57:55.055: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:57.132] Nov 5 23:57:57.132: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:57:59.210] Nov 5 23:57:59.210: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:58:01.287] Nov 5 23:58:01.287: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:58:03.364] Nov 5 23:58:03.364: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:58:05.441] Nov 5 23:58:05.441: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:58:07.518] Nov 5 23:58:07.518: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:58:09.600] Nov 5 23:58:09.600: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:58:11.677] Nov 5 23:58:11.677: INFO: PersistentVolumeClaim pvc-7xh4b found but phase is Pending instead of Bound. I1105 23:58:13.677] Nov 5 23:58:13.677: INFO: Unexpected error occurred: PersistentVolumeClaims [pvc-7xh4b] not all in phase Bound within 5m0s I1105 23:58:13.678] [AfterEach] [single-az] I1105 23:58:13.678] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1105 23:58:13.679] STEP: Collecting events from namespace "azuredisk-180". I1105 23:58:13.755] STEP: Found 3 events. I1105 23:58:13.755] Nov 5 23:58:13.755: INFO: At 2019-11-05 23:53:12 +0000 UTC - event for pvc-7xh4b: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator I1105 23:58:13.756] Nov 5 23:58:13.755: INFO: At 2019-11-05 23:53:12 +0000 UTC - event for pvc-7xh4b: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } Provisioning: External provisioner is provisioning volume for claim "azuredisk-180/pvc-7xh4b" I1105 23:58:13.756] Nov 5 23:58:13.755: INFO: At 2019-11-05 23:53:22 +0000 UTC - event for pvc-7xh4b: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-180-disk.csi.azure.com-dynamic-sc-zqqs6": rpc error: code = DeadlineExceeded desc = context deadline exceeded I1105 23:58:13.831] Nov 5 23:58:13.831: INFO: POD NODE PHASE GRACE CONDITIONS I1105 23:58:13.832] Nov 5 23:58:13.831: INFO: I1105 23:58:14.060] Nov 5 23:58:14.060: INFO: I1105 23:58:14.060] Logging node info for node k8s-agentpool-73731178-vmss000000 I1105 23:58:14.140] Nov 5 23:58:14.136: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000000,UID:e9bc0b16-6756-4155-b49c-e223c0ba9499,ResourceVersion:6530,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-1,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000000"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:18 +0000 UTC 2019-11-05 23:28:18 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:57:26 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:57:26 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:57:26 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:57:26 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.4} {Hostname k8s-agentpool-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:956ad861ae4a42099801f8e840b4e502,SystemUUID:439CF4B9-2B9F-B74E-9ED7-7379FD8BD0DF,BootID:bd3476e5-4fd4-4437-9b56-54fbe38a3a49,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1] 121711221} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/metrics-server-amd64@sha256:49a9f12f7067d11f42c803dbe61ed2c1299959ad85cb315b25ff7eef8e6b8892 k8s.gcr.io/metrics-server-amd64:v0.2.1] 42541759} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:58:14.140] Nov 5 23:58:14.137: INFO: I1105 23:58:14.141] Logging kubelet events for node k8s-agentpool-73731178-vmss000000 I1105 23:58:14.218] Nov 5 23:58:14.218: INFO: I1105 23:58:14.218] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000000 I1105 23:58:14.299] Nov 5 23:58:14.299: INFO: blobfuse-flexvol-installer-cvgkv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:14.300] Nov 5 23:58:14.299: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1105 23:58:14.300] Nov 5 23:58:14.299: INFO: azure-ip-masq-agent-vn5zc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:14.300] Nov 5 23:58:14.299: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:58:14.300] Nov 5 23:58:14.299: INFO: keyvault-flexvolume-xr7v6 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:14.300] Nov 5 23:58:14.299: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1105 23:58:14.301] Nov 5 23:58:14.299: INFO: metrics-server-864ffbc5c-kb9cz started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:14.301] Nov 5 23:58:14.299: INFO: Container metrics-server ready: true, restart count 0 I1105 23:58:14.301] Nov 5 23:58:14.299: INFO: kube-proxy-jnqp8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:14.301] Nov 5 23:58:14.299: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:58:14.301] Nov 5 23:58:14.299: INFO: kubernetes-dashboard-66dd8b8df7-4rnsp started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:58:14.301] Nov 5 23:58:14.299: INFO: Container kubernetes-dashboard ready: true, restart count 1 I1105 23:58:14.302] Nov 5 23:58:14.299: INFO: csi-azuredisk-node-g6wbm started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1105 23:58:14.302] Nov 5 23:58:14.299: INFO: Container azuredisk ready: true, restart count 0 I1105 23:58:14.302] Nov 5 23:58:14.299: INFO: Container liveness-probe ready: true, restart count 0 I1105 23:58:14.302] Nov 5 23:58:14.299: INFO: Container node-driver-registrar ready: true, restart count 0 I1105 23:58:14.554] Nov 5 23:58:14.554: INFO: I1105 23:58:14.554] Latency metrics for node k8s-agentpool-73731178-vmss000000 I1105 23:58:14.554] Nov 5 23:58:14.554: INFO: I1105 23:58:14.555] Logging node info for node k8s-agentpool-73731178-vmss000001 I1105 23:58:14.636] Nov 5 23:58:14.632: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000001,UID:ab75ba9d-ec23-4ff7-ae5a-d1a19974c05d,ResourceVersion:6642,Generation:0,CreationTimestamp:2019-11-05 23:27:31 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-2,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000001"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.5.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:17 +0000 UTC 2019-11-05 23:28:17 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:58:06 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:58:06 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:58:06 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:58:06 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.5} {Hostname k8s-agentpool-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f0eae5e73d0f4ccb82dd0f22701c288f,SystemUUID:7E54C533-AED3-744D-8D17-EFF5E62EA06D,BootID:6d58e5a6-45fb-4a41-a491-bc2f3799f411,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[gcr.io/kubernetes-helm/tiller@sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1 gcr.io/kubernetes-helm/tiller:v2.11.0] 71821984} {[quay.io/k8scsi/csi-provisioner@sha256:d657c839dce87324fe2b677302913f9386f885f8746be7bea0ced5b0844e3433 quay.io/k8scsi/csi-provisioner:v1.3.1] 50596998} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0] 46226754} {[quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1] 45874691} {[quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb quay.io/k8scsi/csi-snapshotter:v1.1.0] 44325352} {[k8s.gcr.io/coredns@sha256:e83beb5e43f8513fa735e77ffc5859640baea30a882a11cc75c4c3244a737d3c k8s.gcr.io/coredns:1.5.0] 42488424} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0] 14967303} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:58:14.636] Nov 5 23:58:14.632: INFO: I1105 23:58:14.636] Logging kubelet events for node k8s-agentpool-73731178-vmss000001 I1105 23:58:14.713] Nov 5 23:58:14.713: INFO: I1105 23:58:14.713] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000001 I1105 23:58:14.796] Nov 5 23:58:14.796: INFO: csi-azuredisk-node-ml68k started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1105 23:58:14.796] Nov 5 23:58:14.796: INFO: Container azuredisk ready: true, restart count 0 I1105 23:58:14.797] Nov 5 23:58:14.796: INFO: Container liveness-probe ready: true, restart count 0 I1105 23:58:14.797] Nov 5 23:58:14.796: INFO: Container node-driver-registrar ready: true, restart count 0 I1105 23:58:14.797] Nov 5 23:58:14.796: INFO: blobfuse-flexvol-installer-589vv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:14.797] Nov 5 23:58:14.796: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1105 23:58:14.797] Nov 5 23:58:14.796: INFO: coredns-7f68dcdbdb-f98nq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:14.797] Nov 5 23:58:14.796: INFO: Container coredns ready: true, restart count 0 I1105 23:58:14.797] Nov 5 23:58:14.796: INFO: azure-ip-masq-agent-6qqgc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:14.798] Nov 5 23:58:14.796: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:58:14.798] Nov 5 23:58:14.796: INFO: keyvault-flexvolume-7tztj started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:14.798] Nov 5 23:58:14.796: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1105 23:58:14.798] Nov 5 23:58:14.796: INFO: kube-proxy-z4hf8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:14.798] Nov 5 23:58:14.796: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:58:14.798] Nov 5 23:58:14.796: INFO: tiller-deploy-54c96cb5df-wlzbj started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:58:14.799] Nov 5 23:58:14.796: INFO: Container tiller ready: true, restart count 0 I1105 23:58:14.799] Nov 5 23:58:14.796: INFO: csi-azuredisk-controller-59bf945f54-k2p5m started at 2019-11-05 23:30:58 +0000 UTC (0+6 container statuses recorded) I1105 23:58:14.799] Nov 5 23:58:14.796: INFO: Container azuredisk ready: true, restart count 0 I1105 23:58:14.799] Nov 5 23:58:14.796: INFO: Container cluster-driver-registrar ready: true, restart count 0 I1105 23:58:14.799] Nov 5 23:58:14.796: INFO: Container csi-attacher ready: true, restart count 0 I1105 23:58:14.799] Nov 5 23:58:14.796: INFO: Container csi-provisioner ready: true, restart count 0 I1105 23:58:14.799] Nov 5 23:58:14.796: INFO: Container csi-snapshotter ready: true, restart count 0 I1105 23:58:14.800] Nov 5 23:58:14.796: INFO: Container liveness-probe ready: true, restart count 0 I1105 23:58:15.055] Nov 5 23:58:15.054: INFO: I1105 23:58:15.055] Latency metrics for node k8s-agentpool-73731178-vmss000001 I1105 23:58:15.055] Nov 5 23:58:15.055: INFO: I1105 23:58:15.055] Logging node info for node k8s-master-73731178-vmss000000 I1105 23:58:15.134] Nov 5 23:58:15.132: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000000,UID:1f765350-accc-4e67-898b-e4d84be84901,ResourceVersion:6522,Generation:0,CreationTimestamp:2019-11-05 23:27:30 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:57:24 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:57:24 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:57:24 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:57:24 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.4} {Hostname k8s-master-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:836af7329e85492184d73f1ea7f63a4e,SystemUUID:D1C68207-4499-C24D-B9D6-ADA0554A1BE5,BootID:a29dde5d-b4dc-483e-a50e-76e79359d759,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:58:15.135] Nov 5 23:58:15.132: INFO: I1105 23:58:15.135] Logging kubelet events for node k8s-master-73731178-vmss000000 I1105 23:58:15.213] Nov 5 23:58:15.213: INFO: I1105 23:58:15.213] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000000 I1105 23:58:15.295] Nov 5 23:58:15.295: INFO: kube-scheduler-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:58:15.295] Nov 5 23:58:15.295: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:58:15.296] Nov 5 23:58:15.295: INFO: cloud-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:58:15.296] Nov 5 23:58:15.295: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:58:15.296] Nov 5 23:58:15.295: INFO: kube-addon-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:58:15.296] Nov 5 23:58:15.295: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:58:15.296] Nov 5 23:58:15.295: INFO: kube-apiserver-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:58:15.297] Nov 5 23:58:15.295: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:58:15.297] Nov 5 23:58:15.295: INFO: azure-ip-masq-agent-xmkx2 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:15.297] Nov 5 23:58:15.295: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:58:15.297] Nov 5 23:58:15.295: INFO: kube-proxy-2fwv9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:15.297] Nov 5 23:58:15.295: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:58:15.298] Nov 5 23:58:15.295: INFO: kube-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:58:15.298] Nov 5 23:58:15.295: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:58:15.545] Nov 5 23:58:15.545: INFO: I1105 23:58:15.545] Latency metrics for node k8s-master-73731178-vmss000000 I1105 23:58:15.546] Nov 5 23:58:15.545: INFO: I1105 23:58:15.546] Logging node info for node k8s-master-73731178-vmss000001 I1105 23:58:15.624] Nov 5 23:58:15.621: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000001,UID:442cf114-6b0a-4c80-a9e5-be62e184f94c,ResourceVersion:6644,Generation:0,CreationTimestamp:2019-11-05 23:27:42 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:19 +0000 UTC 2019-11-05 23:28:19 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:58:06 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:58:06 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:58:06 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:58:06 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.5} {Hostname k8s-master-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1a9da6632c314858a31bccaea0be0f50,SystemUUID:8F48A76E-30E1-B948-89B2-33C0048059B4,BootID:1597124c-68a3-452c-ae03-6cfe9bc1e57f,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:58:15.624] Nov 5 23:58:15.622: INFO: I1105 23:58:15.624] Logging kubelet events for node k8s-master-73731178-vmss000001 I1105 23:58:15.702] Nov 5 23:58:15.702: INFO: I1105 23:58:15.703] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000001 I1105 23:58:15.784] Nov 5 23:58:15.784: INFO: kube-scheduler-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:58:15.784] Nov 5 23:58:15.784: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:58:15.784] Nov 5 23:58:15.784: INFO: cloud-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:58:15.785] Nov 5 23:58:15.784: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:58:15.785] Nov 5 23:58:15.784: INFO: kube-addon-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:58:15.785] Nov 5 23:58:15.784: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:58:15.785] Nov 5 23:58:15.784: INFO: kube-apiserver-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:58:15.785] Nov 5 23:58:15.784: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:58:15.785] Nov 5 23:58:15.784: INFO: kube-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1105 23:58:15.786] Nov 5 23:58:15.784: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:58:15.786] Nov 5 23:58:15.784: INFO: azure-ip-masq-agent-825g9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:15.786] Nov 5 23:58:15.784: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:58:15.786] Nov 5 23:58:15.784: INFO: kube-proxy-8924t started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:15.786] Nov 5 23:58:15.784: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:58:16.039] Nov 5 23:58:16.039: INFO: I1105 23:58:16.040] Latency metrics for node k8s-master-73731178-vmss000001 I1105 23:58:16.040] Nov 5 23:58:16.039: INFO: I1105 23:58:16.040] Logging node info for node k8s-master-73731178-vmss000002 I1105 23:58:16.118] Nov 5 23:58:16.116: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000002,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000002,UID:6cf1398e-1b6b-4537-837d-9ffceb9a4f00,ResourceVersion:6531,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000002,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.6.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/2,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:27:55 +0000 UTC 2019-11-05 23:27:55 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:57:26 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:57:26 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:57:26 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:57:26 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.6} {Hostname k8s-master-73731178-vmss000002}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7964689c8ba4f448e6f435b3d4fefac,SystemUUID:9369535A-87BF-1E4B-86DF-5D1A23713C9F,BootID:74f93904-298f-454d-8df6-8d4bba193331,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:58:16.119] Nov 5 23:58:16.116: INFO: I1105 23:58:16.119] Logging kubelet events for node k8s-master-73731178-vmss000002 I1105 23:58:16.197] Nov 5 23:58:16.197: INFO: I1105 23:58:16.197] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000002 I1105 23:58:16.279] Nov 5 23:58:16.279: INFO: kube-addon-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:18 +0000 UTC (0+1 container statuses recorded) I1105 23:58:16.279] Nov 5 23:58:16.279: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:58:16.280] Nov 5 23:58:16.279: INFO: kube-apiserver-k8s-master-73731178-vmss000002 started at 2019-11-05 23:28:42 +0000 UTC (0+1 container statuses recorded) I1105 23:58:16.280] Nov 5 23:58:16.279: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:58:16.280] Nov 5 23:58:16.279: INFO: kube-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1105 23:58:16.280] Nov 5 23:58:16.279: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:58:16.280] Nov 5 23:58:16.279: INFO: kube-scheduler-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1105 23:58:16.280] Nov 5 23:58:16.279: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:58:16.280] Nov 5 23:58:16.279: INFO: cloud-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1105 23:58:16.281] Nov 5 23:58:16.279: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:58:16.281] Nov 5 23:58:16.279: INFO: azure-ip-masq-agent-74xks started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:16.281] Nov 5 23:58:16.279: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:58:16.281] Nov 5 23:58:16.279: INFO: kube-proxy-t958f started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:16.281] Nov 5 23:58:16.279: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:58:16.527] Nov 5 23:58:16.527: INFO: I1105 23:58:16.527] Latency metrics for node k8s-master-73731178-vmss000002 I1105 23:58:16.528] Nov 5 23:58:16.527: INFO: I1105 23:58:16.528] Logging node info for node k8s-master-73731178-vmss000003 I1105 23:58:16.607] Nov 5 23:58:16.604: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000003,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000003,UID:54efc1b0-183c-4153-b804-31d0d42ce204,ResourceVersion:6523,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000003,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/3,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:57:24 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:57:24 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:57:24 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:57:24 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{Hostname k8s-master-73731178-vmss000003} {InternalIP 10.240.0.7}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a448072d2d27400fa2252a0cb3c8ff37,SystemUUID:98F6A517-FFCA-8E4D-A914-52A5F1482433,BootID:50c0f9e6-7c4d-45ec-8984-248ea540d637,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:58:16.607] Nov 5 23:58:16.604: INFO: I1105 23:58:16.607] Logging kubelet events for node k8s-master-73731178-vmss000003 I1105 23:58:16.694] Nov 5 23:58:16.694: INFO: I1105 23:58:16.694] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000003 I1105 23:58:16.776] Nov 5 23:58:16.776: INFO: cloud-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:58:16.777] Nov 5 23:58:16.776: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:58:16.777] Nov 5 23:58:16.776: INFO: kube-addon-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:43 +0000 UTC (0+1 container statuses recorded) I1105 23:58:16.777] Nov 5 23:58:16.776: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:58:16.777] Nov 5 23:58:16.776: INFO: kube-apiserver-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:58:16.777] Nov 5 23:58:16.776: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:58:16.777] Nov 5 23:58:16.776: INFO: kube-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:58:16.778] Nov 5 23:58:16.776: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:58:16.778] Nov 5 23:58:16.776: INFO: kube-scheduler-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:58:16.778] Nov 5 23:58:16.776: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:58:16.778] Nov 5 23:58:16.776: INFO: azure-ip-masq-agent-4nshf started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:16.778] Nov 5 23:58:16.776: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:58:16.778] Nov 5 23:58:16.776: INFO: kube-proxy-qm7rq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1105 23:58:16.778] Nov 5 23:58:16.776: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:58:17.028] Nov 5 23:58:17.027: INFO: I1105 23:58:17.028] Latency metrics for node k8s-master-73731178-vmss000003 I1105 23:58:17.028] Nov 5 23:58:17.027: INFO: I1105 23:58:17.028] Logging node info for node k8s-master-73731178-vmss000004 I1105 23:58:17.107] Nov 5 23:58:17.105: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000004,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000004,UID:4a582f8b-6cf2-4e91-8770-fde6f9c22194,ResourceVersion:6518,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000004,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/4,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:32 +0000 UTC 2019-11-05 23:28:32 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-05 23:57:23 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-05 23:57:23 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-05 23:57:23 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-05 23:57:23 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.8} {Hostname k8s-master-73731178-vmss000004}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:252c632059f2483d87e2d8d689053e48,SystemUUID:5BBFFB00-FBAB-0F4A-8F63-6B99DE219F64,BootID:165ca62a-8171-48e8-92f7-3ad786cb6b9a,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1105 23:58:17.107] Nov 5 23:58:17.105: INFO: I1105 23:58:17.108] Logging kubelet events for node k8s-master-73731178-vmss000004 I1105 23:58:17.186] Nov 5 23:58:17.186: INFO: I1105 23:58:17.186] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000004 I1105 23:58:17.267] Nov 5 23:58:17.267: INFO: azure-ip-masq-agent-rh9pr started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:58:17.267] Nov 5 23:58:17.267: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1105 23:58:17.267] Nov 5 23:58:17.267: INFO: kube-proxy-rk5r6 started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1105 23:58:17.267] Nov 5 23:58:17.267: INFO: Container kube-proxy ready: true, restart count 0 I1105 23:58:17.268] Nov 5 23:58:17.267: INFO: cloud-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:58:17.268] Nov 5 23:58:17.267: INFO: Container cloud-controller-manager ready: true, restart count 0 I1105 23:58:17.268] Nov 5 23:58:17.267: INFO: kube-addon-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:58:17.268] Nov 5 23:58:17.267: INFO: Container kube-addon-manager ready: true, restart count 0 I1105 23:58:17.268] Nov 5 23:58:17.267: INFO: kube-apiserver-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:58:17.268] Nov 5 23:58:17.267: INFO: Container kube-apiserver ready: true, restart count 0 I1105 23:58:17.269] Nov 5 23:58:17.267: INFO: kube-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1105 23:58:17.269] Nov 5 23:58:17.267: INFO: Container kube-controller-manager ready: true, restart count 0 I1105 23:58:17.269] Nov 5 23:58:17.267: INFO: kube-scheduler-k8s-master-73731178-vmss000004 started at 2019-11-05 23:28:31 +0000 UTC (0+1 container statuses recorded) I1105 23:58:17.269] Nov 5 23:58:17.267: INFO: Container kube-scheduler ready: true, restart count 0 I1105 23:58:17.515] Nov 5 23:58:17.514: INFO: I1105 23:58:17.515] Latency metrics for node k8s-master-73731178-vmss000004 I1105 23:58:17.515] Nov 5 23:58:17.515: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1105 23:58:17.594] STEP: Destroying namespace "azuredisk-180" for this suite. I1105 23:58:31.829] Nov 5 23:58:31.829: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1105 23:58:34.728] Nov 5 23:58:34.728: INFO: namespace azuredisk-180 deletion completed in 17.133641973s I1105 23:58:34.728] I1105 23:58:34.728] • Failure [323.347 seconds] I1105 23:58:34.728] [azuredisk-csi-e2e] Dynamic Provisioning I1105 23:58:34.729] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:33 I1105 23:58:34.729] [single-az] I1105 23:58:34.729] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:36 I1105 23:58:34.729] [env] should retain PV with reclaimPolicy "Retain" [It] I1105 23:58:34.729] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:240 I1105 23:58:34.729] I1105 23:58:34.730] Unexpected error: I1105 23:58:34.730] <*errors.errorString | 0xc000b62770>: { I1105 23:58:34.730] s: "PersistentVolumeClaims [pvc-7xh4b] not all in phase Bound within 5m0s", I1105 23:58:34.730] } I1105 23:58:34.730] PersistentVolumeClaims [pvc-7xh4b] not all in phase Bound within 5m0s I1105 23:58:34.730] occurred I1105 23:58:34.731] I1105 23:58:34.731] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1105 23:58:34.731] ------------------------------ I1105 23:58:34.731] [azuredisk-csi-e2e] Dynamic Provisioning [single-az] I1105 23:58:34.731] should delete PV with reclaimPolicy "Delete" I1105 23:58:34.732] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:221 I1105 23:58:34.732] [BeforeEach] [single-az] I1105 23:58:34.732] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1105 23:58:34.732] STEP: Creating a kubernetes client I1105 23:58:34.732] Nov 5 23:58:34.728: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1105 23:58:34.733] STEP: Building a namespace api object, basename azuredisk I1105 23:58:34.960] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-8464 I1105 23:58:35.223] STEP: Waiting for a default service account to be provisioned in namespace I1105 23:58:35.298] [BeforeEach] [single-az] I1105 23:58:35.298] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:58 I1105 23:58:35.298] [It] should delete PV with reclaimPolicy "Delete" I1105 23:58:35.298] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:221 I1105 23:58:35.298] STEP: setting up the StorageClass I1105 23:58:35.298] STEP: creating a StorageClass I1105 23:58:35.382] STEP: setting up the PVC and PV I1105 23:58:35.382] STEP: creating a PVC I1105 23:58:35.468] STEP: waiting for PVC to be in phase "Bound" I1105 23:58:35.469] Nov 5 23:58:35.468: INFO: Waiting up to 5m0s for PersistentVolumeClaims [pvc-ssrnz] to have phase Bound I1105 23:58:35.545] Nov 5 23:58:35.545: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:58:37.622] Nov 5 23:58:37.622: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:58:39.699] Nov 5 23:58:39.699: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:58:41.776] Nov 5 23:58:41.776: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:58:43.853] Nov 5 23:58:43.853: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:58:45.930] Nov 5 23:58:45.930: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:58:48.024] Nov 5 23:58:48.024: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:58:50.101] Nov 5 23:58:50.101: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:58:52.178] Nov 5 23:58:52.178: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:58:54.255] Nov 5 23:58:54.255: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:58:56.332] Nov 5 23:58:56.332: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:58:58.409] Nov 5 23:58:58.409: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:00.491] Nov 5 23:59:00.491: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:02.568] Nov 5 23:59:02.567: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:04.645] Nov 5 23:59:04.645: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:06.723] Nov 5 23:59:06.723: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:08.800] Nov 5 23:59:08.799: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:10.879] Nov 5 23:59:10.877: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:12.956] Nov 5 23:59:12.956: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:15.034] Nov 5 23:59:15.034: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:17.111] Nov 5 23:59:17.111: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:19.188] Nov 5 23:59:19.188: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:21.266] Nov 5 23:59:21.266: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:23.343] Nov 5 23:59:23.342: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:25.420] Nov 5 23:59:25.420: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:27.498] Nov 5 23:59:27.498: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:29.575] Nov 5 23:59:29.575: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:31.652] Nov 5 23:59:31.652: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:33.729] Nov 5 23:59:33.729: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:35.807] Nov 5 23:59:35.806: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:37.884] Nov 5 23:59:37.883: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:39.961] Nov 5 23:59:39.961: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:42.039] Nov 5 23:59:42.038: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:44.116] Nov 5 23:59:44.116: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:46.193] Nov 5 23:59:46.193: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:48.270] Nov 5 23:59:48.270: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:50.347] Nov 5 23:59:50.347: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:52.423] Nov 5 23:59:52.423: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:54.500] Nov 5 23:59:54.500: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:56.577] Nov 5 23:59:56.576: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1105 23:59:58.654] Nov 5 23:59:58.654: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:00.731] Nov 6 00:00:00.731: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:02.808] Nov 6 00:00:02.808: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:04.885] Nov 6 00:00:04.885: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:06.962] Nov 6 00:00:06.961: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:09.039] Nov 6 00:00:09.038: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:11.116] Nov 6 00:00:11.115: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:13.193] Nov 6 00:00:13.192: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:15.270] Nov 6 00:00:15.270: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:17.347] Nov 6 00:00:17.346: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:19.424] Nov 6 00:00:19.424: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:21.503] Nov 6 00:00:21.503: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:23.581] Nov 6 00:00:23.581: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:25.658] Nov 6 00:00:25.658: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:27.736] Nov 6 00:00:27.736: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:29.814] Nov 6 00:00:29.813: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:31.890] Nov 6 00:00:31.890: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:33.968] Nov 6 00:00:33.968: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:36.045] Nov 6 00:00:36.045: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:38.123] Nov 6 00:00:38.122: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:40.200] Nov 6 00:00:40.200: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:42.277] Nov 6 00:00:42.277: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:44.355] Nov 6 00:00:44.354: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:46.432] Nov 6 00:00:46.432: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:48.509] Nov 6 00:00:48.508: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:50.586] Nov 6 00:00:50.585: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:52.663] Nov 6 00:00:52.663: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:54.743] Nov 6 00:00:54.743: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:56.820] Nov 6 00:00:56.820: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:00:58.898] Nov 6 00:00:58.898: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:00.975] Nov 6 00:01:00.975: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:03.052] Nov 6 00:01:03.052: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:05.131] Nov 6 00:01:05.130: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:07.208] Nov 6 00:01:07.208: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:09.286] Nov 6 00:01:09.285: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:11.363] Nov 6 00:01:11.363: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:13.442] Nov 6 00:01:13.442: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:15.519] Nov 6 00:01:15.519: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:17.597] Nov 6 00:01:17.596: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:19.673] Nov 6 00:01:19.673: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:21.753] Nov 6 00:01:21.753: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:23.831] Nov 6 00:01:23.831: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:25.908] Nov 6 00:01:25.908: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:27.986] Nov 6 00:01:27.986: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:30.064] Nov 6 00:01:30.063: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:32.141] Nov 6 00:01:32.141: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:34.218] Nov 6 00:01:34.218: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:36.295] Nov 6 00:01:36.295: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:38.372] Nov 6 00:01:38.372: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:40.455] Nov 6 00:01:40.455: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:42.532] Nov 6 00:01:42.532: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:44.613] Nov 6 00:01:44.613: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:46.700] Nov 6 00:01:46.700: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:48.788] Nov 6 00:01:48.788: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:50.873] Nov 6 00:01:50.873: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:52.959] Nov 6 00:01:52.958: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:55.043] Nov 6 00:01:55.043: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:57.128] Nov 6 00:01:57.128: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:01:59.217] Nov 6 00:01:59.217: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:01.302] Nov 6 00:02:01.302: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:03.387] Nov 6 00:02:03.387: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:05.471] Nov 6 00:02:05.471: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:07.556] Nov 6 00:02:07.556: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:09.640] Nov 6 00:02:09.640: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:11.725] Nov 6 00:02:11.725: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:13.810] Nov 6 00:02:13.810: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:15.895] Nov 6 00:02:15.895: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:17.980] Nov 6 00:02:17.979: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:20.072] Nov 6 00:02:20.072: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:22.160] Nov 6 00:02:22.160: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:24.253] Nov 6 00:02:24.253: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:26.339] Nov 6 00:02:26.338: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:28.426] Nov 6 00:02:28.426: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:30.513] Nov 6 00:02:30.513: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:32.598] Nov 6 00:02:32.598: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:34.683] Nov 6 00:02:34.683: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:36.768] Nov 6 00:02:36.768: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:38.853] Nov 6 00:02:38.853: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:40.939] Nov 6 00:02:40.939: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:43.024] Nov 6 00:02:43.024: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:45.112] Nov 6 00:02:45.111: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:47.197] Nov 6 00:02:47.196: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:49.282] Nov 6 00:02:49.281: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:51.367] Nov 6 00:02:51.366: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:53.452] Nov 6 00:02:53.452: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:55.537] Nov 6 00:02:55.536: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:57.623] Nov 6 00:02:57.623: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:02:59.708] Nov 6 00:02:59.708: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:01.792] Nov 6 00:03:01.792: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:03.879] Nov 6 00:03:03.879: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:05.963] Nov 6 00:03:05.963: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:08.056] Nov 6 00:03:08.055: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:10.141] Nov 6 00:03:10.141: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:12.243] Nov 6 00:03:12.242: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:14.328] Nov 6 00:03:14.328: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:16.414] Nov 6 00:03:16.414: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:18.499] Nov 6 00:03:18.498: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:20.583] Nov 6 00:03:20.583: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:22.668] Nov 6 00:03:22.668: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:24.754] Nov 6 00:03:24.754: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:26.839] Nov 6 00:03:26.838: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:28.924] Nov 6 00:03:28.924: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:31.009] Nov 6 00:03:31.008: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:33.094] Nov 6 00:03:33.094: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:35.179] Nov 6 00:03:35.179: INFO: PersistentVolumeClaim pvc-ssrnz found but phase is Pending instead of Bound. I1106 00:03:37.179] Nov 6 00:03:37.179: INFO: Unexpected error occurred: PersistentVolumeClaims [pvc-ssrnz] not all in phase Bound within 5m0s I1106 00:03:37.180] [AfterEach] [single-az] I1106 00:03:37.180] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1106 00:03:37.180] STEP: Collecting events from namespace "azuredisk-8464". I1106 00:03:37.266] STEP: Found 3 events. I1106 00:03:37.266] Nov 6 00:03:37.266: INFO: At 2019-11-05 23:58:35 +0000 UTC - event for pvc-ssrnz: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator I1106 00:03:37.266] Nov 6 00:03:37.266: INFO: At 2019-11-05 23:58:35 +0000 UTC - event for pvc-ssrnz: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } Provisioning: External provisioner is provisioning volume for claim "azuredisk-8464/pvc-ssrnz" I1106 00:03:37.267] Nov 6 00:03:37.266: INFO: At 2019-11-05 23:58:45 +0000 UTC - event for pvc-ssrnz: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-8464-disk.csi.azure.com-dynamic-sc-6pxn6": rpc error: code = DeadlineExceeded desc = context deadline exceeded I1106 00:03:37.351] Nov 6 00:03:37.351: INFO: POD NODE PHASE GRACE CONDITIONS I1106 00:03:37.351] Nov 6 00:03:37.351: INFO: I1106 00:03:37.601] Nov 6 00:03:37.601: INFO: I1106 00:03:37.602] Logging node info for node k8s-agentpool-73731178-vmss000000 I1106 00:03:37.689] Nov 6 00:03:37.686: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000000,UID:e9bc0b16-6756-4155-b49c-e223c0ba9499,ResourceVersion:7601,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-1,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000000"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:18 +0000 UTC 2019-11-05 23:28:18 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:03:27 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:03:27 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:03:27 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:03:27 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.4} {Hostname k8s-agentpool-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:956ad861ae4a42099801f8e840b4e502,SystemUUID:439CF4B9-2B9F-B74E-9ED7-7379FD8BD0DF,BootID:bd3476e5-4fd4-4437-9b56-54fbe38a3a49,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1] 121711221} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/metrics-server-amd64@sha256:49a9f12f7067d11f42c803dbe61ed2c1299959ad85cb315b25ff7eef8e6b8892 k8s.gcr.io/metrics-server-amd64:v0.2.1] 42541759} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:03:37.689] Nov 6 00:03:37.686: INFO: I1106 00:03:37.689] Logging kubelet events for node k8s-agentpool-73731178-vmss000000 I1106 00:03:37.775] Nov 6 00:03:37.775: INFO: I1106 00:03:37.775] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000000 I1106 00:03:37.866] Nov 6 00:03:37.866: INFO: metrics-server-864ffbc5c-kb9cz started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:37.866] Nov 6 00:03:37.866: INFO: Container metrics-server ready: true, restart count 0 I1106 00:03:37.866] Nov 6 00:03:37.866: INFO: kube-proxy-jnqp8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:37.866] Nov 6 00:03:37.866: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:03:37.867] Nov 6 00:03:37.866: INFO: kubernetes-dashboard-66dd8b8df7-4rnsp started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:03:37.867] Nov 6 00:03:37.866: INFO: Container kubernetes-dashboard ready: true, restart count 1 I1106 00:03:37.867] Nov 6 00:03:37.866: INFO: csi-azuredisk-node-g6wbm started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 00:03:37.867] Nov 6 00:03:37.866: INFO: Container azuredisk ready: true, restart count 0 I1106 00:03:37.867] Nov 6 00:03:37.866: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:03:37.867] Nov 6 00:03:37.866: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 00:03:37.867] Nov 6 00:03:37.866: INFO: blobfuse-flexvol-installer-cvgkv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:37.868] Nov 6 00:03:37.866: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 00:03:37.868] Nov 6 00:03:37.866: INFO: azure-ip-masq-agent-vn5zc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:37.868] Nov 6 00:03:37.866: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:03:37.868] Nov 6 00:03:37.866: INFO: keyvault-flexvolume-xr7v6 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:37.868] Nov 6 00:03:37.866: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 00:03:38.141] Nov 6 00:03:38.141: INFO: I1106 00:03:38.142] Latency metrics for node k8s-agentpool-73731178-vmss000000 I1106 00:03:38.142] Nov 6 00:03:38.141: INFO: I1106 00:03:38.142] Logging node info for node k8s-agentpool-73731178-vmss000001 I1106 00:03:38.230] Nov 6 00:03:38.226: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000001,UID:ab75ba9d-ec23-4ff7-ae5a-d1a19974c05d,ResourceVersion:7541,Generation:0,CreationTimestamp:2019-11-05 23:27:31 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-2,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000001"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.5.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:17 +0000 UTC 2019-11-05 23:28:17 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:03:06 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:03:06 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:03:06 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:03:06 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.5} {Hostname k8s-agentpool-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f0eae5e73d0f4ccb82dd0f22701c288f,SystemUUID:7E54C533-AED3-744D-8D17-EFF5E62EA06D,BootID:6d58e5a6-45fb-4a41-a491-bc2f3799f411,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[gcr.io/kubernetes-helm/tiller@sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1 gcr.io/kubernetes-helm/tiller:v2.11.0] 71821984} {[quay.io/k8scsi/csi-provisioner@sha256:d657c839dce87324fe2b677302913f9386f885f8746be7bea0ced5b0844e3433 quay.io/k8scsi/csi-provisioner:v1.3.1] 50596998} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0] 46226754} {[quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1] 45874691} {[quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb quay.io/k8scsi/csi-snapshotter:v1.1.0] 44325352} {[k8s.gcr.io/coredns@sha256:e83beb5e43f8513fa735e77ffc5859640baea30a882a11cc75c4c3244a737d3c k8s.gcr.io/coredns:1.5.0] 42488424} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0] 14967303} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:03:38.230] Nov 6 00:03:38.226: INFO: I1106 00:03:38.230] Logging kubelet events for node k8s-agentpool-73731178-vmss000001 I1106 00:03:38.315] Nov 6 00:03:38.315: INFO: I1106 00:03:38.315] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000001 I1106 00:03:38.407] Nov 6 00:03:38.407: INFO: csi-azuredisk-node-ml68k started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 00:03:38.408] Nov 6 00:03:38.407: INFO: Container azuredisk ready: true, restart count 0 I1106 00:03:38.408] Nov 6 00:03:38.407: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:03:38.408] Nov 6 00:03:38.407: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 00:03:38.408] Nov 6 00:03:38.407: INFO: azure-ip-masq-agent-6qqgc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:38.408] Nov 6 00:03:38.407: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:03:38.408] Nov 6 00:03:38.407: INFO: keyvault-flexvolume-7tztj started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:38.409] Nov 6 00:03:38.407: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 00:03:38.409] Nov 6 00:03:38.407: INFO: kube-proxy-z4hf8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:38.409] Nov 6 00:03:38.407: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:03:38.409] Nov 6 00:03:38.407: INFO: tiller-deploy-54c96cb5df-wlzbj started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:03:38.409] Nov 6 00:03:38.407: INFO: Container tiller ready: true, restart count 0 I1106 00:03:38.409] Nov 6 00:03:38.407: INFO: csi-azuredisk-controller-59bf945f54-k2p5m started at 2019-11-05 23:30:58 +0000 UTC (0+6 container statuses recorded) I1106 00:03:38.409] Nov 6 00:03:38.407: INFO: Container azuredisk ready: true, restart count 0 I1106 00:03:38.409] Nov 6 00:03:38.407: INFO: Container cluster-driver-registrar ready: true, restart count 0 I1106 00:03:38.410] Nov 6 00:03:38.407: INFO: Container csi-attacher ready: true, restart count 0 I1106 00:03:38.410] Nov 6 00:03:38.407: INFO: Container csi-provisioner ready: true, restart count 0 I1106 00:03:38.410] Nov 6 00:03:38.407: INFO: Container csi-snapshotter ready: true, restart count 0 I1106 00:03:38.410] Nov 6 00:03:38.407: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:03:38.410] Nov 6 00:03:38.407: INFO: blobfuse-flexvol-installer-589vv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:38.410] Nov 6 00:03:38.407: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 00:03:38.410] Nov 6 00:03:38.407: INFO: coredns-7f68dcdbdb-f98nq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:38.411] Nov 6 00:03:38.407: INFO: Container coredns ready: true, restart count 0 I1106 00:03:38.685] Nov 6 00:03:38.685: INFO: I1106 00:03:38.685] Latency metrics for node k8s-agentpool-73731178-vmss000001 I1106 00:03:38.685] Nov 6 00:03:38.685: INFO: I1106 00:03:38.685] Logging node info for node k8s-master-73731178-vmss000000 I1106 00:03:38.772] Nov 6 00:03:38.769: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000000,UID:1f765350-accc-4e67-898b-e4d84be84901,ResourceVersion:7594,Generation:0,CreationTimestamp:2019-11-05 23:27:30 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:03:25 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:03:25 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:03:25 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:03:25 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.4} {Hostname k8s-master-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:836af7329e85492184d73f1ea7f63a4e,SystemUUID:D1C68207-4499-C24D-B9D6-ADA0554A1BE5,BootID:a29dde5d-b4dc-483e-a50e-76e79359d759,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:03:38.772] Nov 6 00:03:38.769: INFO: I1106 00:03:38.772] Logging kubelet events for node k8s-master-73731178-vmss000000 I1106 00:03:38.860] Nov 6 00:03:38.859: INFO: I1106 00:03:38.860] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000000 I1106 00:03:38.950] Nov 6 00:03:38.950: INFO: kube-apiserver-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:03:38.950] Nov 6 00:03:38.950: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:03:38.950] Nov 6 00:03:38.950: INFO: azure-ip-masq-agent-xmkx2 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:38.951] Nov 6 00:03:38.950: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:03:38.951] Nov 6 00:03:38.950: INFO: kube-proxy-2fwv9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:38.951] Nov 6 00:03:38.950: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:03:38.951] Nov 6 00:03:38.950: INFO: kube-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:03:38.951] Nov 6 00:03:38.950: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:03:38.951] Nov 6 00:03:38.950: INFO: kube-scheduler-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:03:38.951] Nov 6 00:03:38.950: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:03:38.952] Nov 6 00:03:38.950: INFO: cloud-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:03:38.952] Nov 6 00:03:38.950: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:03:38.952] Nov 6 00:03:38.950: INFO: kube-addon-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:03:38.952] Nov 6 00:03:38.950: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:03:39.222] Nov 6 00:03:39.222: INFO: I1106 00:03:39.222] Latency metrics for node k8s-master-73731178-vmss000000 I1106 00:03:39.223] Nov 6 00:03:39.222: INFO: I1106 00:03:39.223] Logging node info for node k8s-master-73731178-vmss000001 I1106 00:03:39.308] Nov 6 00:03:39.306: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000001,UID:442cf114-6b0a-4c80-a9e5-be62e184f94c,ResourceVersion:7543,Generation:0,CreationTimestamp:2019-11-05 23:27:42 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:19 +0000 UTC 2019-11-05 23:28:19 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:03:07 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:03:07 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:03:07 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:03:07 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.5} {Hostname k8s-master-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1a9da6632c314858a31bccaea0be0f50,SystemUUID:8F48A76E-30E1-B948-89B2-33C0048059B4,BootID:1597124c-68a3-452c-ae03-6cfe9bc1e57f,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:03:39.309] Nov 6 00:03:39.306: INFO: I1106 00:03:39.309] Logging kubelet events for node k8s-master-73731178-vmss000001 I1106 00:03:39.395] Nov 6 00:03:39.395: INFO: I1106 00:03:39.395] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000001 I1106 00:03:39.484] Nov 6 00:03:39.484: INFO: azure-ip-masq-agent-825g9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:39.485] Nov 6 00:03:39.484: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:03:39.485] Nov 6 00:03:39.484: INFO: kube-proxy-8924t started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:39.485] Nov 6 00:03:39.484: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:03:39.485] Nov 6 00:03:39.484: INFO: kube-scheduler-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:03:39.485] Nov 6 00:03:39.484: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:03:39.486] Nov 6 00:03:39.484: INFO: cloud-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:03:39.486] Nov 6 00:03:39.484: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:03:39.486] Nov 6 00:03:39.484: INFO: kube-addon-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:03:39.486] Nov 6 00:03:39.484: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:03:39.486] Nov 6 00:03:39.484: INFO: kube-apiserver-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:03:39.487] Nov 6 00:03:39.484: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:03:39.487] Nov 6 00:03:39.484: INFO: kube-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:03:39.487] Nov 6 00:03:39.484: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:03:39.758] Nov 6 00:03:39.758: INFO: I1106 00:03:39.759] Latency metrics for node k8s-master-73731178-vmss000001 I1106 00:03:39.759] Nov 6 00:03:39.758: INFO: I1106 00:03:39.759] Logging node info for node k8s-master-73731178-vmss000002 I1106 00:03:39.846] Nov 6 00:03:39.843: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000002,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000002,UID:6cf1398e-1b6b-4537-837d-9ffceb9a4f00,ResourceVersion:7603,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000002,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.6.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/2,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:27:55 +0000 UTC 2019-11-05 23:27:55 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:03:27 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:03:27 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:03:27 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:03:27 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.6} {Hostname k8s-master-73731178-vmss000002}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7964689c8ba4f448e6f435b3d4fefac,SystemUUID:9369535A-87BF-1E4B-86DF-5D1A23713C9F,BootID:74f93904-298f-454d-8df6-8d4bba193331,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:03:39.846] Nov 6 00:03:39.843: INFO: I1106 00:03:39.846] Logging kubelet events for node k8s-master-73731178-vmss000002 I1106 00:03:39.932] Nov 6 00:03:39.932: INFO: I1106 00:03:39.932] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000002 I1106 00:03:40.039] Nov 6 00:03:40.039: INFO: kube-addon-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:18 +0000 UTC (0+1 container statuses recorded) I1106 00:03:40.039] Nov 6 00:03:40.039: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:03:40.039] Nov 6 00:03:40.039: INFO: kube-apiserver-k8s-master-73731178-vmss000002 started at 2019-11-05 23:28:42 +0000 UTC (0+1 container statuses recorded) I1106 00:03:40.040] Nov 6 00:03:40.039: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:03:40.040] Nov 6 00:03:40.039: INFO: kube-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:03:40.040] Nov 6 00:03:40.039: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:03:40.040] Nov 6 00:03:40.039: INFO: kube-scheduler-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:03:40.040] Nov 6 00:03:40.039: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:03:40.040] Nov 6 00:03:40.039: INFO: cloud-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:03:40.040] Nov 6 00:03:40.039: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:03:40.041] Nov 6 00:03:40.039: INFO: azure-ip-masq-agent-74xks started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:40.041] Nov 6 00:03:40.039: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:03:40.041] Nov 6 00:03:40.039: INFO: kube-proxy-t958f started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:40.041] Nov 6 00:03:40.039: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:03:40.324] Nov 6 00:03:40.324: INFO: I1106 00:03:40.324] Latency metrics for node k8s-master-73731178-vmss000002 I1106 00:03:40.324] Nov 6 00:03:40.324: INFO: I1106 00:03:40.325] Logging node info for node k8s-master-73731178-vmss000003 I1106 00:03:40.411] Nov 6 00:03:40.408: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000003,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000003,UID:54efc1b0-183c-4153-b804-31d0d42ce204,ResourceVersion:7595,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000003,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/3,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:03:25 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:03:25 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:03:25 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:03:25 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{Hostname k8s-master-73731178-vmss000003} {InternalIP 10.240.0.7}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a448072d2d27400fa2252a0cb3c8ff37,SystemUUID:98F6A517-FFCA-8E4D-A914-52A5F1482433,BootID:50c0f9e6-7c4d-45ec-8984-248ea540d637,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:03:40.411] Nov 6 00:03:40.408: INFO: I1106 00:03:40.411] Logging kubelet events for node k8s-master-73731178-vmss000003 I1106 00:03:40.497] Nov 6 00:03:40.497: INFO: I1106 00:03:40.498] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000003 I1106 00:03:40.589] Nov 6 00:03:40.588: INFO: azure-ip-masq-agent-4nshf started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:40.589] Nov 6 00:03:40.588: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:03:40.589] Nov 6 00:03:40.588: INFO: kube-proxy-qm7rq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:03:40.589] Nov 6 00:03:40.588: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:03:40.590] Nov 6 00:03:40.588: INFO: cloud-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:03:40.590] Nov 6 00:03:40.588: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:03:40.590] Nov 6 00:03:40.588: INFO: kube-addon-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:43 +0000 UTC (0+1 container statuses recorded) I1106 00:03:40.590] Nov 6 00:03:40.588: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:03:40.590] Nov 6 00:03:40.588: INFO: kube-apiserver-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:03:40.590] Nov 6 00:03:40.589: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:03:40.591] Nov 6 00:03:40.589: INFO: kube-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:03:40.591] Nov 6 00:03:40.589: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:03:40.591] Nov 6 00:03:40.589: INFO: kube-scheduler-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:03:40.591] Nov 6 00:03:40.589: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:03:40.868] Nov 6 00:03:40.868: INFO: I1106 00:03:40.868] Latency metrics for node k8s-master-73731178-vmss000003 I1106 00:03:40.869] Nov 6 00:03:40.868: INFO: I1106 00:03:40.869] Logging node info for node k8s-master-73731178-vmss000004 I1106 00:03:40.955] Nov 6 00:03:40.952: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000004,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000004,UID:4a582f8b-6cf2-4e91-8770-fde6f9c22194,ResourceVersion:7591,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000004,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/4,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:32 +0000 UTC 2019-11-05 23:28:32 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:03:24 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:03:24 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:03:24 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:03:24 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.8} {Hostname k8s-master-73731178-vmss000004}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:252c632059f2483d87e2d8d689053e48,SystemUUID:5BBFFB00-FBAB-0F4A-8F63-6B99DE219F64,BootID:165ca62a-8171-48e8-92f7-3ad786cb6b9a,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:03:40.955] Nov 6 00:03:40.953: INFO: I1106 00:03:40.955] Logging kubelet events for node k8s-master-73731178-vmss000004 I1106 00:03:41.042] Nov 6 00:03:41.041: INFO: I1106 00:03:41.042] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000004 I1106 00:03:41.130] Nov 6 00:03:41.130: INFO: kube-apiserver-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:03:41.130] Nov 6 00:03:41.130: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:03:41.131] Nov 6 00:03:41.130: INFO: kube-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:03:41.131] Nov 6 00:03:41.130: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:03:41.131] Nov 6 00:03:41.130: INFO: kube-scheduler-k8s-master-73731178-vmss000004 started at 2019-11-05 23:28:31 +0000 UTC (0+1 container statuses recorded) I1106 00:03:41.131] Nov 6 00:03:41.130: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:03:41.131] Nov 6 00:03:41.130: INFO: azure-ip-masq-agent-rh9pr started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:03:41.132] Nov 6 00:03:41.130: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:03:41.132] Nov 6 00:03:41.130: INFO: kube-proxy-rk5r6 started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:03:41.132] Nov 6 00:03:41.130: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:03:41.132] Nov 6 00:03:41.130: INFO: cloud-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:03:41.132] Nov 6 00:03:41.130: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:03:41.133] Nov 6 00:03:41.130: INFO: kube-addon-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:03:41.133] Nov 6 00:03:41.130: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:03:41.399] Nov 6 00:03:41.399: INFO: I1106 00:03:41.399] Latency metrics for node k8s-master-73731178-vmss000004 I1106 00:03:41.399] Nov 6 00:03:41.399: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1106 00:03:41.484] STEP: Destroying namespace "azuredisk-8464" for this suite. I1106 00:03:55.746] Nov 6 00:03:55.746: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1106 00:03:58.911] Nov 6 00:03:58.911: INFO: namespace azuredisk-8464 deletion completed in 17.426531759s I1106 00:03:58.911] I1106 00:03:58.911] • Failure [324.183 seconds] I1106 00:03:58.911] [azuredisk-csi-e2e] Dynamic Provisioning I1106 00:03:58.911] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:33 I1106 00:03:58.912] [single-az] I1106 00:03:58.912] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:36 I1106 00:03:58.912] should delete PV with reclaimPolicy "Delete" [It] I1106 00:03:58.912] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:221 I1106 00:03:58.912] I1106 00:03:58.912] Unexpected error: I1106 00:03:58.912] <*errors.errorString | 0xc000997520>: { I1106 00:03:58.913] s: "PersistentVolumeClaims [pvc-ssrnz] not all in phase Bound within 5m0s", I1106 00:03:58.913] } I1106 00:03:58.913] PersistentVolumeClaims [pvc-ssrnz] not all in phase Bound within 5m0s I1106 00:03:58.913] occurred I1106 00:03:58.913] I1106 00:03:58.913] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1106 00:03:58.913] ------------------------------ I1106 00:03:58.913] [azuredisk-csi-e2e] Dynamic Provisioning [multi-az] I1106 00:03:58.913] should create a raw block volume on demand I1106 00:03:58.914] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:101 I1106 00:03:58.914] [BeforeEach] [multi-az] I1106 00:03:58.914] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1106 00:03:58.914] STEP: Creating a kubernetes client I1106 00:03:58.914] Nov 6 00:03:58.911: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1106 00:03:58.914] STEP: Building a namespace api object, basename azuredisk I1106 00:03:59.171] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-7509 I1106 00:03:59.445] STEP: Waiting for a default service account to be provisioned in namespace I1106 00:03:59.527] [BeforeEach] [multi-az] I1106 00:03:59.528] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:58 I1106 00:03:59.528] [It] should create a raw block volume on demand I1106 00:03:59.528] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:101 I1106 00:03:59.528] STEP: setting up the StorageClass I1106 00:03:59.528] STEP: creating a StorageClass I1106 00:03:59.619] STEP: setting up the PVC and PV I1106 00:03:59.620] STEP: creating a PVC I1106 00:03:59.711] STEP: deploying the pod I1106 00:03:59.800] STEP: checking that the pods command exits with no error I1106 00:03:59.800] Nov 6 00:03:59.800: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-zjlj6" in namespace "azuredisk-7509" to be "success or failure" I1106 00:03:59.884] Nov 6 00:03:59.884: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 84.314234ms I1106 00:04:01.969] Nov 6 00:04:01.969: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.169266617s I1106 00:04:04.059] Nov 6 00:04:04.058: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.258826136s I1106 00:04:06.144] Nov 6 00:04:06.143: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 6.343813821s I1106 00:04:08.237] Nov 6 00:04:08.236: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 8.436821367s I1106 00:04:10.322] Nov 6 00:04:10.322: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 10.522239556s I1106 00:04:12.407] Nov 6 00:04:12.407: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 12.607407344s I1106 00:04:14.492] Nov 6 00:04:14.492: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 14.692606533s I1106 00:04:16.577] Nov 6 00:04:16.577: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 16.777320418s I1106 00:04:18.662] Nov 6 00:04:18.662: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 18.862219506s I1106 00:04:20.747] Nov 6 00:04:20.747: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 20.947308896s I1106 00:04:22.833] Nov 6 00:04:22.833: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 23.033600995s I1106 00:04:24.918] Nov 6 00:04:24.918: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 25.118660285s I1106 00:04:27.003] Nov 6 00:04:27.003: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 27.203182273s I1106 00:04:29.088] Nov 6 00:04:29.088: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 29.288052863s I1106 00:04:31.172] Nov 6 00:04:31.172: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 31.372554451s I1106 00:04:33.258] Nov 6 00:04:33.257: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 33.457595744s I1106 00:04:35.344] Nov 6 00:04:35.343: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 35.543820046s I1106 00:04:37.429] Nov 6 00:04:37.428: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 37.628822039s I1106 00:04:39.514] Nov 6 00:04:39.514: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 39.714241937s I1106 00:04:41.599] Nov 6 00:04:41.599: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 41.79906433s I1106 00:04:43.684] Nov 6 00:04:43.684: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 43.884516629s I1106 00:04:45.769] Nov 6 00:04:45.769: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Pending", Reason="", readiness=false. Elapsed: 45.969191622s I1106 00:04:47.854] Nov 6 00:04:47.853: INFO: Pod "azuredisk-volume-tester-zjlj6": Phase="Succeeded", Reason="", readiness=false. Elapsed: 48.053670214s I1106 00:04:47.854] STEP: Saw pod success I1106 00:04:47.854] Nov 6 00:04:47.853: INFO: Pod "azuredisk-volume-tester-zjlj6" satisfied condition "success or failure" I1106 00:04:47.854] Nov 6 00:04:47.853: INFO: deleting Pod "azuredisk-7509"/"azuredisk-volume-tester-zjlj6" I1106 00:04:47.943] Nov 6 00:04:47.943: INFO: Pod azuredisk-volume-tester-zjlj6 has the following logs: e2e-test I1106 00:04:47.943] I1106 00:04:47.943] STEP: Deleting pod azuredisk-volume-tester-zjlj6 in namespace azuredisk-7509 I1106 00:04:48.175] STEP: validating provisioned PV I1106 00:04:48.258] STEP: checking the PV I1106 00:04:48.258] Nov 6 00:04:48.258: INFO: deleting PVC "azuredisk-7509"/"pvc-tv6gp" I1106 00:04:48.258] Nov 6 00:04:48.258: INFO: Deleting PersistentVolumeClaim "pvc-tv6gp" I1106 00:04:48.353] STEP: waiting for claim's PV "pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312" to be deleted I1106 00:04:48.353] Nov 6 00:04:48.353: INFO: Waiting up to 10m0s for PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 to get deleted I1106 00:04:48.439] Nov 6 00:04:48.439: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (86.470651ms) I1106 00:04:53.523] Nov 6 00:04:53.523: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (5.170329526s) I1106 00:04:58.608] Nov 6 00:04:58.608: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (10.254875609s) I1106 00:05:03.692] Nov 6 00:05:03.692: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (15.339545196s) I1106 00:05:08.777] Nov 6 00:05:08.777: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (20.42458569s) I1106 00:05:13.862] Nov 6 00:05:13.862: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (25.509232483s) I1106 00:05:18.947] Nov 6 00:05:18.946: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (30.593739979s) I1106 00:05:24.060] Nov 6 00:05:24.060: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (35.707552998s) I1106 00:05:29.145] Nov 6 00:05:29.145: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (40.792070899s) I1106 00:05:34.230] Nov 6 00:05:34.230: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (45.877108208s) I1106 00:05:39.319] Nov 6 00:05:39.318: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (50.965684546s) I1106 00:05:44.403] Nov 6 00:05:44.403: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (56.050411758s) I1106 00:05:49.488] Nov 6 00:05:49.488: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (1m1.135103873s) I1106 00:05:54.573] Nov 6 00:05:54.573: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (1m6.220049892s) I1106 00:05:59.658] Nov 6 00:05:59.658: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (1m11.305036315s) I1106 00:06:04.743] Nov 6 00:06:04.742: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (1m16.389643837s) I1106 00:06:09.831] Nov 6 00:06:09.831: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (1m21.478046491s) I1106 00:06:14.916] Nov 6 00:06:14.916: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (1m26.562857021s) I1106 00:06:20.000] Nov 6 00:06:20.000: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (1m31.647141149s) I1106 00:06:25.085] Nov 6 00:06:25.084: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (1m36.731678082s) I1106 00:06:30.169] Nov 6 00:06:30.169: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (1m41.816295018s) I1106 00:06:35.256] Nov 6 00:06:35.256: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (1m46.903102173s) I1106 00:06:40.348] Nov 6 00:06:40.341: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (1m51.988167518s) I1106 00:06:45.426] Nov 6 00:06:45.426: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (1m57.073181265s) I1106 00:06:50.510] Nov 6 00:06:50.510: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (2m2.157463509s) I1106 00:06:55.595] Nov 6 00:06:55.594: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (2m7.241762456s) I1106 00:07:00.679] Nov 6 00:07:00.679: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (2m12.326023205s) I1106 00:07:05.763] Nov 6 00:07:05.763: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (2m17.410538658s) I1106 00:07:10.848] Nov 6 00:07:10.847: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (2m22.494682412s) I1106 00:07:15.932] Nov 6 00:07:15.932: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (2m27.579290871s) I1106 00:07:21.017] Nov 6 00:07:21.017: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (2m32.663878132s) I1106 00:07:26.102] Nov 6 00:07:26.101: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (2m37.748676297s) I1106 00:07:31.186] Nov 6 00:07:31.186: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (2m42.833031361s) I1106 00:07:36.271] Nov 6 00:07:36.271: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (2m47.917877832s) I1106 00:07:41.355] Nov 6 00:07:41.355: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (2m53.0020892s) I1106 00:07:46.439] Nov 6 00:07:46.439: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (2m58.086027168s) I1106 00:07:51.524] Nov 6 00:07:51.523: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (3m3.170679243s) I1106 00:07:56.608] Nov 6 00:07:56.608: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (3m8.254887018s) I1106 00:08:01.692] Nov 6 00:08:01.692: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (3m13.339170696s) I1106 00:08:06.777] Nov 6 00:08:06.776: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (3m18.423774378s) I1106 00:08:11.862] Nov 6 00:08:11.861: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (3m23.508823965s) I1106 00:08:16.945] Nov 6 00:08:16.945: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (3m28.592226843s) I1106 00:08:22.030] Nov 6 00:08:22.030: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (3m33.677444636s) I1106 00:08:27.115] Nov 6 00:08:27.115: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (3m38.76245103s) I1106 00:08:32.200] Nov 6 00:08:32.200: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (3m43.847104023s) I1106 00:08:37.285] Nov 6 00:08:37.285: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (3m48.93200092s) I1106 00:08:42.369] Nov 6 00:08:42.369: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (3m54.016325115s) I1106 00:08:47.454] Nov 6 00:08:47.454: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (3m59.101204516s) I1106 00:08:52.538] Nov 6 00:08:52.538: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (4m4.185344614s) I1106 00:08:57.623] Nov 6 00:08:57.622: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (4m9.269842116s) I1106 00:09:02.707] Nov 6 00:09:02.706: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (4m14.353795716s) I1106 00:09:07.791] Nov 6 00:09:07.791: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (4m19.438410423s) I1106 00:09:12.875] Nov 6 00:09:12.875: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (4m24.522259926s) I1106 00:09:17.959] Nov 6 00:09:17.959: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (4m29.606470234s) I1106 00:09:23.044] Nov 6 00:09:23.044: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (4m34.69149825s) I1106 00:09:28.129] Nov 6 00:09:28.129: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (4m39.776295666s) I1106 00:09:33.213] Nov 6 00:09:33.213: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (4m44.860384879s) I1106 00:09:38.297] Nov 6 00:09:38.297: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (4m49.944285792s) I1106 00:09:43.382] Nov 6 00:09:43.382: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (4m55.029021413s) I1106 00:09:48.469] Nov 6 00:09:48.469: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (5m0.115998653s) I1106 00:09:53.553] Nov 6 00:09:53.553: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (5m5.200469376s) I1106 00:09:58.638] Nov 6 00:09:58.638: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (5m10.2848788s) I1106 00:10:03.723] Nov 6 00:10:03.722: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (5m15.36983053s) I1106 00:10:08.807] Nov 6 00:10:08.806: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (5m20.453760254s) I1106 00:10:13.891] Nov 6 00:10:13.891: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (5m25.538059383s) I1106 00:10:18.975] Nov 6 00:10:18.975: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (5m30.622106411s) I1106 00:10:24.060] Nov 6 00:10:24.060: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (5m35.707031248s) I1106 00:10:29.144] Nov 6 00:10:29.144: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (5m40.791459382s) I1106 00:10:34.229] Nov 6 00:10:34.229: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (5m45.876284021s) I1106 00:10:39.314] Nov 6 00:10:39.313: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (5m50.960676359s) I1106 00:10:44.398] Nov 6 00:10:44.398: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (5m56.044997798s) I1106 00:10:49.482] Nov 6 00:10:49.482: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (6m1.129352938s) I1106 00:10:54.566] Nov 6 00:10:54.566: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (6m6.213417578s) I1106 00:10:59.650] Nov 6 00:10:59.650: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (6m11.297185017s) I1106 00:11:04.735] Nov 6 00:11:04.735: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (6m16.382310968s) I1106 00:11:09.820] Nov 6 00:11:09.819: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (6m21.466696616s) I1106 00:11:14.904] Nov 6 00:11:14.904: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (6m26.551209565s) I1106 00:11:19.988] Nov 6 00:11:19.988: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (6m31.635293013s) I1106 00:11:25.073] Nov 6 00:11:25.072: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (6m36.719796365s) I1106 00:11:30.157] Nov 6 00:11:30.157: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (6m41.804094218s) I1106 00:11:35.242] Nov 6 00:11:35.242: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (6m46.88954738s) I1106 00:11:40.327] Nov 6 00:11:40.327: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (6m51.974299639s) I1106 00:11:45.412] Nov 6 00:11:45.412: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (6m57.059044399s) I1106 00:11:50.497] Nov 6 00:11:50.496: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (7m2.143794261s) I1106 00:11:55.582] Nov 6 00:11:55.582: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (7m7.229240829s) I1106 00:12:00.667] Nov 6 00:12:00.667: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (7m12.314093894s) I1106 00:12:05.752] Nov 6 00:12:05.752: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (7m17.398877261s) I1106 00:12:10.836] Nov 6 00:12:10.836: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (7m22.483653228s) I1106 00:12:15.921] Nov 6 00:12:15.921: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (7m27.567933093s) I1106 00:12:21.006] Nov 6 00:12:21.005: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (7m32.652831064s) I1106 00:12:26.091] Nov 6 00:12:26.090: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (7m37.737797037s) I1106 00:12:31.175] Nov 6 00:12:31.175: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (7m42.822396708s) I1106 00:12:36.261] Nov 6 00:12:36.260: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (7m47.907704786s) I1106 00:12:41.345] Nov 6 00:12:41.345: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (7m52.99221216s) I1106 00:12:46.430] Nov 6 00:12:46.430: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (7m58.077591841s) I1106 00:12:51.516] Nov 6 00:12:51.515: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (8m3.162837422s) I1106 00:12:56.603] Nov 6 00:12:56.602: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (8m8.249630117s) I1106 00:13:01.690] Nov 6 00:13:01.689: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (8m13.336742615s) I1106 00:13:06.774] Nov 6 00:13:06.774: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (8m18.421319095s) I1106 00:13:11.858] Nov 6 00:13:11.858: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (8m23.505578874s) I1106 00:13:16.943] Nov 6 00:13:16.943: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (8m28.590278657s) I1106 00:13:22.029] Nov 6 00:13:22.028: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 found and phase=Released (8m33.675697047s) I1106 00:13:27.114] Nov 6 00:13:27.114: INFO: PersistentVolume pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312 was removed I1106 00:13:27.114] Nov 6 00:13:27.114: INFO: Waiting up to 5m0s for PersistentVolumeClaim azuredisk-7509 to be removed I1106 00:13:27.198] Nov 6 00:13:27.198: INFO: Claim "azuredisk-7509" in namespace "pvc-tv6gp" doesn't exist in the system I1106 00:13:27.198] Nov 6 00:13:27.198: INFO: deleting StorageClass azuredisk-7509-disk.csi.azure.com-dynamic-sc-zgmpn I1106 00:13:27.290] [AfterEach] [multi-az] I1106 00:13:27.290] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1106 00:13:27.290] Nov 6 00:13:27.290: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1106 00:13:27.455] STEP: Destroying namespace "azuredisk-7509" for this suite. I1106 00:13:33.718] Nov 6 00:13:33.718: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1106 00:13:36.908] Nov 6 00:13:36.908: INFO: namespace azuredisk-7509 deletion completed in 9.453243154s I1106 00:13:36.908] I1106 00:13:36.909] • [SLOW TEST:577.997 seconds] I1106 00:13:36.909] [azuredisk-csi-e2e] Dynamic Provisioning I1106 00:13:36.909] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:33 I1106 00:13:36.909] [multi-az] I1106 00:13:36.909] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:40 I1106 00:13:36.909] should create a raw block volume on demand I1106 00:13:36.910] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:101 I1106 00:13:36.910] ------------------------------ I1106 00:13:36.910] [azuredisk-csi-e2e] Dynamic Provisioning [multi-az] I1106 00:13:36.910] should delete PV with reclaimPolicy "Delete" I1106 00:13:36.910] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:221 I1106 00:13:36.910] [BeforeEach] [multi-az] I1106 00:13:36.910] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1106 00:13:36.910] STEP: Creating a kubernetes client I1106 00:13:36.911] Nov 6 00:13:36.908: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1106 00:13:36.911] STEP: Building a namespace api object, basename azuredisk I1106 00:13:37.167] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-5196 I1106 00:13:37.443] STEP: Waiting for a default service account to be provisioned in namespace I1106 00:13:37.525] [BeforeEach] [multi-az] I1106 00:13:37.525] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:58 I1106 00:13:37.526] [It] should delete PV with reclaimPolicy "Delete" I1106 00:13:37.526] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:221 I1106 00:13:37.526] STEP: setting up the StorageClass I1106 00:13:37.526] STEP: creating a StorageClass I1106 00:13:37.614] STEP: setting up the PVC and PV I1106 00:13:37.614] STEP: creating a PVC I1106 00:13:37.704] STEP: waiting for PVC to be in phase "Bound" I1106 00:13:37.704] Nov 6 00:13:37.704: INFO: Waiting up to 5m0s for PersistentVolumeClaims [pvc-cwqdw] to have phase Bound I1106 00:13:37.788] Nov 6 00:13:37.788: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:13:39.873] Nov 6 00:13:39.873: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:13:41.959] Nov 6 00:13:41.958: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:13:44.055] Nov 6 00:13:44.055: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:13:46.140] Nov 6 00:13:46.140: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:13:48.246] Nov 6 00:13:48.246: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:13:50.330] Nov 6 00:13:50.330: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:13:52.415] Nov 6 00:13:52.415: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:13:54.500] Nov 6 00:13:54.500: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:13:56.586] Nov 6 00:13:56.585: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:13:58.670] Nov 6 00:13:58.670: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:00.755] Nov 6 00:14:00.755: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:02.840] Nov 6 00:14:02.840: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:04.926] Nov 6 00:14:04.926: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:07.011] Nov 6 00:14:07.011: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:09.097] Nov 6 00:14:09.096: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:11.181] Nov 6 00:14:11.181: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:13.266] Nov 6 00:14:13.266: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:15.352] Nov 6 00:14:15.352: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:17.437] Nov 6 00:14:17.437: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:19.522] Nov 6 00:14:19.522: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:21.607] Nov 6 00:14:21.607: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:23.691] Nov 6 00:14:23.691: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:25.775] Nov 6 00:14:25.775: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:27.860] Nov 6 00:14:27.860: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:29.945] Nov 6 00:14:29.945: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:32.060] Nov 6 00:14:32.060: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:34.145] Nov 6 00:14:34.145: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:36.244] Nov 6 00:14:36.244: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:38.330] Nov 6 00:14:38.330: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:40.414] Nov 6 00:14:40.414: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:42.499] Nov 6 00:14:42.499: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:44.584] Nov 6 00:14:44.584: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:46.669] Nov 6 00:14:46.669: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:48.754] Nov 6 00:14:48.754: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:50.861] Nov 6 00:14:50.861: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:52.945] Nov 6 00:14:52.945: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:55.030] Nov 6 00:14:55.030: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:57.116] Nov 6 00:14:57.116: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:14:59.200] Nov 6 00:14:59.200: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:01.284] Nov 6 00:15:01.284: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:03.370] Nov 6 00:15:03.369: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:05.455] Nov 6 00:15:05.454: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:07.540] Nov 6 00:15:07.540: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:09.624] Nov 6 00:15:09.624: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:11.709] Nov 6 00:15:11.708: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:13.794] Nov 6 00:15:13.794: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:15.878] Nov 6 00:15:15.878: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:17.962] Nov 6 00:15:17.961: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:20.053] Nov 6 00:15:20.053: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:22.138] Nov 6 00:15:22.137: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:24.236] Nov 6 00:15:24.235: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:26.319] Nov 6 00:15:26.319: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:28.404] Nov 6 00:15:28.403: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:30.489] Nov 6 00:15:30.488: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:32.573] Nov 6 00:15:32.573: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:34.657] Nov 6 00:15:34.656: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:36.741] Nov 6 00:15:36.741: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:38.825] Nov 6 00:15:38.825: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:40.911] Nov 6 00:15:40.910: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:42.994] Nov 6 00:15:42.994: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:45.079] Nov 6 00:15:45.078: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:47.163] Nov 6 00:15:47.163: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:49.259] Nov 6 00:15:49.259: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:51.344] Nov 6 00:15:51.344: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:53.430] Nov 6 00:15:53.429: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:55.514] Nov 6 00:15:55.514: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:57.599] Nov 6 00:15:57.599: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:15:59.683] Nov 6 00:15:59.683: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:01.769] Nov 6 00:16:01.769: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:03.853] Nov 6 00:16:03.853: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:05.938] Nov 6 00:16:05.937: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:08.066] Nov 6 00:16:08.066: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:10.150] Nov 6 00:16:10.150: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:12.239] Nov 6 00:16:12.239: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:14.324] Nov 6 00:16:14.323: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:16.407] Nov 6 00:16:16.407: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:18.492] Nov 6 00:16:18.491: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:20.576] Nov 6 00:16:20.576: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:22.661] Nov 6 00:16:22.661: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:24.746] Nov 6 00:16:24.745: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:26.830] Nov 6 00:16:26.830: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:28.915] Nov 6 00:16:28.914: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:30.998] Nov 6 00:16:30.998: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:33.082] Nov 6 00:16:33.082: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:35.167] Nov 6 00:16:35.167: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:37.251] Nov 6 00:16:37.251: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:39.336] Nov 6 00:16:39.336: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:41.420] Nov 6 00:16:41.420: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:43.504] Nov 6 00:16:43.504: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:45.588] Nov 6 00:16:45.588: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:47.673] Nov 6 00:16:47.673: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:49.758] Nov 6 00:16:49.757: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:51.843] Nov 6 00:16:51.842: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:53.927] Nov 6 00:16:53.926: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:56.028] Nov 6 00:16:56.028: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:16:58.112] Nov 6 00:16:58.112: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:00.196] Nov 6 00:17:00.196: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:02.280] Nov 6 00:17:02.280: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:04.364] Nov 6 00:17:04.364: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:06.453] Nov 6 00:17:06.453: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:08.538] Nov 6 00:17:08.537: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:10.621] Nov 6 00:17:10.621: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:12.707] Nov 6 00:17:12.706: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:14.790] Nov 6 00:17:14.790: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:16.874] Nov 6 00:17:16.874: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:18.959] Nov 6 00:17:18.959: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:21.045] Nov 6 00:17:21.044: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:23.130] Nov 6 00:17:23.129: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:25.214] Nov 6 00:17:25.214: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:27.298] Nov 6 00:17:27.298: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:29.382] Nov 6 00:17:29.382: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:31.467] Nov 6 00:17:31.466: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:33.550] Nov 6 00:17:33.550: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:35.634] Nov 6 00:17:35.634: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:37.723] Nov 6 00:17:37.722: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:39.807] Nov 6 00:17:39.807: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:41.890] Nov 6 00:17:41.890: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:43.976] Nov 6 00:17:43.975: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:46.060] Nov 6 00:17:46.059: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:48.145] Nov 6 00:17:48.144: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:50.229] Nov 6 00:17:50.229: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:52.314] Nov 6 00:17:52.314: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:54.398] Nov 6 00:17:54.398: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:56.483] Nov 6 00:17:56.482: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:17:58.567] Nov 6 00:17:58.567: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:00.652] Nov 6 00:18:00.652: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:02.737] Nov 6 00:18:02.736: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:04.822] Nov 6 00:18:04.821: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:06.906] Nov 6 00:18:06.906: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:08.990] Nov 6 00:18:08.989: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:11.074] Nov 6 00:18:11.073: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:13.158] Nov 6 00:18:13.158: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:15.242] Nov 6 00:18:15.242: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:17.328] Nov 6 00:18:17.327: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:19.412] Nov 6 00:18:19.412: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:21.497] Nov 6 00:18:21.497: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:23.582] Nov 6 00:18:23.581: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:25.666] Nov 6 00:18:25.666: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:27.752] Nov 6 00:18:27.751: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:29.836] Nov 6 00:18:29.835: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:31.920] Nov 6 00:18:31.919: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:34.004] Nov 6 00:18:34.003: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:36.087] Nov 6 00:18:36.087: INFO: PersistentVolumeClaim pvc-cwqdw found but phase is Pending instead of Bound. I1106 00:18:38.088] Nov 6 00:18:38.087: INFO: Unexpected error occurred: PersistentVolumeClaims [pvc-cwqdw] not all in phase Bound within 5m0s I1106 00:18:38.088] [AfterEach] [multi-az] I1106 00:18:38.090] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1106 00:18:38.090] STEP: Collecting events from namespace "azuredisk-5196". I1106 00:18:38.172] STEP: Found 3 events. I1106 00:18:38.173] Nov 6 00:18:38.172: INFO: At 2019-11-06 00:13:37 +0000 UTC - event for pvc-cwqdw: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator I1106 00:18:38.173] Nov 6 00:18:38.172: INFO: At 2019-11-06 00:13:37 +0000 UTC - event for pvc-cwqdw: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } Provisioning: External provisioner is provisioning volume for claim "azuredisk-5196/pvc-cwqdw" I1106 00:18:38.173] Nov 6 00:18:38.172: INFO: At 2019-11-06 00:13:47 +0000 UTC - event for pvc-cwqdw: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-5196-disk.csi.azure.com-dynamic-sc-ksmsx": rpc error: code = DeadlineExceeded desc = context deadline exceeded I1106 00:18:38.256] Nov 6 00:18:38.256: INFO: POD NODE PHASE GRACE CONDITIONS I1106 00:18:38.256] Nov 6 00:18:38.256: INFO: I1106 00:18:38.505] Nov 6 00:18:38.505: INFO: I1106 00:18:38.506] Logging node info for node k8s-agentpool-73731178-vmss000000 I1106 00:18:38.593] Nov 6 00:18:38.589: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000000,UID:e9bc0b16-6756-4155-b49c-e223c0ba9499,ResourceVersion:10212,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-1,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000000"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:18 +0000 UTC 2019-11-05 23:28:18 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:18:09 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:18:09 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:18:09 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:18:09 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.4} {Hostname k8s-agentpool-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:956ad861ae4a42099801f8e840b4e502,SystemUUID:439CF4B9-2B9F-B74E-9ED7-7379FD8BD0DF,BootID:bd3476e5-4fd4-4437-9b56-54fbe38a3a49,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1] 121711221} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/metrics-server-amd64@sha256:49a9f12f7067d11f42c803dbe61ed2c1299959ad85cb315b25ff7eef8e6b8892 k8s.gcr.io/metrics-server-amd64:v0.2.1] 42541759} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/disks/pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312],VolumesAttached:[],Config:nil,},} I1106 00:18:38.593] Nov 6 00:18:38.590: INFO: I1106 00:18:38.593] Logging kubelet events for node k8s-agentpool-73731178-vmss000000 I1106 00:18:38.678] Nov 6 00:18:38.678: INFO: I1106 00:18:38.678] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000000 I1106 00:18:38.768] Nov 6 00:18:38.768: INFO: metrics-server-864ffbc5c-kb9cz started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:38.769] Nov 6 00:18:38.768: INFO: Container metrics-server ready: true, restart count 0 I1106 00:18:38.769] Nov 6 00:18:38.768: INFO: kube-proxy-jnqp8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:38.769] Nov 6 00:18:38.768: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:18:38.769] Nov 6 00:18:38.768: INFO: kubernetes-dashboard-66dd8b8df7-4rnsp started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:18:38.769] Nov 6 00:18:38.768: INFO: Container kubernetes-dashboard ready: true, restart count 1 I1106 00:18:38.769] Nov 6 00:18:38.768: INFO: csi-azuredisk-node-g6wbm started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 00:18:38.769] Nov 6 00:18:38.768: INFO: Container azuredisk ready: true, restart count 0 I1106 00:18:38.770] Nov 6 00:18:38.768: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:18:38.770] Nov 6 00:18:38.768: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 00:18:38.770] Nov 6 00:18:38.768: INFO: blobfuse-flexvol-installer-cvgkv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:38.770] Nov 6 00:18:38.768: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 00:18:38.770] Nov 6 00:18:38.768: INFO: azure-ip-masq-agent-vn5zc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:38.770] Nov 6 00:18:38.768: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:18:38.770] Nov 6 00:18:38.768: INFO: keyvault-flexvolume-xr7v6 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:38.770] Nov 6 00:18:38.768: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 00:18:39.043] Nov 6 00:18:39.043: INFO: I1106 00:18:39.043] Latency metrics for node k8s-agentpool-73731178-vmss000000 I1106 00:18:39.043] Nov 6 00:18:39.043: INFO: I1106 00:18:39.043] Logging node info for node k8s-agentpool-73731178-vmss000001 I1106 00:18:39.130] Nov 6 00:18:39.126: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000001,UID:ab75ba9d-ec23-4ff7-ae5a-d1a19974c05d,ResourceVersion:10210,Generation:0,CreationTimestamp:2019-11-05 23:27:31 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-2,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000001"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.5.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:17 +0000 UTC 2019-11-05 23:28:17 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:18:09 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:18:09 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:18:09 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:18:09 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.5} {Hostname k8s-agentpool-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f0eae5e73d0f4ccb82dd0f22701c288f,SystemUUID:7E54C533-AED3-744D-8D17-EFF5E62EA06D,BootID:6d58e5a6-45fb-4a41-a491-bc2f3799f411,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[gcr.io/kubernetes-helm/tiller@sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1 gcr.io/kubernetes-helm/tiller:v2.11.0] 71821984} {[quay.io/k8scsi/csi-provisioner@sha256:d657c839dce87324fe2b677302913f9386f885f8746be7bea0ced5b0844e3433 quay.io/k8scsi/csi-provisioner:v1.3.1] 50596998} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0] 46226754} {[quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1] 45874691} {[quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb quay.io/k8scsi/csi-snapshotter:v1.1.0] 44325352} {[k8s.gcr.io/coredns@sha256:e83beb5e43f8513fa735e77ffc5859640baea30a882a11cc75c4c3244a737d3c k8s.gcr.io/coredns:1.5.0] 42488424} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0] 14967303} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:18:39.130] Nov 6 00:18:39.126: INFO: I1106 00:18:39.130] Logging kubelet events for node k8s-agentpool-73731178-vmss000001 I1106 00:18:39.224] Nov 6 00:18:39.224: INFO: I1106 00:18:39.224] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000001 I1106 00:18:39.319] Nov 6 00:18:39.319: INFO: csi-azuredisk-node-ml68k started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 00:18:39.319] Nov 6 00:18:39.319: INFO: Container azuredisk ready: true, restart count 0 I1106 00:18:39.319] Nov 6 00:18:39.319: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:18:39.320] Nov 6 00:18:39.319: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 00:18:39.320] Nov 6 00:18:39.319: INFO: coredns-7f68dcdbdb-f98nq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:39.320] Nov 6 00:18:39.319: INFO: Container coredns ready: true, restart count 0 I1106 00:18:39.320] Nov 6 00:18:39.319: INFO: azure-ip-masq-agent-6qqgc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:39.320] Nov 6 00:18:39.319: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:18:39.321] Nov 6 00:18:39.319: INFO: keyvault-flexvolume-7tztj started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:39.321] Nov 6 00:18:39.319: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 00:18:39.321] Nov 6 00:18:39.319: INFO: kube-proxy-z4hf8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:39.321] Nov 6 00:18:39.319: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:18:39.321] Nov 6 00:18:39.319: INFO: tiller-deploy-54c96cb5df-wlzbj started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:18:39.321] Nov 6 00:18:39.319: INFO: Container tiller ready: true, restart count 0 I1106 00:18:39.322] Nov 6 00:18:39.319: INFO: csi-azuredisk-controller-59bf945f54-k2p5m started at 2019-11-05 23:30:58 +0000 UTC (0+6 container statuses recorded) I1106 00:18:39.322] Nov 6 00:18:39.319: INFO: Container azuredisk ready: true, restart count 0 I1106 00:18:39.322] Nov 6 00:18:39.319: INFO: Container cluster-driver-registrar ready: true, restart count 0 I1106 00:18:39.322] Nov 6 00:18:39.319: INFO: Container csi-attacher ready: true, restart count 0 I1106 00:18:39.322] Nov 6 00:18:39.319: INFO: Container csi-provisioner ready: true, restart count 0 I1106 00:18:39.322] Nov 6 00:18:39.319: INFO: Container csi-snapshotter ready: true, restart count 0 I1106 00:18:39.322] Nov 6 00:18:39.319: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:18:39.323] Nov 6 00:18:39.319: INFO: blobfuse-flexvol-installer-589vv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:39.323] Nov 6 00:18:39.319: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 00:18:39.589] Nov 6 00:18:39.589: INFO: I1106 00:18:39.589] Latency metrics for node k8s-agentpool-73731178-vmss000001 I1106 00:18:39.589] Nov 6 00:18:39.589: INFO: I1106 00:18:39.589] Logging node info for node k8s-master-73731178-vmss000000 I1106 00:18:39.677] Nov 6 00:18:39.675: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000000,UID:1f765350-accc-4e67-898b-e4d84be84901,ResourceVersion:10265,Generation:0,CreationTimestamp:2019-11-05 23:27:30 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:18:27 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:18:27 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:18:27 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:18:27 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.4} {Hostname k8s-master-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:836af7329e85492184d73f1ea7f63a4e,SystemUUID:D1C68207-4499-C24D-B9D6-ADA0554A1BE5,BootID:a29dde5d-b4dc-483e-a50e-76e79359d759,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:18:39.677] Nov 6 00:18:39.675: INFO: I1106 00:18:39.677] Logging kubelet events for node k8s-master-73731178-vmss000000 I1106 00:18:39.763] Nov 6 00:18:39.762: INFO: I1106 00:18:39.763] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000000 I1106 00:18:39.851] Nov 6 00:18:39.851: INFO: kube-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:18:39.851] Nov 6 00:18:39.851: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:18:39.852] Nov 6 00:18:39.851: INFO: kube-scheduler-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:18:39.852] Nov 6 00:18:39.851: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:18:39.852] Nov 6 00:18:39.851: INFO: cloud-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:18:39.852] Nov 6 00:18:39.851: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:18:39.852] Nov 6 00:18:39.851: INFO: kube-addon-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:18:39.852] Nov 6 00:18:39.851: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:18:39.852] Nov 6 00:18:39.851: INFO: kube-apiserver-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:18:39.853] Nov 6 00:18:39.851: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:18:39.853] Nov 6 00:18:39.851: INFO: azure-ip-masq-agent-xmkx2 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:39.853] Nov 6 00:18:39.851: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:18:39.853] Nov 6 00:18:39.851: INFO: kube-proxy-2fwv9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:39.853] Nov 6 00:18:39.851: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:18:40.145] Nov 6 00:18:40.145: INFO: I1106 00:18:40.146] Latency metrics for node k8s-master-73731178-vmss000000 I1106 00:18:40.146] Nov 6 00:18:40.145: INFO: I1106 00:18:40.146] Logging node info for node k8s-master-73731178-vmss000001 I1106 00:18:40.244] Nov 6 00:18:40.241: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000001,UID:442cf114-6b0a-4c80-a9e5-be62e184f94c,ResourceVersion:10214,Generation:0,CreationTimestamp:2019-11-05 23:27:42 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:19 +0000 UTC 2019-11-05 23:28:19 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:18:09 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:18:09 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:18:09 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:18:09 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.5} {Hostname k8s-master-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1a9da6632c314858a31bccaea0be0f50,SystemUUID:8F48A76E-30E1-B948-89B2-33C0048059B4,BootID:1597124c-68a3-452c-ae03-6cfe9bc1e57f,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:18:40.245] Nov 6 00:18:40.242: INFO: I1106 00:18:40.245] Logging kubelet events for node k8s-master-73731178-vmss000001 I1106 00:18:40.329] Nov 6 00:18:40.329: INFO: I1106 00:18:40.330] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000001 I1106 00:18:40.418] Nov 6 00:18:40.418: INFO: kube-scheduler-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:18:40.419] Nov 6 00:18:40.418: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:18:40.419] Nov 6 00:18:40.418: INFO: cloud-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:18:40.419] Nov 6 00:18:40.418: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:18:40.419] Nov 6 00:18:40.418: INFO: kube-addon-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:18:40.419] Nov 6 00:18:40.418: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:18:40.419] Nov 6 00:18:40.418: INFO: kube-apiserver-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:18:40.420] Nov 6 00:18:40.418: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:18:40.420] Nov 6 00:18:40.418: INFO: kube-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:18:40.420] Nov 6 00:18:40.418: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:18:40.420] Nov 6 00:18:40.418: INFO: azure-ip-masq-agent-825g9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:40.420] Nov 6 00:18:40.418: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:18:40.420] Nov 6 00:18:40.418: INFO: kube-proxy-8924t started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:40.420] Nov 6 00:18:40.418: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:18:40.695] Nov 6 00:18:40.695: INFO: I1106 00:18:40.696] Latency metrics for node k8s-master-73731178-vmss000001 I1106 00:18:40.696] Nov 6 00:18:40.695: INFO: I1106 00:18:40.696] Logging node info for node k8s-master-73731178-vmss000002 I1106 00:18:40.782] Nov 6 00:18:40.779: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000002,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000002,UID:6cf1398e-1b6b-4537-837d-9ffceb9a4f00,ResourceVersion:10272,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000002,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.6.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/2,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:27:55 +0000 UTC 2019-11-05 23:27:55 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:18:29 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:18:29 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:18:29 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:18:29 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.6} {Hostname k8s-master-73731178-vmss000002}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7964689c8ba4f448e6f435b3d4fefac,SystemUUID:9369535A-87BF-1E4B-86DF-5D1A23713C9F,BootID:74f93904-298f-454d-8df6-8d4bba193331,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:18:40.782] Nov 6 00:18:40.780: INFO: I1106 00:18:40.782] Logging kubelet events for node k8s-master-73731178-vmss000002 I1106 00:18:40.868] Nov 6 00:18:40.867: INFO: I1106 00:18:40.868] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000002 I1106 00:18:40.959] Nov 6 00:18:40.958: INFO: azure-ip-masq-agent-74xks started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:40.959] Nov 6 00:18:40.959: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:18:40.959] Nov 6 00:18:40.959: INFO: kube-proxy-t958f started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:40.960] Nov 6 00:18:40.959: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:18:40.960] Nov 6 00:18:40.959: INFO: kube-addon-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:18 +0000 UTC (0+1 container statuses recorded) I1106 00:18:40.960] Nov 6 00:18:40.959: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:18:40.960] Nov 6 00:18:40.959: INFO: kube-apiserver-k8s-master-73731178-vmss000002 started at 2019-11-05 23:28:42 +0000 UTC (0+1 container statuses recorded) I1106 00:18:40.960] Nov 6 00:18:40.959: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:18:40.961] Nov 6 00:18:40.959: INFO: kube-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:18:40.961] Nov 6 00:18:40.959: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:18:40.961] Nov 6 00:18:40.959: INFO: kube-scheduler-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:18:40.961] Nov 6 00:18:40.959: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:18:40.962] Nov 6 00:18:40.959: INFO: cloud-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:18:40.962] Nov 6 00:18:40.959: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:18:41.240] Nov 6 00:18:41.240: INFO: I1106 00:18:41.240] Latency metrics for node k8s-master-73731178-vmss000002 I1106 00:18:41.240] Nov 6 00:18:41.240: INFO: I1106 00:18:41.240] Logging node info for node k8s-master-73731178-vmss000003 I1106 00:18:41.326] Nov 6 00:18:41.323: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000003,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000003,UID:54efc1b0-183c-4153-b804-31d0d42ce204,ResourceVersion:10266,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000003,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/3,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:18:27 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:18:27 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:18:27 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:18:27 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{Hostname k8s-master-73731178-vmss000003} {InternalIP 10.240.0.7}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a448072d2d27400fa2252a0cb3c8ff37,SystemUUID:98F6A517-FFCA-8E4D-A914-52A5F1482433,BootID:50c0f9e6-7c4d-45ec-8984-248ea540d637,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:18:41.326] Nov 6 00:18:41.323: INFO: I1106 00:18:41.326] Logging kubelet events for node k8s-master-73731178-vmss000003 I1106 00:18:41.413] Nov 6 00:18:41.413: INFO: I1106 00:18:41.413] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000003 I1106 00:18:41.505] Nov 6 00:18:41.504: INFO: kube-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:18:41.505] Nov 6 00:18:41.504: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:18:41.505] Nov 6 00:18:41.504: INFO: kube-scheduler-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:18:41.505] Nov 6 00:18:41.504: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:18:41.506] Nov 6 00:18:41.504: INFO: azure-ip-masq-agent-4nshf started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:41.506] Nov 6 00:18:41.504: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:18:41.506] Nov 6 00:18:41.504: INFO: kube-proxy-qm7rq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:18:41.506] Nov 6 00:18:41.504: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:18:41.506] Nov 6 00:18:41.504: INFO: cloud-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:18:41.507] Nov 6 00:18:41.504: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:18:41.507] Nov 6 00:18:41.504: INFO: kube-addon-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:43 +0000 UTC (0+1 container statuses recorded) I1106 00:18:41.507] Nov 6 00:18:41.504: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:18:41.507] Nov 6 00:18:41.504: INFO: kube-apiserver-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:18:41.507] Nov 6 00:18:41.504: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:18:41.781] Nov 6 00:18:41.780: INFO: I1106 00:18:41.781] Latency metrics for node k8s-master-73731178-vmss000003 I1106 00:18:41.781] Nov 6 00:18:41.781: INFO: I1106 00:18:41.781] Logging node info for node k8s-master-73731178-vmss000004 I1106 00:18:41.867] Nov 6 00:18:41.864: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000004,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000004,UID:4a582f8b-6cf2-4e91-8770-fde6f9c22194,ResourceVersion:10261,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000004,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/4,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:32 +0000 UTC 2019-11-05 23:28:32 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:18:26 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:18:26 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:18:26 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:18:26 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.8} {Hostname k8s-master-73731178-vmss000004}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:252c632059f2483d87e2d8d689053e48,SystemUUID:5BBFFB00-FBAB-0F4A-8F63-6B99DE219F64,BootID:165ca62a-8171-48e8-92f7-3ad786cb6b9a,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:18:41.867] Nov 6 00:18:41.865: INFO: I1106 00:18:41.867] Logging kubelet events for node k8s-master-73731178-vmss000004 I1106 00:18:41.954] Nov 6 00:18:41.954: INFO: I1106 00:18:41.954] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000004 I1106 00:18:42.041] Nov 6 00:18:42.041: INFO: kube-apiserver-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:18:42.041] Nov 6 00:18:42.041: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:18:42.041] Nov 6 00:18:42.041: INFO: kube-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:18:42.041] Nov 6 00:18:42.041: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:18:42.042] Nov 6 00:18:42.041: INFO: kube-scheduler-k8s-master-73731178-vmss000004 started at 2019-11-05 23:28:31 +0000 UTC (0+1 container statuses recorded) I1106 00:18:42.042] Nov 6 00:18:42.041: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:18:42.042] Nov 6 00:18:42.041: INFO: azure-ip-masq-agent-rh9pr started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:18:42.042] Nov 6 00:18:42.041: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:18:42.042] Nov 6 00:18:42.041: INFO: kube-proxy-rk5r6 started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:18:42.042] Nov 6 00:18:42.041: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:18:42.042] Nov 6 00:18:42.041: INFO: cloud-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:18:42.043] Nov 6 00:18:42.041: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:18:42.043] Nov 6 00:18:42.041: INFO: kube-addon-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:18:42.043] Nov 6 00:18:42.041: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:18:42.329] Nov 6 00:18:42.329: INFO: I1106 00:18:42.329] Latency metrics for node k8s-master-73731178-vmss000004 I1106 00:18:42.330] Nov 6 00:18:42.329: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1106 00:18:42.414] STEP: Destroying namespace "azuredisk-5196" for this suite. I1106 00:18:56.672] Nov 6 00:18:56.671: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1106 00:18:59.847] Nov 6 00:18:59.847: INFO: namespace azuredisk-5196 deletion completed in 17.433330544s I1106 00:18:59.848] I1106 00:18:59.848] • Failure [322.939 seconds] I1106 00:18:59.848] [azuredisk-csi-e2e] Dynamic Provisioning I1106 00:18:59.848] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:33 I1106 00:18:59.848] [multi-az] I1106 00:18:59.849] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:40 I1106 00:18:59.849] should delete PV with reclaimPolicy "Delete" [It] I1106 00:18:59.849] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:221 I1106 00:18:59.849] I1106 00:18:59.849] Unexpected error: I1106 00:18:59.850] <*errors.errorString | 0xc000830880>: { I1106 00:18:59.850] s: "PersistentVolumeClaims [pvc-cwqdw] not all in phase Bound within 5m0s", I1106 00:18:59.850] } I1106 00:18:59.850] PersistentVolumeClaims [pvc-cwqdw] not all in phase Bound within 5m0s I1106 00:18:59.850] occurred I1106 00:18:59.850] I1106 00:18:59.851] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1106 00:18:59.851] ------------------------------ I1106 00:18:59.851] [azuredisk-csi-e2e] [single-az] Pre-Provisioned I1106 00:18:59.851] [env] should use a pre-provisioned volume and mount it as readOnly in a pod I1106 00:18:59.851] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning.go:66 I1106 00:18:59.851] [BeforeEach] [azuredisk-csi-e2e] [single-az] Pre-Provisioned I1106 00:18:59.851] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1106 00:18:59.851] STEP: Creating a kubernetes client I1106 00:18:59.851] Nov 6 00:18:59.847: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1106 00:18:59.852] STEP: Building a namespace api object, basename azuredisk I1106 00:19:00.118] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-7323 I1106 00:19:00.395] STEP: Waiting for a default service account to be provisioned in namespace I1106 00:19:00.476] [BeforeEach] [azuredisk-csi-e2e] [single-az] Pre-Provisioned I1106 00:19:00.476] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning.go:48 I1106 00:19:00.477] [It] [env] should use a pre-provisioned volume and mount it as readOnly in a pod I1106 00:19:00.477] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning.go:66 I1106 00:19:02.217] STEP: Successfully provisioned AzureDisk volume: "/subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/disks/pre-provisioned-readOnly" I1106 00:19:02.217] I1106 00:19:02.217] STEP: setting up the PV I1106 00:19:02.217] STEP: creating a PV I1106 00:19:02.305] STEP: setting up the PVC I1106 00:19:02.305] STEP: creating a PVC I1106 00:19:02.396] STEP: waiting for PVC to be in phase "Bound" I1106 00:19:02.397] Nov 6 00:19:02.396: INFO: Waiting up to 5m0s for PersistentVolumeClaims [pvc-bkpbm] to have phase Bound I1106 00:19:02.480] Nov 6 00:19:02.480: INFO: PersistentVolumeClaim pvc-bkpbm found and phase=Bound (83.843535ms) I1106 00:19:02.481] STEP: checking the PVC I1106 00:19:02.564] STEP: validating provisioned PV I1106 00:19:02.648] STEP: checking the PV I1106 00:19:02.649] STEP: deploying the pod I1106 00:19:02.737] STEP: checking that the pods command exits with an error I1106 00:19:02.737] Nov 6 00:19:02.737: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-5nd5c" in namespace "azuredisk-7323" to be "Error status code" I1106 00:19:02.821] Nov 6 00:19:02.820: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 83.546433ms I1106 00:19:04.905] Nov 6 00:19:04.904: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2.167577331s I1106 00:19:06.989] Nov 6 00:19:06.989: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4.252218942s I1106 00:19:09.075] Nov 6 00:19:09.075: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6.337990157s I1106 00:19:11.167] Nov 6 00:19:11.167: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8.430224619s I1106 00:19:13.255] Nov 6 00:19:13.254: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10.517664534s I1106 00:19:15.339] Nov 6 00:19:15.339: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12.602073817s I1106 00:19:17.424] Nov 6 00:19:17.424: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14.686912897s I1106 00:19:19.509] Nov 6 00:19:19.509: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 16.772260475s I1106 00:19:21.593] Nov 6 00:19:21.593: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 18.856336835s I1106 00:19:23.678] Nov 6 00:19:23.678: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 20.940756791s I1106 00:19:25.763] Nov 6 00:19:25.763: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 23.025835447s I1106 00:19:27.847] Nov 6 00:19:27.847: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 25.110156489s I1106 00:19:29.934] Nov 6 00:19:29.934: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 27.196859345s I1106 00:19:32.033] Nov 6 00:19:32.033: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 29.296307603s I1106 00:19:34.118] Nov 6 00:19:34.118: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 31.380995429s I1106 00:19:36.202] Nov 6 00:19:36.202: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 33.465089844s I1106 00:19:38.287] Nov 6 00:19:38.286: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 35.549634756s I1106 00:19:40.371] Nov 6 00:19:40.371: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 37.63406396s I1106 00:19:42.456] Nov 6 00:19:42.455: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 39.718468358s I1106 00:19:44.540] Nov 6 00:19:44.539: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 41.802606848s I1106 00:19:46.624] Nov 6 00:19:46.624: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 43.887098434s I1106 00:19:48.708] Nov 6 00:19:48.708: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 45.971277111s I1106 00:19:50.793] Nov 6 00:19:50.793: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 48.055997086s I1106 00:19:52.878] Nov 6 00:19:52.878: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 50.140708055s I1106 00:19:54.962] Nov 6 00:19:54.962: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 52.225381118s I1106 00:19:57.047] Nov 6 00:19:57.047: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 54.309865673s I1106 00:19:59.132] Nov 6 00:19:59.132: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 56.394704124s I1106 00:20:01.216] Nov 6 00:20:01.216: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 58.479176367s I1106 00:20:03.301] Nov 6 00:20:03.300: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.563676603s I1106 00:20:05.385] Nov 6 00:20:05.385: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.648434236s I1106 00:20:07.470] Nov 6 00:20:07.470: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.733138862s I1106 00:20:09.555] Nov 6 00:20:09.555: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.817871582s I1106 00:20:11.641] Nov 6 00:20:11.640: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.902935999s I1106 00:20:13.725] Nov 6 00:20:13.724: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.987473206s I1106 00:20:15.810] Nov 6 00:20:15.809: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.072438211s I1106 00:20:17.894] Nov 6 00:20:17.894: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.157042206s I1106 00:20:19.979] Nov 6 00:20:19.979: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.2421705s I1106 00:20:22.064] Nov 6 00:20:22.064: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.326857584s I1106 00:20:24.150] Nov 6 00:20:24.149: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m21.412650072s I1106 00:20:26.234] Nov 6 00:20:26.234: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m23.497321544s I1106 00:20:28.324] Nov 6 00:20:28.323: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m25.58667185s I1106 00:20:30.408] Nov 6 00:20:30.408: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m27.670964807s I1106 00:20:32.492] Nov 6 00:20:32.492: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m29.755036457s I1106 00:20:34.577] Nov 6 00:20:34.577: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m31.840044709s I1106 00:20:36.666] Nov 6 00:20:36.666: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m33.928909788s I1106 00:20:38.762] Nov 6 00:20:38.762: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.025155323s I1106 00:20:40.847] Nov 6 00:20:40.846: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.109592253s I1106 00:20:42.931] Nov 6 00:20:42.931: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.194112779s I1106 00:20:45.016] Nov 6 00:20:45.015: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.278613398s I1106 00:20:47.100] Nov 6 00:20:47.100: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.36286671s I1106 00:20:49.185] Nov 6 00:20:49.185: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.447915722s I1106 00:20:51.269] Nov 6 00:20:51.269: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.532367924s I1106 00:20:53.354] Nov 6 00:20:53.354: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.617200224s I1106 00:20:55.439] Nov 6 00:20:55.439: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.702472422s I1106 00:20:57.524] Nov 6 00:20:57.524: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.786884208s I1106 00:20:59.610] Nov 6 00:20:59.609: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.872648999s I1106 00:21:01.696] Nov 6 00:21:01.696: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.958983289s I1106 00:21:03.780] Nov 6 00:21:03.780: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m1.043431558s I1106 00:21:05.868] Nov 6 00:21:05.868: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m3.131297451s I1106 00:21:07.953] Nov 6 00:21:07.952: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m5.215634308s I1106 00:21:10.037] Nov 6 00:21:10.037: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m7.299981661s I1106 00:21:12.122] Nov 6 00:21:12.122: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m9.384705511s I1106 00:21:14.206] Nov 6 00:21:14.206: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m11.469216454s I1106 00:21:16.291] Nov 6 00:21:16.291: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m13.554314096s I1106 00:21:18.376] Nov 6 00:21:18.376: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m15.63905533s I1106 00:21:20.462] Nov 6 00:21:20.462: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m17.725384573s I1106 00:21:22.548] Nov 6 00:21:22.547: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m19.8105923s I1106 00:21:24.632] Nov 6 00:21:24.632: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m21.895059317s I1106 00:21:26.717] Nov 6 00:21:26.717: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m23.980157833s I1106 00:21:28.802] Nov 6 00:21:28.801: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.064530038s I1106 00:21:30.886] Nov 6 00:21:30.886: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.14912704s I1106 00:21:32.970] Nov 6 00:21:32.970: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.233246733s I1106 00:21:35.056] Nov 6 00:21:35.055: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.31853203s I1106 00:21:37.141] Nov 6 00:21:37.141: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.403810922s I1106 00:21:39.225] Nov 6 00:21:39.225: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.488070701s I1106 00:21:41.310] Nov 6 00:21:41.310: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.572712878s I1106 00:21:43.393] Nov 6 00:21:43.393: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.65619974s I1106 00:21:45.479] Nov 6 00:21:45.479: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.742382819s I1106 00:21:47.555] Nov 6 00:21:47.555: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.818070606s I1106 00:21:49.632] Nov 6 00:21:49.632: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.8950562s I1106 00:21:51.708] Nov 6 00:21:51.708: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.971338582s I1106 00:21:53.785] Nov 6 00:21:53.784: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m51.047382057s I1106 00:21:55.860] Nov 6 00:21:55.860: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m53.123294427s I1106 00:21:57.937] Nov 6 00:21:57.936: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m55.199316092s I1106 00:22:00.023] Nov 6 00:22:00.023: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m57.286334545s I1106 00:22:02.099] Nov 6 00:22:02.099: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m59.361758796s I1106 00:22:04.174] Nov 6 00:22:04.174: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m1.437117541s I1106 00:22:06.250] Nov 6 00:22:06.250: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m3.512859485s I1106 00:22:08.326] Nov 6 00:22:08.325: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m5.588496424s I1106 00:22:10.401] Nov 6 00:22:10.401: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m7.663988756s I1106 00:22:12.477] Nov 6 00:22:12.477: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m9.740122089s I1106 00:22:14.553] Nov 6 00:22:14.553: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m11.815800814s I1106 00:22:16.630] Nov 6 00:22:16.630: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m13.892744244s I1106 00:22:18.705] Nov 6 00:22:18.705: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m15.968282258s I1106 00:22:20.780] Nov 6 00:22:20.780: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.043188663s I1106 00:22:22.855] Nov 6 00:22:22.855: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.118257864s I1106 00:22:24.931] Nov 6 00:22:24.931: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.193824964s I1106 00:22:27.007] Nov 6 00:22:27.007: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.269897665s I1106 00:22:29.084] Nov 6 00:22:29.083: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.346572065s I1106 00:22:31.159] Nov 6 00:22:31.159: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.422006251s I1106 00:22:33.234] Nov 6 00:22:33.234: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.497444232s I1106 00:22:35.310] Nov 6 00:22:35.310: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.573416713s I1106 00:22:37.386] Nov 6 00:22:37.385: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.648576783s I1106 00:22:39.461] Nov 6 00:22:39.461: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.72388875s I1106 00:22:41.536] Nov 6 00:22:41.536: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.798988711s I1106 00:22:43.612] Nov 6 00:22:43.612: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.874727172s I1106 00:22:45.687] Nov 6 00:22:45.687: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.950105826s I1106 00:22:47.763] Nov 6 00:22:47.762: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m45.025447576s I1106 00:22:49.838] Nov 6 00:22:49.838: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m47.101146624s I1106 00:22:51.914] Nov 6 00:22:51.914: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m49.176741866s I1106 00:22:53.989] Nov 6 00:22:53.989: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m51.251879801s I1106 00:22:56.064] Nov 6 00:22:56.064: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m53.327215233s I1106 00:22:58.141] Nov 6 00:22:58.141: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m55.403828871s I1106 00:23:00.230] Nov 6 00:23:00.229: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m57.492474404s I1106 00:23:02.305] Nov 6 00:23:02.305: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m59.567901524s I1106 00:23:04.381] Nov 6 00:23:04.380: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m1.643480541s I1106 00:23:06.457] Nov 6 00:23:06.456: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m3.719622558s I1106 00:23:08.531] Nov 6 00:23:08.531: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m5.794236659s I1106 00:23:10.606] Nov 6 00:23:10.606: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m7.869338259s I1106 00:23:12.682] Nov 6 00:23:12.682: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m9.945168861s I1106 00:23:14.757] Nov 6 00:23:14.757: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.020246752s I1106 00:23:16.833] Nov 6 00:23:16.833: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.095741043s I1106 00:23:18.908] Nov 6 00:23:18.908: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.171332931s I1106 00:23:20.984] Nov 6 00:23:20.984: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.247020015s I1106 00:23:23.060] Nov 6 00:23:23.060: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.323008898s I1106 00:23:25.135] Nov 6 00:23:25.135: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.398051969s I1106 00:23:27.210] Nov 6 00:23:27.210: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.473250437s I1106 00:23:29.286] Nov 6 00:23:29.286: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.549035406s I1106 00:23:31.361] Nov 6 00:23:31.361: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.624025164s I1106 00:23:33.436] Nov 6 00:23:33.436: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.699362721s I1106 00:23:35.511] Nov 6 00:23:35.511: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.774386071s I1106 00:23:37.587] Nov 6 00:23:37.586: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.849561319s I1106 00:23:39.663] Nov 6 00:23:39.663: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.925884372s I1106 00:23:41.738] Nov 6 00:23:41.738: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m39.000992612s I1106 00:23:43.813] Nov 6 00:23:43.813: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m41.075695444s I1106 00:23:45.888] Nov 6 00:23:45.888: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m43.151315679s I1106 00:23:47.965] Nov 6 00:23:47.965: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m45.228150821s I1106 00:23:50.042] Nov 6 00:23:50.041: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m47.304585056s I1106 00:23:52.117] Nov 6 00:23:52.117: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m49.380023178s I1106 00:23:54.193] Nov 6 00:23:54.192: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m51.455549797s I1106 00:23:56.268] Nov 6 00:23:56.267: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m53.530539808s I1106 00:23:58.343] Nov 6 00:23:58.343: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m55.60600482s I1106 00:24:00.419] Nov 6 00:24:00.418: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m57.681559628s I1106 00:24:02.494] Nov 6 00:24:02.494: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m59.757034331s I1106 00:24:04.569] Nov 6 00:24:04.569: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m1.832273929s I1106 00:24:06.647] Nov 6 00:24:06.647: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m3.910200545s I1106 00:24:08.723] Nov 6 00:24:08.723: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m5.98589974s I1106 00:24:10.798] Nov 6 00:24:10.798: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m8.060764023s I1106 00:24:12.874] Nov 6 00:24:12.874: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m10.136783513s I1106 00:24:14.949] Nov 6 00:24:14.949: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.211921191s I1106 00:24:17.024] Nov 6 00:24:17.024: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m14.287355768s I1106 00:24:19.100] Nov 6 00:24:19.100: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m16.363199345s I1106 00:24:21.176] Nov 6 00:24:21.175: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m18.438483514s I1106 00:24:23.251] Nov 6 00:24:23.251: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m20.514221382s I1106 00:24:25.326] Nov 6 00:24:25.326: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m22.589409043s I1106 00:24:27.403] Nov 6 00:24:27.402: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m24.665487307s I1106 00:24:29.478] Nov 6 00:24:29.478: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m26.741065664s I1106 00:24:31.554] Nov 6 00:24:31.554: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m28.816882318s I1106 00:24:33.630] Nov 6 00:24:33.630: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m30.89271667s I1106 00:24:35.705] Nov 6 00:24:35.704: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m32.96765901s I1106 00:24:37.781] Nov 6 00:24:37.780: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m35.043547055s I1106 00:24:39.856] Nov 6 00:24:39.856: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m37.119121094s I1106 00:24:41.932] Nov 6 00:24:41.931: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m39.194482027s I1106 00:24:44.025] Nov 6 00:24:44.025: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m41.287920405s I1106 00:24:46.101] Nov 6 00:24:46.100: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m43.363536933s I1106 00:24:48.176] Nov 6 00:24:48.176: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m45.439016157s I1106 00:24:50.251] Nov 6 00:24:50.251: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m47.514372377s I1106 00:24:52.328] Nov 6 00:24:52.328: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m49.591134004s I1106 00:24:54.403] Nov 6 00:24:54.403: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m51.666443716s I1106 00:24:56.479] Nov 6 00:24:56.479: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m53.741910226s I1106 00:24:58.554] Nov 6 00:24:58.554: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m55.81705743s I1106 00:25:00.630] Nov 6 00:25:00.629: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m57.892447733s I1106 00:25:02.705] Nov 6 00:25:02.705: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 5m59.968408137s I1106 00:25:04.785] Nov 6 00:25:04.784: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m2.047503263s I1106 00:25:06.860] Nov 6 00:25:06.860: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m4.12337076s I1106 00:25:08.936] Nov 6 00:25:08.936: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m6.199188052s I1106 00:25:11.013] Nov 6 00:25:11.013: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m8.275718348s I1106 00:25:13.089] Nov 6 00:25:13.089: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m10.351773136s I1106 00:25:15.166] Nov 6 00:25:15.166: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m12.429209432s I1106 00:25:17.242] Nov 6 00:25:17.241: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m14.504536607s I1106 00:25:19.317] Nov 6 00:25:19.317: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.580053181s I1106 00:25:21.393] Nov 6 00:25:21.392: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.65543175s I1106 00:25:23.468] Nov 6 00:25:23.468: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.730863117s I1106 00:25:25.544] Nov 6 00:25:25.544: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.806895985s I1106 00:25:27.619] Nov 6 00:25:27.619: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m24.882347846s I1106 00:25:29.695] Nov 6 00:25:29.695: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m26.957919904s I1106 00:25:31.773] Nov 6 00:25:31.772: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m29.035542075s I1106 00:25:33.848] Nov 6 00:25:33.848: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m31.110723024s I1106 00:25:35.932] Nov 6 00:25:35.932: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m33.195285945s I1106 00:25:38.017] Nov 6 00:25:38.017: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m35.279766663s I1106 00:25:40.101] Nov 6 00:25:40.101: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m37.364130677s I1106 00:25:42.186] Nov 6 00:25:42.186: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m39.448759489s I1106 00:25:44.270] Nov 6 00:25:44.270: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m41.533070196s I1106 00:25:46.353] Nov 6 00:25:46.353: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m43.616302591s I1106 00:25:48.438] Nov 6 00:25:48.437: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m45.700514391s I1106 00:25:50.522] Nov 6 00:25:50.521: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m47.784552986s I1106 00:25:52.606] Nov 6 00:25:52.606: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m49.869175583s I1106 00:25:54.690] Nov 6 00:25:54.690: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m51.952952771s I1106 00:25:56.775] Nov 6 00:25:56.775: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m54.037854864s I1106 00:25:58.859] Nov 6 00:25:58.858: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m56.121652645s I1106 00:26:00.942] Nov 6 00:26:00.942: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 6m58.205348422s I1106 00:26:03.026] Nov 6 00:26:03.026: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m0.289147897s I1106 00:26:05.111] Nov 6 00:26:05.110: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m2.373530874s I1106 00:26:07.195] Nov 6 00:26:07.195: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m4.45822855s I1106 00:26:09.280] Nov 6 00:26:09.279: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m6.542632521s I1106 00:26:11.364] Nov 6 00:26:11.364: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m8.62707159s I1106 00:26:13.449] Nov 6 00:26:13.449: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.712036459s I1106 00:26:15.533] Nov 6 00:26:15.533: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m12.796471122s I1106 00:26:17.618] Nov 6 00:26:17.618: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m14.881420685s I1106 00:26:19.703] Nov 6 00:26:19.703: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m16.965799541s I1106 00:26:21.788] Nov 6 00:26:21.788: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m19.050970201s I1106 00:26:23.873] Nov 6 00:26:23.872: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m21.13525875s I1106 00:26:25.957] Nov 6 00:26:25.957: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m23.219855499s I1106 00:26:28.041] Nov 6 00:26:28.041: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m25.303973042s I1106 00:26:30.126] Nov 6 00:26:30.126: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m27.388756186s I1106 00:26:32.210] Nov 6 00:26:32.210: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m29.473010624s I1106 00:26:34.295] Nov 6 00:26:34.295: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m31.557712863s I1106 00:26:36.380] Nov 6 00:26:36.379: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m33.6426159s I1106 00:26:38.464] Nov 6 00:26:38.464: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m35.727325533s I1106 00:26:40.549] Nov 6 00:26:40.549: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m37.812262865s I1106 00:26:42.634] Nov 6 00:26:42.634: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m39.89677009s I1106 00:26:44.718] Nov 6 00:26:44.718: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m41.981083012s I1106 00:26:46.802] Nov 6 00:26:46.802: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m44.065471231s I1106 00:26:48.886] Nov 6 00:26:48.886: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m46.149145941s I1106 00:26:50.971] Nov 6 00:26:50.971: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m48.23415916s I1106 00:26:53.056] Nov 6 00:26:53.056: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m50.318701772s I1106 00:26:55.140] Nov 6 00:26:55.140: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m52.40313088s I1106 00:26:57.237] Nov 6 00:26:57.236: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m54.499602883s I1106 00:26:59.321] Nov 6 00:26:59.321: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m56.583768684s I1106 00:27:01.405] Nov 6 00:27:01.405: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.668327285s I1106 00:27:03.490] Nov 6 00:27:03.489: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.752558481s I1106 00:27:05.574] Nov 6 00:27:05.573: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m2.836565673s I1106 00:27:07.658] Nov 6 00:27:07.658: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m4.920981265s I1106 00:27:09.742] Nov 6 00:27:09.742: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m7.005225053s I1106 00:27:11.827] Nov 6 00:27:11.827: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m9.089763541s I1106 00:27:13.911] Nov 6 00:27:13.911: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m11.173972624s I1106 00:27:15.995] Nov 6 00:27:15.995: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m13.258321205s I1106 00:27:18.080] Nov 6 00:27:18.080: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m15.342857985s I1106 00:27:20.165] Nov 6 00:27:20.165: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m17.42838717s I1106 00:27:22.250] Nov 6 00:27:22.250: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m19.513108746s I1106 00:27:24.335] Nov 6 00:27:24.334: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m21.597641219s I1106 00:27:26.420] Nov 6 00:27:26.419: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m23.682473791s I1106 00:27:28.504] Nov 6 00:27:28.504: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m25.766990257s I1106 00:27:30.589] Nov 6 00:27:30.589: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m27.851806724s I1106 00:27:32.673] Nov 6 00:27:32.673: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m29.936115984s I1106 00:27:34.766] Nov 6 00:27:34.766: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m32.028814209s I1106 00:27:36.851] Nov 6 00:27:36.851: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m34.114193573s I1106 00:27:38.936] Nov 6 00:27:38.936: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m36.199190331s I1106 00:27:41.020] Nov 6 00:27:41.020: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m38.283180279s I1106 00:27:43.106] Nov 6 00:27:43.106: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m40.368955838s I1106 00:27:45.195] Nov 6 00:27:45.195: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m42.458100122s I1106 00:27:47.279] Nov 6 00:27:47.279: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m44.542279964s I1106 00:27:49.364] Nov 6 00:27:49.363: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m46.626479203s I1106 00:27:51.454] Nov 6 00:27:51.454: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m48.716833589s I1106 00:27:53.539] Nov 6 00:27:53.538: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m50.801560928s I1106 00:27:55.623] Nov 6 00:27:55.623: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m52.88571106s I1106 00:27:57.707] Nov 6 00:27:57.707: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m54.970181391s I1106 00:27:59.792] Nov 6 00:27:59.791: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m57.05454412s I1106 00:28:01.876] Nov 6 00:28:01.876: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 8m59.138727845s I1106 00:28:03.960] Nov 6 00:28:03.960: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m1.223390771s I1106 00:28:06.045] Nov 6 00:28:06.045: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m3.307978894s I1106 00:28:08.130] Nov 6 00:28:08.129: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m5.392580415s I1106 00:28:10.215] Nov 6 00:28:10.214: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m7.477419835s I1106 00:28:12.299] Nov 6 00:28:12.299: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m9.561961051s I1106 00:28:14.384] Nov 6 00:28:14.383: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m11.646449164s I1106 00:28:16.469] Nov 6 00:28:16.469: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m13.732113484s I1106 00:28:18.553] Nov 6 00:28:18.553: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m15.816077088s I1106 00:28:20.638] Nov 6 00:28:20.638: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m17.900711095s I1106 00:28:22.722] Nov 6 00:28:22.722: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m19.985256399s I1106 00:28:24.807] Nov 6 00:28:24.807: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m22.070010602s I1106 00:28:26.891] Nov 6 00:28:26.891: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m24.1543461s I1106 00:28:28.976] Nov 6 00:28:28.976: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m26.238716296s I1106 00:28:31.061] Nov 6 00:28:31.060: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m28.323548793s I1106 00:28:33.145] Nov 6 00:28:33.145: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m30.408316388s I1106 00:28:35.230] Nov 6 00:28:35.230: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m32.49305008s I1106 00:28:37.314] Nov 6 00:28:37.314: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m34.577455667s I1106 00:28:39.399] Nov 6 00:28:39.399: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m36.661969853s I1106 00:28:41.483] Nov 6 00:28:41.483: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m38.746273235s I1106 00:28:43.568] Nov 6 00:28:43.567: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m40.830590614s I1106 00:28:45.652] Nov 6 00:28:45.651: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m42.914591089s I1106 00:28:47.736] Nov 6 00:28:47.736: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m44.999013266s I1106 00:28:49.821] Nov 6 00:28:49.820: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m47.083676142s I1106 00:28:51.906] Nov 6 00:28:51.905: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m49.168607018s I1106 00:28:53.990] Nov 6 00:28:53.990: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m51.253004287s I1106 00:28:56.074] Nov 6 00:28:56.074: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m53.337316954s I1106 00:28:58.159] Nov 6 00:28:58.159: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m55.422014221s I1106 00:29:00.244] Nov 6 00:29:00.243: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m57.506637386s I1106 00:29:02.328] Nov 6 00:29:02.328: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 9m59.591468151s I1106 00:29:04.413] Nov 6 00:29:04.413: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m1.675802409s I1106 00:29:06.498] Nov 6 00:29:06.497: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m3.760477368s I1106 00:29:08.582] Nov 6 00:29:08.582: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m5.844871122s I1106 00:29:10.666] Nov 6 00:29:10.666: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m7.929082373s I1106 00:29:12.751] Nov 6 00:29:12.751: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m10.013795326s I1106 00:29:14.835] Nov 6 00:29:14.835: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m12.098019073s I1106 00:29:16.919] Nov 6 00:29:16.919: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m14.18244832s I1106 00:29:19.004] Nov 6 00:29:19.004: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m16.267085366s I1106 00:29:21.088] Nov 6 00:29:21.088: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m18.351175306s I1106 00:29:23.172] Nov 6 00:29:23.172: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m20.435406544s I1106 00:29:25.257] Nov 6 00:29:25.257: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m22.519740282s I1106 00:29:27.341] Nov 6 00:29:27.341: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m24.604292419s I1106 00:29:29.426] Nov 6 00:29:29.425: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m26.688613052s I1106 00:29:31.515] Nov 6 00:29:31.515: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m28.777799523s I1106 00:29:33.599] Nov 6 00:29:33.599: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m30.862302253s I1106 00:29:35.683] Nov 6 00:29:35.683: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m32.94646208s I1106 00:29:37.768] Nov 6 00:29:37.768: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m35.031032107s I1106 00:29:39.853] Nov 6 00:29:39.853: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m37.115931635s I1106 00:29:41.938] Nov 6 00:29:41.937: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m39.200354457s I1106 00:29:44.052] Nov 6 00:29:44.052: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m41.315026819s I1106 00:29:46.136] Nov 6 00:29:46.136: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m43.399374736s I1106 00:29:48.236] Nov 6 00:29:48.236: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m45.498710472s I1106 00:29:50.321] Nov 6 00:29:50.321: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m47.583984793s I1106 00:29:52.409] Nov 6 00:29:52.409: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m49.672168435s I1106 00:29:54.494] Nov 6 00:29:54.493: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m51.756584346s I1106 00:29:56.579] Nov 6 00:29:56.578: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m53.841634659s I1106 00:29:58.664] Nov 6 00:29:58.663: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m55.926636071s I1106 00:30:00.748] Nov 6 00:30:00.748: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 10m58.011112676s I1106 00:30:02.832] Nov 6 00:30:02.832: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m0.095475978s I1106 00:30:04.918] Nov 6 00:30:04.917: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m2.180671186s I1106 00:30:07.003] Nov 6 00:30:07.003: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m4.26569529s I1106 00:30:09.087] Nov 6 00:30:09.087: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m6.349962686s I1106 00:30:11.172] Nov 6 00:30:11.172: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m8.435000386s I1106 00:30:13.256] Nov 6 00:30:13.256: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m10.519022276s I1106 00:30:15.341] Nov 6 00:30:15.340: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m12.603541069s I1106 00:30:17.426] Nov 6 00:30:17.425: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m14.688523463s I1106 00:30:19.510] Nov 6 00:30:19.510: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m16.772977052s I1106 00:30:21.594] Nov 6 00:30:21.594: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m18.857324437s I1106 00:30:23.679] Nov 6 00:30:23.678: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m20.94157072s I1106 00:30:25.763] Nov 6 00:30:25.763: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m23.025874202s I1106 00:30:27.847] Nov 6 00:30:27.847: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m25.109797379s I1106 00:30:29.931] Nov 6 00:30:29.931: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m27.194031956s I1106 00:30:32.060] Nov 6 00:30:32.059: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m29.322489584s I1106 00:30:34.144] Nov 6 00:30:34.144: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m31.406729858s I1106 00:30:36.237] Nov 6 00:30:36.237: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m33.500363904s I1106 00:30:38.322] Nov 6 00:30:38.322: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m35.584867077s I1106 00:30:40.406] Nov 6 00:30:40.406: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m37.669078245s I1106 00:30:42.490] Nov 6 00:30:42.490: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m39.753307012s I1106 00:30:44.575] Nov 6 00:30:44.575: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m41.838164782s I1106 00:30:46.660] Nov 6 00:30:46.660: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m43.922780049s I1106 00:30:48.744] Nov 6 00:30:48.744: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m46.006691308s I1106 00:30:50.830] Nov 6 00:30:50.830: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m48.092993784s I1106 00:30:52.915] Nov 6 00:30:52.914: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m50.177617245s I1106 00:30:54.999] Nov 6 00:30:54.998: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m52.2616388s I1106 00:30:57.083] Nov 6 00:30:57.083: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m54.345726754s I1106 00:30:59.168] Nov 6 00:30:59.168: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m56.430980215s I1106 00:31:01.252] Nov 6 00:31:01.252: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 11m58.515267367s I1106 00:31:03.337] Nov 6 00:31:03.336: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m0.599552817s I1106 00:31:05.421] Nov 6 00:31:05.420: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m2.683656664s I1106 00:31:07.505] Nov 6 00:31:07.504: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m4.767643608s I1106 00:31:09.589] Nov 6 00:31:09.589: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m6.852417657s I1106 00:31:11.674] Nov 6 00:31:11.674: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m8.936999603s I1106 00:31:13.759] Nov 6 00:31:13.759: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m11.021838549s I1106 00:31:15.843] Nov 6 00:31:15.842: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m13.105632586s I1106 00:31:17.927] Nov 6 00:31:17.927: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m15.189879024s I1106 00:31:20.017] Nov 6 00:31:20.017: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m17.280212009s I1106 00:31:22.102] Nov 6 00:31:22.102: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m19.364837647s I1106 00:31:24.186] Nov 6 00:31:24.186: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m21.44910418s I1106 00:31:26.271] Nov 6 00:31:26.271: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m23.533691415s I1106 00:31:28.356] Nov 6 00:31:28.355: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m25.618387649s I1106 00:31:30.440] Nov 6 00:31:30.440: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m27.702892379s I1106 00:31:32.524] Nov 6 00:31:32.524: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m29.787394508s I1106 00:31:34.611] Nov 6 00:31:34.610: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m31.873619149s I1106 00:31:36.699] Nov 6 00:31:36.699: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m33.962206708s I1106 00:31:38.784] Nov 6 00:31:38.784: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m36.046713232s I1106 00:31:40.869] Nov 6 00:31:40.868: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m38.131625858s I1106 00:31:42.954] Nov 6 00:31:42.954: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m40.217182488s I1106 00:31:45.040] Nov 6 00:31:45.040: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m42.302931717s I1106 00:31:47.125] Nov 6 00:31:47.125: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m44.387885339s I1106 00:31:49.210] Nov 6 00:31:49.210: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m46.47300746s I1106 00:31:51.295] Nov 6 00:31:51.295: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m48.557783177s I1106 00:31:53.380] Nov 6 00:31:53.379: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m50.642473892s I1106 00:31:55.468] Nov 6 00:31:55.467: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m52.730514132s I1106 00:31:57.553] Nov 6 00:31:57.553: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m54.816208952s I1106 00:31:59.639] Nov 6 00:31:59.638: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m56.901624668s I1106 00:32:01.723] Nov 6 00:32:01.723: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 12m58.985938474s I1106 00:32:03.808] Nov 6 00:32:03.807: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m1.070587981s I1106 00:32:05.892] Nov 6 00:32:05.892: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m3.155008385s I1106 00:32:07.977] Nov 6 00:32:07.977: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m5.240033692s I1106 00:32:10.062] Nov 6 00:32:10.062: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m7.325145499s I1106 00:32:12.148] Nov 6 00:32:12.147: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m9.410534206s I1106 00:32:14.233] Nov 6 00:32:14.233: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m11.495961512s I1106 00:32:16.318] Nov 6 00:32:16.318: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m13.580808611s I1106 00:32:18.403] Nov 6 00:32:18.403: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m15.665918212s I1106 00:32:20.488] Nov 6 00:32:20.488: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m17.751209412s I1106 00:32:22.573] Nov 6 00:32:22.573: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m19.836112508s I1106 00:32:24.658] Nov 6 00:32:24.658: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m21.921294005s I1106 00:32:26.743] Nov 6 00:32:26.743: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m24.006300799s I1106 00:32:28.828] Nov 6 00:32:28.828: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m26.091372492s I1106 00:32:30.913] Nov 6 00:32:30.913: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m28.176262782s I1106 00:32:32.998] Nov 6 00:32:32.998: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m30.260754767s I1106 00:32:35.083] Nov 6 00:32:35.083: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m32.345786756s I1106 00:32:37.168] Nov 6 00:32:37.168: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m34.430860043s I1106 00:32:39.253] Nov 6 00:32:39.253: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m36.516369833s I1106 00:32:41.338] Nov 6 00:32:41.338: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m38.600884613s I1106 00:32:43.422] Nov 6 00:32:43.422: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m40.685111789s I1106 00:32:45.507] Nov 6 00:32:45.507: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m42.769722167s I1106 00:32:47.591] Nov 6 00:32:47.591: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m44.854385945s I1106 00:32:49.676] Nov 6 00:32:49.676: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m46.939049121s I1106 00:32:51.761] Nov 6 00:32:51.761: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m49.023974597s I1106 00:32:53.846] Nov 6 00:32:53.846: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m51.109071574s I1106 00:32:55.931] Nov 6 00:32:55.930: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m53.193492643s I1106 00:32:58.015] Nov 6 00:32:58.015: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m55.278041313s I1106 00:33:00.100] Nov 6 00:33:00.100: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m57.363405788s I1106 00:33:02.186] Nov 6 00:33:02.186: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 13m59.44869116s I1106 00:33:04.271] Nov 6 00:33:04.271: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m1.534017832s I1106 00:33:06.356] Nov 6 00:33:06.356: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m3.619189701s I1106 00:33:08.442] Nov 6 00:33:08.442: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m5.704866273s I1106 00:33:10.528] Nov 6 00:33:10.527: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m7.790651044s I1106 00:33:12.612] Nov 6 00:33:12.612: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m9.875385206s I1106 00:33:14.698] Nov 6 00:33:14.697: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m11.96052827s I1106 00:33:16.786] Nov 6 00:33:16.786: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m14.04921376s I1106 00:33:18.871] Nov 6 00:33:18.871: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m16.133852317s I1106 00:33:20.956] Nov 6 00:33:20.956: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m18.219251179s I1106 00:33:23.043] Nov 6 00:33:23.043: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m20.306234852s I1106 00:33:25.129] Nov 6 00:33:25.129: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m22.391688312s I1106 00:33:27.214] Nov 6 00:33:27.213: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m24.476451064s I1106 00:33:29.299] Nov 6 00:33:29.298: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m26.56165122s I1106 00:33:31.384] Nov 6 00:33:31.383: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m28.646556371s I1106 00:33:33.468] Nov 6 00:33:33.468: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m30.731217019s I1106 00:33:35.553] Nov 6 00:33:35.553: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m32.816042768s I1106 00:33:37.638] Nov 6 00:33:37.638: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m34.900913515s I1106 00:33:39.724] Nov 6 00:33:39.722: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m36.985334258s I1106 00:33:41.806] Nov 6 00:33:41.806: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m39.069368597s I1106 00:33:43.892] Nov 6 00:33:43.892: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m41.155232748s I1106 00:33:45.978] Nov 6 00:33:45.977: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m43.239884789s I1106 00:33:48.068] Nov 6 00:33:48.067: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m45.330573576s I1106 00:33:50.153] Nov 6 00:33:50.153: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m47.415721219s I1106 00:33:52.250] Nov 6 00:33:52.250: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m49.512730654s I1106 00:33:54.335] Nov 6 00:33:54.334: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m51.597638192s I1106 00:33:56.419] Nov 6 00:33:56.419: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m53.682135725s I1106 00:33:58.510] Nov 6 00:33:58.510: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m55.772971808s I1106 00:34:00.595] Nov 6 00:34:00.595: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m57.858037043s I1106 00:34:02.680] Nov 6 00:34:02.680: INFO: Pod "azuredisk-volume-tester-5nd5c": Phase="Pending", Reason="", readiness=false. Elapsed: 14m59.943104078s I1106 00:34:04.684] Nov 6 00:34:04.683: INFO: Unexpected error occurred: Gave up after waiting 15m0s for pod "azuredisk-volume-tester-5nd5c" to be "Error status code" I1106 00:34:04.684] Nov 6 00:34:04.683: INFO: deleting Pod "azuredisk-7323"/"azuredisk-volume-tester-5nd5c" I1106 00:34:04.776] Nov 6 00:34:04.773: INFO: Error getting logs for pod azuredisk-volume-tester-5nd5c: the server rejected our request for an unknown reason (get pods azuredisk-volume-tester-5nd5c) I1106 00:34:04.777] STEP: Deleting pod azuredisk-volume-tester-5nd5c in namespace azuredisk-7323 I1106 00:34:04.871] STEP: deleting PV "azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5" I1106 00:34:04.923] Nov 6 00:34:04.871: INFO: Deleting PersistentVolume "azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5" I1106 00:34:04.964] STEP: waiting for claim's PV "azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5" to be deleted I1106 00:34:04.964] Nov 6 00:34:04.962: INFO: Waiting up to 10m0s for PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 to get deleted I1106 00:34:05.046] Nov 6 00:34:05.046: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (84.197763ms) I1106 00:34:10.131] Nov 6 00:34:10.131: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (5.168745331s) I1106 00:34:15.216] Nov 6 00:34:15.216: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (10.253704996s) I1106 00:34:20.300] Nov 6 00:34:20.300: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (15.338356251s) I1106 00:34:25.385] Nov 6 00:34:25.385: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (20.422776398s) I1106 00:34:30.471] Nov 6 00:34:30.470: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (25.507966544s) I1106 00:34:35.556] Nov 6 00:34:35.556: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (30.594064091s) I1106 00:34:40.641] Nov 6 00:34:40.640: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (35.678415917s) I1106 00:34:45.730] Nov 6 00:34:45.730: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (40.768075879s) I1106 00:34:50.821] Nov 6 00:34:50.821: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (45.859290646s) I1106 00:34:55.908] Nov 6 00:34:55.907: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (50.945588868s) I1106 00:35:00.993] Nov 6 00:35:00.993: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (56.030922977s) I1106 00:35:06.080] Nov 6 00:35:06.078: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (1m1.115805975s) I1106 00:35:11.163] Nov 6 00:35:11.162: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (1m6.200527466s) I1106 00:35:16.252] Nov 6 00:35:16.251: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (1m11.289434984s) I1106 00:35:21.343] Nov 6 00:35:21.343: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (1m16.381276419s) I1106 00:35:26.428] Nov 6 00:35:26.428: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (1m21.465969091s) I1106 00:35:31.505] Nov 6 00:35:31.505: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (1m26.5433147s) I1106 00:35:36.583] Nov 6 00:35:36.583: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (1m31.621148107s) I1106 00:35:41.661] Nov 6 00:35:41.661: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (1m36.69920561s) I1106 00:35:46.738] Nov 6 00:35:46.738: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (1m41.776066697s) I1106 00:35:51.815] Nov 6 00:35:51.815: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (1m46.85307748s) I1106 00:35:56.892] Nov 6 00:35:56.892: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (1m51.929876456s) I1106 00:36:01.974] Nov 6 00:36:01.973: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (1m57.011252262s) I1106 00:36:07.054] Nov 6 00:36:07.054: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (2m2.091873057s) I1106 00:36:12.131] Nov 6 00:36:12.131: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (2m7.168732416s) I1106 00:36:17.216] Nov 6 00:36:17.214: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (2m12.25193272s) I1106 00:36:22.302] Nov 6 00:36:22.294: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (2m17.331948693s) I1106 00:36:27.385] Nov 6 00:36:27.382: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (2m22.420002325s) I1106 00:36:32.461] Nov 6 00:36:32.460: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (2m27.498446275s) I1106 00:36:37.539] Nov 6 00:36:37.538: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (2m32.576431217s) I1106 00:36:42.615] Nov 6 00:36:42.615: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (2m37.653125143s) I1106 00:36:47.692] Nov 6 00:36:47.692: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (2m42.730214768s) I1106 00:36:52.770] Nov 6 00:36:52.770: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (2m47.807986893s) I1106 00:36:57.847] Nov 6 00:36:57.847: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (2m52.885400409s) I1106 00:37:02.924] Nov 6 00:37:02.924: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (2m57.961960315s) I1106 00:37:08.001] Nov 6 00:37:08.001: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (3m3.038928318s) I1106 00:37:13.078] Nov 6 00:37:13.078: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (3m8.116021418s) I1106 00:37:18.158] Nov 6 00:37:18.158: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (3m13.196380038s) I1106 00:37:23.238] Nov 6 00:37:23.235: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (3m18.273182426s) I1106 00:37:28.312] Nov 6 00:37:28.312: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (3m23.350385412s) I1106 00:37:33.391] Nov 6 00:37:33.390: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (3m28.428253699s) I1106 00:37:38.471] Nov 6 00:37:38.471: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (3m33.508791502s) I1106 00:37:53.365] Nov 6 00:37:43.548: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (3m38.586223776s) I1106 00:37:53.365] Nov 6 00:37:48.626: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (3m43.66423145s) I1106 00:37:53.704] Nov 6 00:37:53.703: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (3m48.741570714s) I1106 00:38:08.602] Nov 6 00:37:58.781: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (3m53.819124576s) I1106 00:38:08.602] Nov 6 00:38:03.858: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (3m58.895942627s) I1106 00:38:08.939] Nov 6 00:38:08.939: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (4m3.976991507s) I1106 00:38:14.016] Nov 6 00:38:14.016: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (4m9.054323954s) I1106 00:38:20.553] Nov 6 00:38:19.093: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (4m14.131115292s) I1106 00:38:24.178] Nov 6 00:38:24.178: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (4m19.21616089s) I1106 00:38:29.269] Nov 6 00:38:29.269: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (4m24.306839229s) I1106 00:38:34.353] Nov 6 00:38:34.353: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (4m29.391172113s) I1106 00:38:39.449] Nov 6 00:38:39.449: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (4m34.486954083s) I1106 00:38:44.533] Nov 6 00:38:44.533: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (4m39.57138376s) I1106 00:38:49.618] Nov 6 00:38:49.618: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (4m44.655712732s) I1106 00:38:54.702] Nov 6 00:38:54.702: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (4m49.740040501s) I1106 00:39:00.401] Nov 6 00:38:59.787: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (4m54.824839069s) I1106 00:39:04.874] Nov 6 00:39:04.874: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (4m59.91190425s) I1106 00:39:09.959] Nov 6 00:39:09.958: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (5m4.996407508s) I1106 00:39:15.043] Nov 6 00:39:15.043: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (5m10.081082364s) I1106 00:39:20.127] Nov 6 00:39:20.127: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (5m15.165397712s) I1106 00:39:25.212] Nov 6 00:39:25.212: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (5m20.249881158s) I1106 00:39:30.296] Nov 6 00:39:30.295: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (5m25.333584995s) I1106 00:39:35.380] Nov 6 00:39:35.380: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (5m30.418443337s) I1106 00:39:40.465] Nov 6 00:39:40.465: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (5m35.502775071s) I1106 00:39:45.548] Nov 6 00:39:45.548: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (5m40.586247294s) I1106 00:39:50.632] Nov 6 00:39:50.632: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (5m45.670082517s) I1106 00:39:55.716] Nov 6 00:39:55.716: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (5m50.754088838s) I1106 00:40:00.800] Nov 6 00:40:00.800: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (5m55.838324857s) I1106 00:40:05.884] Nov 6 00:40:05.884: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (6m0.921783966s) I1106 00:40:10.968] Nov 6 00:40:10.968: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (6m6.00626648s) I1106 00:40:16.060] Nov 6 00:40:16.060: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (6m11.097853546s) I1106 00:40:21.148] Nov 6 00:40:21.147: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (6m16.185576578s) I1106 00:40:26.235] Nov 6 00:40:26.234: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (6m21.272484501s) I1106 00:40:31.319] Nov 6 00:40:31.319: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (6m26.357184303s) I1106 00:40:36.407] Nov 6 00:40:36.407: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (6m31.444793425s) I1106 00:40:41.505] Nov 6 00:40:41.498: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (6m36.535937071s) I1106 00:40:46.582] Nov 6 00:40:46.582: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (6m41.619907957s) I1106 00:40:51.669] Nov 6 00:40:51.668: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (6m46.706604162s) I1106 00:40:56.753] Nov 6 00:40:56.753: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (6m51.791058946s) I1106 00:41:01.837] Nov 6 00:41:01.837: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (6m56.875135724s) I1106 00:41:06.921] Nov 6 00:41:06.921: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (7m1.959103999s) I1106 00:41:12.005] Nov 6 00:41:12.005: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (7m7.042954769s) I1106 00:41:17.090] Nov 6 00:41:17.089: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (7m12.127631342s) I1106 00:41:22.186] Nov 6 00:41:22.182: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (7m17.219879072s) I1106 00:41:27.267] Nov 6 00:41:27.266: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (7m22.304427238s) I1106 00:41:32.355] Nov 6 00:41:32.351: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (7m27.389539807s) I1106 00:41:37.464] Nov 6 00:41:37.464: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (7m32.501834184s) I1106 00:41:42.549] Nov 6 00:41:42.548: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (7m37.586598243s) I1106 00:41:47.633] Nov 6 00:41:47.633: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (7m42.670971297s) I1106 00:41:52.718] Nov 6 00:41:52.717: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (7m47.755425948s) I1106 00:41:57.802] Nov 6 00:41:57.802: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (7m52.8402451s) I1106 00:42:02.887] Nov 6 00:42:02.887: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (7m57.924922747s) I1106 00:42:07.971] Nov 6 00:42:07.971: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (8m3.00929189s) I1106 00:42:13.062] Nov 6 00:42:13.058: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (8m8.095909647s) I1106 00:42:18.147] Nov 6 00:42:18.146: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (8m13.183897012s) I1106 00:42:23.230] Nov 6 00:42:23.230: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (8m18.268055545s) I1106 00:42:28.330] Nov 6 00:42:28.322: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (8m23.359916235s) I1106 00:42:33.418] Nov 6 00:42:33.410: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (8m28.447887492s) I1106 00:42:38.498] Nov 6 00:42:38.498: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (8m33.53627265s) I1106 00:42:43.596] Nov 6 00:42:43.596: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (8m38.633707676s) I1106 00:42:48.683] Nov 6 00:42:48.682: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (8m43.720627117s) I1106 00:42:53.767] Nov 6 00:42:53.767: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (8m48.805138637s) I1106 00:42:59.906] Nov 6 00:42:58.852: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (8m53.889929157s) I1106 00:43:03.937] Nov 6 00:43:03.936: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (8m58.974589973s) I1106 00:43:09.021] Nov 6 00:43:09.021: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (9m4.059174086s) I1106 00:43:14.106] Nov 6 00:43:14.106: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (9m9.143830698s) I1106 00:43:19.191] Nov 6 00:43:19.191: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (9m14.229121912s) I1106 00:43:24.276] Nov 6 00:43:24.275: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (9m19.313510616s) I1106 00:43:29.360] Nov 6 00:43:29.360: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (9m24.397804117s) I1106 00:43:34.445] Nov 6 00:43:34.444: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (9m29.482616721s) I1106 00:43:39.529] Nov 6 00:43:39.528: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (9m34.566482714s) I1106 00:43:44.613] Nov 6 00:43:44.612: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (9m39.650608007s) I1106 00:43:49.697] Nov 6 00:43:49.697: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (9m44.735306003s) I1106 00:43:54.782] Nov 6 00:43:54.781: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (9m49.819629593s) I1106 00:43:59.866] Nov 6 00:43:59.866: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (9m54.904000182s) I1106 00:44:04.958] Nov 6 00:44:04.954: INFO: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 found and phase=Bound (9m59.991890195s) I1106 00:44:09.962] Nov 6 00:44:09.958: INFO: Unexpected error occurred: PersistentVolume azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5 still exists within 10m0s I1106 00:44:09.962] [AfterEach] [azuredisk-csi-e2e] [single-az] Pre-Provisioned I1106 00:44:09.962] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1106 00:44:09.962] STEP: Collecting events from namespace "azuredisk-7323". I1106 00:44:10.044] STEP: Found 4 events. I1106 00:44:10.045] Nov 6 00:44:10.043: INFO: At 2019-11-06 00:19:02 +0000 UTC - event for azuredisk-volume-tester-5nd5c: {default-scheduler } Scheduled: Successfully assigned azuredisk-7323/azuredisk-volume-tester-5nd5c to k8s-agentpool-73731178-vmss000001 I1106 00:44:10.045] Nov 6 00:44:10.043: INFO: At 2019-11-06 00:19:03 +0000 UTC - event for azuredisk-volume-tester-5nd5c: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "azuredisk-7323-disk.csi.azure.com-preprovsioned-pv-tj6l5" : rpc error: code = Unknown desc = Attach volume "/subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/disks/pre-provisioned-readOnly" to instance "k8s-agentpool-73731178-vmss000001" failed with compute.VirtualMachineScaleSetVMsClient#Update: Failure sending request: StatusCode=400 -- Original Error: Code="BadRequest" Message="Disk /subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/disks/pre-provisioned-readOnly cannot be attached to the VM because it is not in zone '2'." I1106 00:44:10.046] Nov 6 00:44:10.043: INFO: At 2019-11-06 00:21:05 +0000 UTC - event for azuredisk-volume-tester-5nd5c: {kubelet k8s-agentpool-73731178-vmss000001} FailedMount: Unable to mount volumes for pod "azuredisk-volume-tester-5nd5c_azuredisk-7323(93a93c37-6e37-479e-9d1b-9eeed106bb91)": timeout expired waiting for volumes to attach or mount for pod "azuredisk-7323"/"azuredisk-volume-tester-5nd5c". list of unmounted volumes=[test-volume-1]. list of unattached volumes=[test-volume-1 default-token-m7bpj] I1106 00:44:10.047] Nov 6 00:44:10.043: INFO: At 2019-11-06 00:34:40 +0000 UTC - event for azuredisk-volume-tester-5nd5c: {kubelet k8s-agentpool-73731178-vmss000001} FailedMount: Unable to mount volumes for pod "azuredisk-volume-tester-5nd5c_azuredisk-7323(93a93c37-6e37-479e-9d1b-9eeed106bb91)": timeout expired waiting for volumes to attach or mount for pod "azuredisk-7323"/"azuredisk-volume-tester-5nd5c". list of unmounted volumes=[test-volume-1 default-token-m7bpj]. list of unattached volumes=[test-volume-1 default-token-m7bpj] I1106 00:44:10.130] Nov 6 00:44:10.129: INFO: POD NODE PHASE GRACE CONDITIONS I1106 00:44:10.130] Nov 6 00:44:10.129: INFO: I1106 00:44:10.380] Nov 6 00:44:10.380: INFO: I1106 00:44:10.380] Logging node info for node k8s-agentpool-73731178-vmss000000 I1106 00:44:10.473] Nov 6 00:44:10.466: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000000,UID:e9bc0b16-6756-4155-b49c-e223c0ba9499,ResourceVersion:14527,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-1,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000000"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:18 +0000 UTC 2019-11-05 23:28:18 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:43:13 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:43:13 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:43:13 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:43:13 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.4} {Hostname k8s-agentpool-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:956ad861ae4a42099801f8e840b4e502,SystemUUID:439CF4B9-2B9F-B74E-9ED7-7379FD8BD0DF,BootID:bd3476e5-4fd4-4437-9b56-54fbe38a3a49,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1] 121711221} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/metrics-server-amd64@sha256:49a9f12f7067d11f42c803dbe61ed2c1299959ad85cb315b25ff7eef8e6b8892 k8s.gcr.io/metrics-server-amd64:v0.2.1] 42541759} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/disks/pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312],VolumesAttached:[],Config:nil,},} I1106 00:44:10.473] Nov 6 00:44:10.466: INFO: I1106 00:44:10.473] Logging kubelet events for node k8s-agentpool-73731178-vmss000000 I1106 00:44:10.551] Nov 6 00:44:10.550: INFO: I1106 00:44:10.551] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000000 I1106 00:44:10.644] Nov 6 00:44:10.643: INFO: blobfuse-flexvol-installer-cvgkv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:10.645] Nov 6 00:44:10.643: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 00:44:10.645] Nov 6 00:44:10.643: INFO: azure-ip-masq-agent-vn5zc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:10.645] Nov 6 00:44:10.643: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:44:10.645] Nov 6 00:44:10.643: INFO: keyvault-flexvolume-xr7v6 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:10.646] Nov 6 00:44:10.643: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 00:44:10.646] Nov 6 00:44:10.643: INFO: metrics-server-864ffbc5c-kb9cz started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:10.646] Nov 6 00:44:10.643: INFO: Container metrics-server ready: true, restart count 0 I1106 00:44:10.646] Nov 6 00:44:10.643: INFO: kube-proxy-jnqp8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:10.646] Nov 6 00:44:10.643: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:44:10.647] Nov 6 00:44:10.643: INFO: kubernetes-dashboard-66dd8b8df7-4rnsp started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:44:10.647] Nov 6 00:44:10.643: INFO: Container kubernetes-dashboard ready: true, restart count 1 I1106 00:44:10.647] Nov 6 00:44:10.643: INFO: csi-azuredisk-node-g6wbm started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 00:44:10.647] Nov 6 00:44:10.643: INFO: Container azuredisk ready: true, restart count 0 I1106 00:44:10.648] Nov 6 00:44:10.643: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:44:10.648] Nov 6 00:44:10.643: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 00:44:10.914] Nov 6 00:44:10.914: INFO: I1106 00:44:10.914] Latency metrics for node k8s-agentpool-73731178-vmss000000 I1106 00:44:10.914] Nov 6 00:44:10.914: INFO: I1106 00:44:10.914] Logging node info for node k8s-agentpool-73731178-vmss000001 I1106 00:44:11.002] Nov 6 00:44:10.997: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000001,UID:ab75ba9d-ec23-4ff7-ae5a-d1a19974c05d,ResourceVersion:14524,Generation:0,CreationTimestamp:2019-11-05 23:27:31 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-2,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000001"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.5.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:17 +0000 UTC 2019-11-05 23:28:17 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:43:13 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:43:13 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:43:13 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:43:13 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.5} {Hostname k8s-agentpool-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f0eae5e73d0f4ccb82dd0f22701c288f,SystemUUID:7E54C533-AED3-744D-8D17-EFF5E62EA06D,BootID:6d58e5a6-45fb-4a41-a491-bc2f3799f411,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[gcr.io/kubernetes-helm/tiller@sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1 gcr.io/kubernetes-helm/tiller:v2.11.0] 71821984} {[quay.io/k8scsi/csi-provisioner@sha256:d657c839dce87324fe2b677302913f9386f885f8746be7bea0ced5b0844e3433 quay.io/k8scsi/csi-provisioner:v1.3.1] 50596998} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0] 46226754} {[quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1] 45874691} {[quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb quay.io/k8scsi/csi-snapshotter:v1.1.0] 44325352} {[k8s.gcr.io/coredns@sha256:e83beb5e43f8513fa735e77ffc5859640baea30a882a11cc75c4c3244a737d3c k8s.gcr.io/coredns:1.5.0] 42488424} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0] 14967303} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:44:11.002] Nov 6 00:44:10.997: INFO: I1106 00:44:11.003] Logging kubelet events for node k8s-agentpool-73731178-vmss000001 I1106 00:44:11.082] Nov 6 00:44:11.082: INFO: I1106 00:44:11.083] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000001 I1106 00:44:11.174] Nov 6 00:44:11.174: INFO: keyvault-flexvolume-7tztj started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:11.175] Nov 6 00:44:11.174: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 00:44:11.175] Nov 6 00:44:11.174: INFO: kube-proxy-z4hf8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:11.175] Nov 6 00:44:11.174: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:44:11.176] Nov 6 00:44:11.174: INFO: tiller-deploy-54c96cb5df-wlzbj started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:44:11.176] Nov 6 00:44:11.174: INFO: Container tiller ready: true, restart count 0 I1106 00:44:11.176] Nov 6 00:44:11.174: INFO: csi-azuredisk-controller-59bf945f54-k2p5m started at 2019-11-05 23:30:58 +0000 UTC (0+6 container statuses recorded) I1106 00:44:11.177] Nov 6 00:44:11.174: INFO: Container azuredisk ready: true, restart count 0 I1106 00:44:11.177] Nov 6 00:44:11.174: INFO: Container cluster-driver-registrar ready: true, restart count 0 I1106 00:44:11.177] Nov 6 00:44:11.174: INFO: Container csi-attacher ready: true, restart count 0 I1106 00:44:11.177] Nov 6 00:44:11.174: INFO: Container csi-provisioner ready: true, restart count 0 I1106 00:44:11.177] Nov 6 00:44:11.174: INFO: Container csi-snapshotter ready: true, restart count 0 I1106 00:44:11.178] Nov 6 00:44:11.174: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:44:11.178] Nov 6 00:44:11.174: INFO: blobfuse-flexvol-installer-589vv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:11.178] Nov 6 00:44:11.174: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 00:44:11.178] Nov 6 00:44:11.174: INFO: coredns-7f68dcdbdb-f98nq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:11.179] Nov 6 00:44:11.174: INFO: Container coredns ready: true, restart count 0 I1106 00:44:11.179] Nov 6 00:44:11.174: INFO: azure-ip-masq-agent-6qqgc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:11.179] Nov 6 00:44:11.174: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:44:11.179] Nov 6 00:44:11.174: INFO: csi-azuredisk-node-ml68k started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 00:44:11.180] Nov 6 00:44:11.174: INFO: Container azuredisk ready: true, restart count 0 I1106 00:44:11.180] Nov 6 00:44:11.174: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:44:11.180] Nov 6 00:44:11.174: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 00:44:11.456] Nov 6 00:44:11.455: INFO: I1106 00:44:11.456] Latency metrics for node k8s-agentpool-73731178-vmss000001 I1106 00:44:11.456] Nov 6 00:44:11.455: INFO: I1106 00:44:11.456] Logging node info for node k8s-master-73731178-vmss000000 I1106 00:44:11.543] Nov 6 00:44:11.539: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000000,UID:1f765350-accc-4e67-898b-e4d84be84901,ResourceVersion:14575,Generation:0,CreationTimestamp:2019-11-05 23:27:30 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:43:30 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:43:30 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:43:30 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:43:30 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.4} {Hostname k8s-master-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:836af7329e85492184d73f1ea7f63a4e,SystemUUID:D1C68207-4499-C24D-B9D6-ADA0554A1BE5,BootID:a29dde5d-b4dc-483e-a50e-76e79359d759,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:44:11.544] Nov 6 00:44:11.539: INFO: I1106 00:44:11.544] Logging kubelet events for node k8s-master-73731178-vmss000000 I1106 00:44:11.623] Nov 6 00:44:11.623: INFO: I1106 00:44:11.623] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000000 I1106 00:44:11.720] Nov 6 00:44:11.720: INFO: kube-scheduler-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:44:11.721] Nov 6 00:44:11.720: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:44:11.721] Nov 6 00:44:11.720: INFO: cloud-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:44:11.721] Nov 6 00:44:11.720: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:44:11.721] Nov 6 00:44:11.720: INFO: kube-addon-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:44:11.722] Nov 6 00:44:11.720: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:44:11.722] Nov 6 00:44:11.720: INFO: kube-apiserver-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:44:11.722] Nov 6 00:44:11.720: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:44:11.722] Nov 6 00:44:11.720: INFO: azure-ip-masq-agent-xmkx2 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:11.722] Nov 6 00:44:11.720: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:44:11.723] Nov 6 00:44:11.720: INFO: kube-proxy-2fwv9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:11.723] Nov 6 00:44:11.720: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:44:11.723] Nov 6 00:44:11.720: INFO: kube-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:44:11.723] Nov 6 00:44:11.720: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:44:21.118] Nov 6 00:44:21.111: INFO: I1106 00:44:21.119] Latency metrics for node k8s-master-73731178-vmss000000 I1106 00:44:21.119] Nov 6 00:44:21.111: INFO: I1106 00:44:21.119] Logging node info for node k8s-master-73731178-vmss000001 I1106 00:44:21.203] Nov 6 00:44:21.198: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000001,UID:442cf114-6b0a-4c80-a9e5-be62e184f94c,ResourceVersion:14696,Generation:0,CreationTimestamp:2019-11-05 23:27:42 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:19 +0000 UTC 2019-11-05 23:28:19 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:44:13 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:44:13 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:44:13 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:44:13 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.5} {Hostname k8s-master-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1a9da6632c314858a31bccaea0be0f50,SystemUUID:8F48A76E-30E1-B948-89B2-33C0048059B4,BootID:1597124c-68a3-452c-ae03-6cfe9bc1e57f,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:44:21.204] Nov 6 00:44:21.198: INFO: I1106 00:44:21.204] Logging kubelet events for node k8s-master-73731178-vmss000001 I1106 00:44:21.282] Nov 6 00:44:21.282: INFO: I1106 00:44:21.283] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000001 I1106 00:44:21.452] Nov 6 00:44:21.452: INFO: kube-scheduler-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:44:24.494] Nov 6 00:44:21.452: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:44:24.496] Nov 6 00:44:21.452: INFO: cloud-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:44:24.497] Nov 6 00:44:21.452: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:44:24.498] Nov 6 00:44:21.452: INFO: kube-addon-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:44:24.498] Nov 6 00:44:21.452: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:44:24.499] Nov 6 00:44:21.452: INFO: kube-apiserver-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:44:24.499] Nov 6 00:44:21.452: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:44:24.500] Nov 6 00:44:21.452: INFO: kube-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:44:24.500] Nov 6 00:44:21.452: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:44:24.500] Nov 6 00:44:21.452: INFO: azure-ip-masq-agent-825g9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:24.501] Nov 6 00:44:21.452: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:44:24.501] Nov 6 00:44:21.452: INFO: kube-proxy-8924t started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:24.501] Nov 6 00:44:21.452: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:44:24.706] Nov 6 00:44:24.698: INFO: I1106 00:44:24.706] Latency metrics for node k8s-master-73731178-vmss000001 I1106 00:44:24.706] Nov 6 00:44:24.698: INFO: I1106 00:44:24.706] Logging node info for node k8s-master-73731178-vmss000002 I1106 00:44:24.787] Nov 6 00:44:24.783: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000002,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000002,UID:6cf1398e-1b6b-4537-837d-9ffceb9a4f00,ResourceVersion:14586,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000002,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.6.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/2,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:27:55 +0000 UTC 2019-11-05 23:27:55 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:43:33 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:43:33 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:43:33 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:43:33 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.6} {Hostname k8s-master-73731178-vmss000002}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7964689c8ba4f448e6f435b3d4fefac,SystemUUID:9369535A-87BF-1E4B-86DF-5D1A23713C9F,BootID:74f93904-298f-454d-8df6-8d4bba193331,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:44:24.787] Nov 6 00:44:24.783: INFO: I1106 00:44:24.787] Logging kubelet events for node k8s-master-73731178-vmss000002 I1106 00:44:24.870] Nov 6 00:44:24.869: INFO: I1106 00:44:24.870] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000002 I1106 00:44:25.039] Nov 6 00:44:25.039: INFO: kube-scheduler-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:44:25.040] Nov 6 00:44:25.039: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:44:25.040] Nov 6 00:44:25.039: INFO: cloud-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:44:25.040] Nov 6 00:44:25.039: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:44:25.040] Nov 6 00:44:25.039: INFO: azure-ip-masq-agent-74xks started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:25.041] Nov 6 00:44:25.039: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:44:25.041] Nov 6 00:44:25.039: INFO: kube-proxy-t958f started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:25.041] Nov 6 00:44:25.039: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:44:25.041] Nov 6 00:44:25.039: INFO: kube-addon-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:18 +0000 UTC (0+1 container statuses recorded) I1106 00:44:25.041] Nov 6 00:44:25.039: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:44:25.042] Nov 6 00:44:25.039: INFO: kube-apiserver-k8s-master-73731178-vmss000002 started at 2019-11-05 23:28:42 +0000 UTC (0+1 container statuses recorded) I1106 00:44:25.042] Nov 6 00:44:25.039: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:44:25.042] Nov 6 00:44:25.039: INFO: kube-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:44:25.042] Nov 6 00:44:25.039: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:44:25.318] Nov 6 00:44:25.317: INFO: I1106 00:44:29.234] Latency metrics for node k8s-master-73731178-vmss000002 I1106 00:44:29.234] Nov 6 00:44:25.318: INFO: I1106 00:44:29.234] Logging node info for node k8s-master-73731178-vmss000003 I1106 00:44:29.237] Nov 6 00:44:25.401: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000003,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000003,UID:54efc1b0-183c-4153-b804-31d0d42ce204,ResourceVersion:14576,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000003,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/3,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:43:31 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:43:31 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:43:31 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:43:31 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{Hostname k8s-master-73731178-vmss000003} {InternalIP 10.240.0.7}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a448072d2d27400fa2252a0cb3c8ff37,SystemUUID:98F6A517-FFCA-8E4D-A914-52A5F1482433,BootID:50c0f9e6-7c4d-45ec-8984-248ea540d637,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:44:29.238] Nov 6 00:44:25.402: INFO: I1106 00:44:29.238] Logging kubelet events for node k8s-master-73731178-vmss000003 I1106 00:44:29.238] Nov 6 00:44:25.485: INFO: I1106 00:44:29.238] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000003 I1106 00:44:29.239] Nov 6 00:44:25.585: INFO: cloud-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:44:29.239] Nov 6 00:44:25.585: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:44:29.239] Nov 6 00:44:25.585: INFO: kube-addon-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:43 +0000 UTC (0+1 container statuses recorded) I1106 00:44:29.239] Nov 6 00:44:25.585: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:44:29.240] Nov 6 00:44:25.585: INFO: kube-apiserver-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:44:29.240] Nov 6 00:44:25.585: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:44:29.240] Nov 6 00:44:25.585: INFO: kube-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:44:29.240] Nov 6 00:44:25.585: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:44:29.241] Nov 6 00:44:25.585: INFO: kube-scheduler-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:44:29.241] Nov 6 00:44:25.585: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:44:29.241] Nov 6 00:44:25.585: INFO: azure-ip-masq-agent-4nshf started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:29.241] Nov 6 00:44:25.585: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:44:29.242] Nov 6 00:44:25.585: INFO: kube-proxy-qm7rq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:44:29.242] Nov 6 00:44:25.585: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:44:29.242] Nov 6 00:44:25.855: INFO: I1106 00:44:29.242] Latency metrics for node k8s-master-73731178-vmss000003 I1106 00:44:29.242] Nov 6 00:44:25.855: INFO: I1106 00:44:29.243] Logging node info for node k8s-master-73731178-vmss000004 I1106 00:44:29.246] Nov 6 00:44:25.939: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000004,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000004,UID:4a582f8b-6cf2-4e91-8770-fde6f9c22194,ResourceVersion:14571,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000004,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/4,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:32 +0000 UTC 2019-11-05 23:28:32 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:43:29 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:43:29 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:43:29 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:43:29 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.8} {Hostname k8s-master-73731178-vmss000004}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:252c632059f2483d87e2d8d689053e48,SystemUUID:5BBFFB00-FBAB-0F4A-8F63-6B99DE219F64,BootID:165ca62a-8171-48e8-92f7-3ad786cb6b9a,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:44:29.247] Nov 6 00:44:25.939: INFO: I1106 00:44:29.247] Logging kubelet events for node k8s-master-73731178-vmss000004 I1106 00:44:29.248] Nov 6 00:44:26.026: INFO: I1106 00:44:29.248] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000004 I1106 00:44:29.248] Nov 6 00:44:26.113: INFO: cloud-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:44:29.248] Nov 6 00:44:26.113: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:44:29.249] Nov 6 00:44:26.113: INFO: kube-addon-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:44:29.249] Nov 6 00:44:26.113: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:44:29.249] Nov 6 00:44:26.113: INFO: kube-apiserver-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:44:29.250] Nov 6 00:44:26.113: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:44:29.251] Nov 6 00:44:26.113: INFO: kube-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:44:29.251] Nov 6 00:44:26.113: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:44:29.251] Nov 6 00:44:26.113: INFO: kube-scheduler-k8s-master-73731178-vmss000004 started at 2019-11-05 23:28:31 +0000 UTC (0+1 container statuses recorded) I1106 00:44:29.252] Nov 6 00:44:26.113: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:44:29.252] Nov 6 00:44:26.113: INFO: azure-ip-masq-agent-rh9pr started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:44:29.252] Nov 6 00:44:26.113: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:44:29.253] Nov 6 00:44:26.113: INFO: kube-proxy-rk5r6 started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:44:29.253] Nov 6 00:44:26.113: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:44:29.253] Nov 6 00:44:26.392: INFO: I1106 00:44:29.253] Latency metrics for node k8s-master-73731178-vmss000004 I1106 00:44:29.254] Nov 6 00:44:26.392: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1106 00:44:29.254] STEP: Destroying namespace "azuredisk-7323" for this suite. I1106 00:44:40.738] Nov 6 00:44:40.738: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1106 00:44:43.935] Nov 6 00:44:43.935: INFO: namespace azuredisk-7323 deletion completed in 17.457855479s I1106 00:44:52.519] [AfterEach] [azuredisk-csi-e2e] [single-az] Pre-Provisioned I1106 00:44:52.519] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning.go:54 I1106 00:44:52.519] I1106 00:44:52.520] • Failure [1550.077 seconds] I1106 00:44:52.520] [azuredisk-csi-e2e] [single-az] Pre-Provisioned I1106 00:44:52.520] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning.go:36 I1106 00:44:52.520] [env] should use a pre-provisioned volume and mount it as readOnly in a pod [It] I1106 00:44:52.520] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning.go:66 I1106 00:44:52.520] I1106 00:44:52.520] Unexpected error: I1106 00:44:52.521] <*errors.errorString | 0xc0002036f0>: { I1106 00:44:52.521] s: "Gave up after waiting 15m0s for pod \"azuredisk-volume-tester-5nd5c\" to be \"Error status code\"", I1106 00:44:52.521] } I1106 00:44:52.521] Gave up after waiting 15m0s for pod "azuredisk-volume-tester-5nd5c" to be "Error status code" I1106 00:44:52.521] occurred I1106 00:44:52.521] I1106 00:44:52.522] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:553 I1106 00:44:52.522] ------------------------------ I1106 00:44:52.522] [azuredisk-csi-e2e] Dynamic Provisioning [multi-az] I1106 00:44:52.522] should create a deployment object, write and read to it, delete the pod and write and read to it again I1106 00:44:52.522] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:193 I1106 00:44:52.522] [BeforeEach] [multi-az] I1106 00:44:52.523] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1106 00:44:52.523] STEP: Creating a kubernetes client I1106 00:44:52.523] Nov 6 00:44:49.924: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1106 00:44:52.523] STEP: Building a namespace api object, basename azuredisk I1106 00:44:52.523] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-2929 I1106 00:44:52.524] STEP: Waiting for a default service account to be provisioned in namespace I1106 00:44:52.524] [BeforeEach] [multi-az] I1106 00:44:52.524] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:58 I1106 00:44:52.524] [It] should create a deployment object, write and read to it, delete the pod and write and read to it again I1106 00:44:52.524] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:193 I1106 00:44:52.524] STEP: setting up the StorageClass I1106 00:44:52.525] STEP: creating a StorageClass I1106 00:44:52.525] STEP: setting up the PVC I1106 00:44:52.525] STEP: creating a PVC I1106 00:44:52.525] STEP: setting up the Deployment I1106 00:44:52.525] STEP: deploying the deployment I1106 00:44:52.526] Nov 6 00:44:50.887: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:44:52.974] Nov 6 00:44:52.971: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:44:54.972] Nov 6 00:44:54.971: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:44:56.972] Nov 6 00:44:56.971: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:44:58.972] Nov 6 00:44:58.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:00.972] Nov 6 00:45:00.971: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:02.972] Nov 6 00:45:02.971: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:04.972] Nov 6 00:45:04.971: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:06.973] Nov 6 00:45:06.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:08.976] Nov 6 00:45:08.975: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:10.974] Nov 6 00:45:10.973: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:23.227] Nov 6 00:45:12.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:23.230] Nov 6 00:45:14.971: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:23.231] Nov 6 00:45:16.971: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:23.233] Nov 6 00:45:18.971: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:23.234] Nov 6 00:45:20.971: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:23.235] Nov 6 00:45:22.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:24.963] Nov 6 00:45:24.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:26.962] Nov 6 00:45:26.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:28.963] Nov 6 00:45:28.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:34.310] Nov 6 00:45:30.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:34.311] Nov 6 00:45:32.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:34.964] Nov 6 00:45:34.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:43.002] Nov 6 00:45:36.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:43.003] Nov 6 00:45:38.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:43.004] Nov 6 00:45:40.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:43.005] Nov 6 00:45:42.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:44.963] Nov 6 00:45:44.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:52.546] Nov 6 00:45:46.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:52.547] Nov 6 00:45:48.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:52.550] Nov 6 00:45:50.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:52.971] Nov 6 00:45:52.966: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:45:54.963] Nov 6 00:45:54.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:06.770] Nov 6 00:45:56.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:06.771] Nov 6 00:45:58.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:06.772] Nov 6 00:46:00.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:06.773] Nov 6 00:46:02.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:06.776] Nov 6 00:46:04.966: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:06.963] Nov 6 00:46:06.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:08.963] Nov 6 00:46:08.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:17.886] Nov 6 00:46:10.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:17.887] Nov 6 00:46:12.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:17.888] Nov 6 00:46:14.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:17.889] Nov 6 00:46:16.965: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:18.963] Nov 6 00:46:18.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:20.964] Nov 6 00:46:20.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:30.144] Nov 6 00:46:22.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:30.145] Nov 6 00:46:24.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:30.146] Nov 6 00:46:26.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:30.146] Nov 6 00:46:28.965: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:30.963] Nov 6 00:46:30.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:32.963] Nov 6 00:46:32.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:34.963] Nov 6 00:46:34.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:36.963] Nov 6 00:46:36.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:38.963] Nov 6 00:46:38.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:41.892] Nov 6 00:46:40.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:42.963] Nov 6 00:46:42.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:44.963] Nov 6 00:46:44.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:58.871] Nov 6 00:46:46.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:58.872] Nov 6 00:46:48.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:58.873] Nov 6 00:46:50.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:58.874] Nov 6 00:46:52.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:58.874] Nov 6 00:46:54.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:58.875] Nov 6 00:46:56.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:46:58.965] Nov 6 00:46:58.964: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:00.963] Nov 6 00:47:00.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:02.964] Nov 6 00:47:02.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:06.601] Nov 6 00:47:04.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:06.963] Nov 6 00:47:06.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:08.963] Nov 6 00:47:08.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:10.966] Nov 6 00:47:10.964: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:12.964] Nov 6 00:47:12.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:14.963] Nov 6 00:47:14.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:17.201] Nov 6 00:47:16.969: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:18.964] Nov 6 00:47:18.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:20.963] Nov 6 00:47:20.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:22.969] Nov 6 00:47:22.966: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:24.963] Nov 6 00:47:24.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:26.969] Nov 6 00:47:26.968: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:29.393] Nov 6 00:47:28.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:30.964] Nov 6 00:47:30.964: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:32.963] Nov 6 00:47:32.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:34.963] Nov 6 00:47:34.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:36.963] Nov 6 00:47:36.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:38.968] Nov 6 00:47:38.967: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:40.963] Nov 6 00:47:40.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:43.103] Nov 6 00:47:42.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:44.964] Nov 6 00:47:44.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:46.963] Nov 6 00:47:46.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:48.963] Nov 6 00:47:48.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:51.385] Nov 6 00:47:50.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:52.964] Nov 6 00:47:52.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:54.963] Nov 6 00:47:54.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:56.963] Nov 6 00:47:56.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:47:58.965] Nov 6 00:47:58.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:00.970] Nov 6 00:48:00.969: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:02.967] Nov 6 00:48:02.966: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:04.963] Nov 6 00:48:04.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:06.964] Nov 6 00:48:06.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:08.963] Nov 6 00:48:08.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:10.963] Nov 6 00:48:10.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:12.963] Nov 6 00:48:12.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:14.964] Nov 6 00:48:14.964: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:16.963] Nov 6 00:48:16.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:18.963] Nov 6 00:48:18.963: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:20.973] Nov 6 00:48:20.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:22.972] Nov 6 00:48:22.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:24.979] Nov 6 00:48:24.978: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:26.990] Nov 6 00:48:26.982: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:28.982] Nov 6 00:48:28.980: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:30.982] Nov 6 00:48:30.978: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:32.982] Nov 6 00:48:32.978: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:34.974] Nov 6 00:48:34.973: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:36.973] Nov 6 00:48:36.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:38.973] Nov 6 00:48:38.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:40.976] Nov 6 00:48:40.975: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:42.973] Nov 6 00:48:42.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:44.973] Nov 6 00:48:44.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:46.978] Nov 6 00:48:46.974: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:48.973] Nov 6 00:48:48.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:50.972] Nov 6 00:48:50.971: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:52.973] Nov 6 00:48:52.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:55.153] Nov 6 00:48:54.973: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:56.973] Nov 6 00:48:56.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:48:58.972] Nov 6 00:48:58.971: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:00.981] Nov 6 00:49:00.978: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:02.976] Nov 6 00:49:02.974: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:04.973] Nov 6 00:49:04.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:06.982] Nov 6 00:49:06.974: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:08.978] Nov 6 00:49:08.977: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:10.976] Nov 6 00:49:10.975: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:12.973] Nov 6 00:49:12.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:14.972] Nov 6 00:49:14.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:16.975] Nov 6 00:49:16.974: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:18.974] Nov 6 00:49:18.973: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:20.972] Nov 6 00:49:20.971: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:22.983] Nov 6 00:49:22.978: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:24.973] Nov 6 00:49:24.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:26.975] Nov 6 00:49:26.974: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:28.975] Nov 6 00:49:28.974: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:30.973] Nov 6 00:49:30.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:32.973] Nov 6 00:49:32.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:34.979] Nov 6 00:49:34.979: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:36.973] Nov 6 00:49:36.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:38.985] Nov 6 00:49:38.978: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:40.973] Nov 6 00:49:40.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:42.974] Nov 6 00:49:42.973: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:44.982] Nov 6 00:49:44.978: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:46.973] Nov 6 00:49:46.973: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:48.973] Nov 6 00:49:48.972: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:50.972] Nov 6 00:49:50.971: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:51.057] Nov 6 00:49:51.056: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:51.057] Nov 6 00:49:51.056: INFO: Unexpected error occurred: error waiting for deployment "azuredisk-volume-tester-prv9t" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:49:51.058] Nov 6 00:49:51.056: INFO: deleting Deployment "azuredisk-2929"/"azuredisk-volume-tester-prv9t" I1106 00:49:51.058] Nov 6 00:49:51.056: INFO: Error getting logs for pod : resource name may not be empty I1106 00:49:51.236] STEP: validating provisioned PV I1106 00:49:51.236] Nov 6 00:49:51.234: INFO: Unexpected error occurred: resource name may not be empty I1106 00:49:51.237] Nov 6 00:49:51.235: INFO: deleting StorageClass azuredisk-2929-disk.csi.azure.com-dynamic-sc-hdx22 I1106 00:49:51.334] [AfterEach] [multi-az] I1106 00:49:51.334] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1106 00:49:51.334] STEP: Collecting events from namespace "azuredisk-2929". I1106 00:49:51.414] STEP: Found 6 events. I1106 00:49:51.415] Nov 6 00:49:51.412: INFO: At 2019-11-06 00:44:50 +0000 UTC - event for azuredisk-volume-tester-prv9t: {deployment-controller } ScalingReplicaSet: Scaled up replica set azuredisk-volume-tester-prv9t-8479847459 to 1 I1106 00:49:51.415] Nov 6 00:49:51.412: INFO: At 2019-11-06 00:44:50 +0000 UTC - event for azuredisk-volume-tester-prv9t-8479847459: {replicaset-controller } SuccessfulCreate: Created pod: azuredisk-volume-tester-prv9t-8479847459-z69p9 I1106 00:49:51.416] Nov 6 00:49:51.412: INFO: At 2019-11-06 00:44:50 +0000 UTC - event for pvc-d8vrf: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding I1106 00:49:51.416] Nov 6 00:49:51.412: INFO: At 2019-11-06 00:44:50 +0000 UTC - event for pvc-d8vrf: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator I1106 00:49:51.417] Nov 6 00:49:51.413: INFO: At 2019-11-06 00:44:50 +0000 UTC - event for pvc-d8vrf: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } Provisioning: External provisioner is provisioning volume for claim "azuredisk-2929/pvc-d8vrf" I1106 00:49:51.417] Nov 6 00:49:51.413: INFO: At 2019-11-06 00:45:00 +0000 UTC - event for pvc-d8vrf: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-2929-disk.csi.azure.com-dynamic-sc-hdx22": rpc error: code = DeadlineExceeded desc = context deadline exceeded I1106 00:49:51.500] Nov 6 00:49:51.500: INFO: POD NODE PHASE GRACE CONDITIONS I1106 00:49:51.501] Nov 6 00:49:51.500: INFO: azuredisk-volume-tester-prv9t-8479847459-z69p9 Pending [] I1106 00:49:51.501] Nov 6 00:49:51.500: INFO: I1106 00:49:51.758] Nov 6 00:49:51.758: INFO: I1106 00:49:51.758] Logging node info for node k8s-agentpool-73731178-vmss000000 I1106 00:49:51.845] Nov 6 00:49:51.842: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000000,UID:e9bc0b16-6756-4155-b49c-e223c0ba9499,ResourceVersion:15611,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-1,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000000"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:18 +0000 UTC 2019-11-05 23:28:18 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:49:14 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:49:14 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:49:14 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:49:14 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.4} {Hostname k8s-agentpool-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:956ad861ae4a42099801f8e840b4e502,SystemUUID:439CF4B9-2B9F-B74E-9ED7-7379FD8BD0DF,BootID:bd3476e5-4fd4-4437-9b56-54fbe38a3a49,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1] 121711221} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/metrics-server-amd64@sha256:49a9f12f7067d11f42c803dbe61ed2c1299959ad85cb315b25ff7eef8e6b8892 k8s.gcr.io/metrics-server-amd64:v0.2.1] 42541759} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/disks/pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312],VolumesAttached:[],Config:nil,},} I1106 00:49:55.534] Nov 6 00:49:51.842: INFO: I1106 00:49:55.534] Logging kubelet events for node k8s-agentpool-73731178-vmss000000 I1106 00:49:55.535] Nov 6 00:49:51.926: INFO: I1106 00:49:55.535] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000000 I1106 00:49:55.535] Nov 6 00:49:52.019: INFO: kubernetes-dashboard-66dd8b8df7-4rnsp started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.535] Nov 6 00:49:52.019: INFO: Container kubernetes-dashboard ready: true, restart count 1 I1106 00:49:55.536] Nov 6 00:49:52.019: INFO: csi-azuredisk-node-g6wbm started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 00:49:55.536] Nov 6 00:49:52.019: INFO: Container azuredisk ready: true, restart count 0 I1106 00:49:55.536] Nov 6 00:49:52.019: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:49:55.536] Nov 6 00:49:52.019: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 00:49:55.536] Nov 6 00:49:52.019: INFO: blobfuse-flexvol-installer-cvgkv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.536] Nov 6 00:49:52.019: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 00:49:55.537] Nov 6 00:49:52.019: INFO: azure-ip-masq-agent-vn5zc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.537] Nov 6 00:49:52.019: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:49:55.537] Nov 6 00:49:52.020: INFO: keyvault-flexvolume-xr7v6 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.537] Nov 6 00:49:52.020: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 00:49:55.538] Nov 6 00:49:52.020: INFO: metrics-server-864ffbc5c-kb9cz started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.538] Nov 6 00:49:52.020: INFO: Container metrics-server ready: true, restart count 0 I1106 00:49:55.538] Nov 6 00:49:52.020: INFO: kube-proxy-jnqp8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.538] Nov 6 00:49:52.020: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:49:55.538] Nov 6 00:49:52.349: INFO: I1106 00:49:55.538] Latency metrics for node k8s-agentpool-73731178-vmss000000 I1106 00:49:55.539] Nov 6 00:49:52.349: INFO: I1106 00:49:55.539] Logging node info for node k8s-agentpool-73731178-vmss000001 I1106 00:49:55.544] Nov 6 00:49:52.436: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000001,UID:ab75ba9d-ec23-4ff7-ae5a-d1a19974c05d,ResourceVersion:15609,Generation:0,CreationTimestamp:2019-11-05 23:27:31 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-2,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000001"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.5.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:17 +0000 UTC 2019-11-05 23:28:17 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:49:14 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:49:14 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:49:14 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:49:14 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.5} {Hostname k8s-agentpool-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f0eae5e73d0f4ccb82dd0f22701c288f,SystemUUID:7E54C533-AED3-744D-8D17-EFF5E62EA06D,BootID:6d58e5a6-45fb-4a41-a491-bc2f3799f411,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[gcr.io/kubernetes-helm/tiller@sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1 gcr.io/kubernetes-helm/tiller:v2.11.0] 71821984} {[quay.io/k8scsi/csi-provisioner@sha256:d657c839dce87324fe2b677302913f9386f885f8746be7bea0ced5b0844e3433 quay.io/k8scsi/csi-provisioner:v1.3.1] 50596998} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0] 46226754} {[quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1] 45874691} {[quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb quay.io/k8scsi/csi-snapshotter:v1.1.0] 44325352} {[k8s.gcr.io/coredns@sha256:e83beb5e43f8513fa735e77ffc5859640baea30a882a11cc75c4c3244a737d3c k8s.gcr.io/coredns:1.5.0] 42488424} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0] 14967303} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:49:55.544] Nov 6 00:49:52.436: INFO: I1106 00:49:55.544] Logging kubelet events for node k8s-agentpool-73731178-vmss000001 I1106 00:49:55.544] Nov 6 00:49:52.520: INFO: I1106 00:49:55.544] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000001 I1106 00:49:55.545] Nov 6 00:49:52.611: INFO: csi-azuredisk-node-ml68k started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 00:49:55.545] Nov 6 00:49:52.611: INFO: Container azuredisk ready: true, restart count 0 I1106 00:49:55.545] Nov 6 00:49:52.611: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:49:55.545] Nov 6 00:49:52.611: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 00:49:55.546] Nov 6 00:49:52.611: INFO: azure-ip-masq-agent-6qqgc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.546] Nov 6 00:49:52.611: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:49:55.546] Nov 6 00:49:52.611: INFO: keyvault-flexvolume-7tztj started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.546] Nov 6 00:49:52.611: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 00:49:55.546] Nov 6 00:49:52.611: INFO: kube-proxy-z4hf8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.547] Nov 6 00:49:52.611: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:49:55.547] Nov 6 00:49:52.611: INFO: tiller-deploy-54c96cb5df-wlzbj started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.547] Nov 6 00:49:52.611: INFO: Container tiller ready: true, restart count 0 I1106 00:49:55.548] Nov 6 00:49:52.611: INFO: csi-azuredisk-controller-59bf945f54-k2p5m started at 2019-11-05 23:30:58 +0000 UTC (0+6 container statuses recorded) I1106 00:49:55.548] Nov 6 00:49:52.611: INFO: Container azuredisk ready: true, restart count 0 I1106 00:49:55.548] Nov 6 00:49:52.611: INFO: Container cluster-driver-registrar ready: true, restart count 0 I1106 00:49:55.548] Nov 6 00:49:52.611: INFO: Container csi-attacher ready: true, restart count 0 I1106 00:49:55.548] Nov 6 00:49:52.611: INFO: Container csi-provisioner ready: true, restart count 0 I1106 00:49:55.549] Nov 6 00:49:52.611: INFO: Container csi-snapshotter ready: true, restart count 0 I1106 00:49:55.549] Nov 6 00:49:52.611: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:49:55.552] Nov 6 00:49:52.611: INFO: blobfuse-flexvol-installer-589vv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.553] Nov 6 00:49:52.611: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 00:49:55.553] Nov 6 00:49:52.611: INFO: coredns-7f68dcdbdb-f98nq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.553] Nov 6 00:49:52.611: INFO: Container coredns ready: true, restart count 0 I1106 00:49:55.553] Nov 6 00:49:52.907: INFO: I1106 00:49:55.554] Latency metrics for node k8s-agentpool-73731178-vmss000001 I1106 00:49:55.554] Nov 6 00:49:52.907: INFO: I1106 00:49:55.554] Logging node info for node k8s-master-73731178-vmss000000 I1106 00:49:55.557] Nov 6 00:49:52.991: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000000,UID:1f765350-accc-4e67-898b-e4d84be84901,ResourceVersion:15656,Generation:0,CreationTimestamp:2019-11-05 23:27:30 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:49:31 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:49:31 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:49:31 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:49:31 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.4} {Hostname k8s-master-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:836af7329e85492184d73f1ea7f63a4e,SystemUUID:D1C68207-4499-C24D-B9D6-ADA0554A1BE5,BootID:a29dde5d-b4dc-483e-a50e-76e79359d759,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:49:55.557] Nov 6 00:49:52.991: INFO: I1106 00:49:55.558] Logging kubelet events for node k8s-master-73731178-vmss000000 I1106 00:49:55.558] Nov 6 00:49:53.076: INFO: I1106 00:49:55.558] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000000 I1106 00:49:55.558] Nov 6 00:49:53.165: INFO: azure-ip-masq-agent-xmkx2 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.559] Nov 6 00:49:53.165: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:49:55.559] Nov 6 00:49:53.165: INFO: kube-proxy-2fwv9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.559] Nov 6 00:49:53.165: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:49:55.559] Nov 6 00:49:53.165: INFO: kube-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.560] Nov 6 00:49:53.165: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:49:55.560] Nov 6 00:49:53.165: INFO: kube-scheduler-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.560] Nov 6 00:49:53.165: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:49:55.560] Nov 6 00:49:53.165: INFO: cloud-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.561] Nov 6 00:49:53.165: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:49:55.561] Nov 6 00:49:53.165: INFO: kube-addon-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.561] Nov 6 00:49:53.165: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:49:55.562] Nov 6 00:49:53.165: INFO: kube-apiserver-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.562] Nov 6 00:49:53.165: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:49:55.562] Nov 6 00:49:53.458: INFO: I1106 00:49:55.562] Latency metrics for node k8s-master-73731178-vmss000000 I1106 00:49:55.562] Nov 6 00:49:53.458: INFO: I1106 00:49:55.563] Logging node info for node k8s-master-73731178-vmss000001 I1106 00:49:55.566] Nov 6 00:49:53.542: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000001,UID:442cf114-6b0a-4c80-a9e5-be62e184f94c,ResourceVersion:15610,Generation:0,CreationTimestamp:2019-11-05 23:27:42 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:19 +0000 UTC 2019-11-05 23:28:19 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:49:14 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:49:14 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:49:14 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:49:14 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.5} {Hostname k8s-master-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1a9da6632c314858a31bccaea0be0f50,SystemUUID:8F48A76E-30E1-B948-89B2-33C0048059B4,BootID:1597124c-68a3-452c-ae03-6cfe9bc1e57f,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:49:55.566] Nov 6 00:49:53.542: INFO: I1106 00:49:55.566] Logging kubelet events for node k8s-master-73731178-vmss000001 I1106 00:49:55.567] Nov 6 00:49:53.627: INFO: I1106 00:49:55.567] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000001 I1106 00:49:55.567] Nov 6 00:49:53.716: INFO: cloud-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.567] Nov 6 00:49:53.716: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:49:55.568] Nov 6 00:49:53.716: INFO: kube-addon-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.568] Nov 6 00:49:53.716: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:49:55.568] Nov 6 00:49:53.716: INFO: kube-apiserver-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.568] Nov 6 00:49:53.716: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:49:55.569] Nov 6 00:49:53.716: INFO: kube-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.569] Nov 6 00:49:53.716: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:49:55.569] Nov 6 00:49:53.716: INFO: azure-ip-masq-agent-825g9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.569] Nov 6 00:49:53.716: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:49:55.570] Nov 6 00:49:53.716: INFO: kube-proxy-8924t started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.570] Nov 6 00:49:53.716: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:49:55.570] Nov 6 00:49:53.716: INFO: kube-scheduler-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.570] Nov 6 00:49:53.716: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:49:55.571] Nov 6 00:49:53.986: INFO: I1106 00:49:55.571] Latency metrics for node k8s-master-73731178-vmss000001 I1106 00:49:55.571] Nov 6 00:49:53.986: INFO: I1106 00:49:55.571] Logging node info for node k8s-master-73731178-vmss000002 I1106 00:49:55.575] Nov 6 00:49:54.071: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000002,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000002,UID:6cf1398e-1b6b-4537-837d-9ffceb9a4f00,ResourceVersion:15671,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000002,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.6.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/2,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:27:55 +0000 UTC 2019-11-05 23:27:55 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:49:34 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:49:34 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:49:34 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:49:34 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.6} {Hostname k8s-master-73731178-vmss000002}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7964689c8ba4f448e6f435b3d4fefac,SystemUUID:9369535A-87BF-1E4B-86DF-5D1A23713C9F,BootID:74f93904-298f-454d-8df6-8d4bba193331,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:49:55.575] Nov 6 00:49:54.071: INFO: I1106 00:49:55.575] Logging kubelet events for node k8s-master-73731178-vmss000002 I1106 00:49:55.575] Nov 6 00:49:54.156: INFO: I1106 00:49:55.576] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000002 I1106 00:49:55.576] Nov 6 00:49:54.252: INFO: kube-apiserver-k8s-master-73731178-vmss000002 started at 2019-11-05 23:28:42 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.576] Nov 6 00:49:54.252: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:49:55.576] Nov 6 00:49:54.252: INFO: kube-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.577] Nov 6 00:49:54.252: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:49:55.577] Nov 6 00:49:54.252: INFO: kube-scheduler-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.577] Nov 6 00:49:54.252: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:49:55.577] Nov 6 00:49:54.252: INFO: cloud-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.578] Nov 6 00:49:54.252: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:49:55.578] Nov 6 00:49:54.252: INFO: azure-ip-masq-agent-74xks started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.578] Nov 6 00:49:54.252: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:49:55.578] Nov 6 00:49:54.252: INFO: kube-proxy-t958f started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.579] Nov 6 00:49:54.252: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:49:55.579] Nov 6 00:49:54.252: INFO: kube-addon-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:18 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.579] Nov 6 00:49:54.252: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:49:55.579] Nov 6 00:49:54.525: INFO: I1106 00:49:55.580] Latency metrics for node k8s-master-73731178-vmss000002 I1106 00:49:55.580] Nov 6 00:49:54.525: INFO: I1106 00:49:55.580] Logging node info for node k8s-master-73731178-vmss000003 I1106 00:49:55.583] Nov 6 00:49:54.610: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000003,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000003,UID:54efc1b0-183c-4153-b804-31d0d42ce204,ResourceVersion:15661,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000003,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/3,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:49:32 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:49:32 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:49:32 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:49:32 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{Hostname k8s-master-73731178-vmss000003} {InternalIP 10.240.0.7}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a448072d2d27400fa2252a0cb3c8ff37,SystemUUID:98F6A517-FFCA-8E4D-A914-52A5F1482433,BootID:50c0f9e6-7c4d-45ec-8984-248ea540d637,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:49:55.584] Nov 6 00:49:54.610: INFO: I1106 00:49:55.584] Logging kubelet events for node k8s-master-73731178-vmss000003 I1106 00:49:55.584] Nov 6 00:49:54.694: INFO: I1106 00:49:55.584] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000003 I1106 00:49:55.585] Nov 6 00:49:54.783: INFO: cloud-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.585] Nov 6 00:49:54.783: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:49:55.585] Nov 6 00:49:54.783: INFO: kube-addon-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:43 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.585] Nov 6 00:49:54.783: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:49:55.586] Nov 6 00:49:54.783: INFO: kube-apiserver-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.586] Nov 6 00:49:54.783: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:49:55.586] Nov 6 00:49:54.783: INFO: kube-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.586] Nov 6 00:49:54.784: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:49:55.587] Nov 6 00:49:54.784: INFO: kube-scheduler-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.587] Nov 6 00:49:54.784: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:49:55.587] Nov 6 00:49:54.784: INFO: azure-ip-masq-agent-4nshf started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.587] Nov 6 00:49:54.784: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:49:55.588] Nov 6 00:49:54.784: INFO: kube-proxy-qm7rq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.588] Nov 6 00:49:54.784: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:49:55.588] Nov 6 00:49:55.056: INFO: I1106 00:49:55.588] Latency metrics for node k8s-master-73731178-vmss000003 I1106 00:49:55.588] Nov 6 00:49:55.056: INFO: I1106 00:49:55.589] Logging node info for node k8s-master-73731178-vmss000004 I1106 00:49:55.592] Nov 6 00:49:55.142: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000004,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000004,UID:4a582f8b-6cf2-4e91-8770-fde6f9c22194,ResourceVersion:15654,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000004,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/4,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:32 +0000 UTC 2019-11-05 23:28:32 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:49:30 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:49:30 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:49:30 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:49:30 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.8} {Hostname k8s-master-73731178-vmss000004}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:252c632059f2483d87e2d8d689053e48,SystemUUID:5BBFFB00-FBAB-0F4A-8F63-6B99DE219F64,BootID:165ca62a-8171-48e8-92f7-3ad786cb6b9a,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:49:55.592] Nov 6 00:49:55.142: INFO: I1106 00:49:55.593] Logging kubelet events for node k8s-master-73731178-vmss000004 I1106 00:49:55.593] Nov 6 00:49:55.227: INFO: I1106 00:49:55.593] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000004 I1106 00:49:55.593] Nov 6 00:49:55.314: INFO: cloud-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.594] Nov 6 00:49:55.314: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:49:55.594] Nov 6 00:49:55.314: INFO: kube-addon-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.594] Nov 6 00:49:55.314: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:49:55.594] Nov 6 00:49:55.314: INFO: kube-apiserver-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.595] Nov 6 00:49:55.314: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:49:55.595] Nov 6 00:49:55.314: INFO: kube-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.595] Nov 6 00:49:55.314: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:49:55.595] Nov 6 00:49:55.314: INFO: kube-scheduler-k8s-master-73731178-vmss000004 started at 2019-11-05 23:28:31 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.596] Nov 6 00:49:55.314: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:49:55.596] Nov 6 00:49:55.314: INFO: azure-ip-masq-agent-rh9pr started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.596] Nov 6 00:49:55.314: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:49:55.596] Nov 6 00:49:55.314: INFO: kube-proxy-rk5r6 started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:49:55.597] Nov 6 00:49:55.314: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:49:55.605] Nov 6 00:49:55.605: INFO: I1106 00:49:55.605] Latency metrics for node k8s-master-73731178-vmss000004 I1106 00:49:55.605] Nov 6 00:49:55.605: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1106 00:49:55.694] STEP: Destroying namespace "azuredisk-2929" for this suite. I1106 00:50:09.954] Nov 6 00:50:09.953: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1106 00:50:13.175] Nov 6 00:50:13.174: INFO: namespace azuredisk-2929 deletion completed in 17.483857946s I1106 00:50:13.175] I1106 00:50:13.175] • Failure [323.250 seconds] I1106 00:50:13.175] [azuredisk-csi-e2e] Dynamic Provisioning I1106 00:50:13.175] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:33 I1106 00:50:13.175] [multi-az] I1106 00:50:13.176] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:40 I1106 00:50:13.176] should create a deployment object, write and read to it, delete the pod and write and read to it again [It] I1106 00:50:13.176] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:193 I1106 00:50:13.176] I1106 00:50:13.176] Unexpected error: I1106 00:50:13.176] <*errors.errorString | 0xc000985ce0>: { I1106 00:50:13.177] s: "error waiting for deployment \"azuredisk-volume-tester-prv9t\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"azuredisk-volume-tester-prv9t-8479847459\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}", I1106 00:50:13.177] } I1106 00:50:13.178] error waiting for deployment "azuredisk-volume-tester-prv9t" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63708597890, loc:(*time.Location)(0x34d4fc0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"azuredisk-volume-tester-prv9t-8479847459\" is progressing."}}, CollisionCount:(*int32)(nil)} I1106 00:50:13.178] occurred I1106 00:50:13.178] I1106 00:50:13.178] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:434 I1106 00:50:13.178] ------------------------------ I1106 00:50:13.179] [azuredisk-csi-e2e] Dynamic Provisioning [single-az] I1106 00:50:13.179] should create a volume on demand I1106 00:50:13.179] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:78 I1106 00:50:13.179] [BeforeEach] [single-az] I1106 00:50:13.179] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1106 00:50:13.179] STEP: Creating a kubernetes client I1106 00:50:13.180] Nov 6 00:50:13.175: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1106 00:50:13.180] STEP: Building a namespace api object, basename azuredisk I1106 00:50:13.430] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-8969 I1106 00:50:13.704] STEP: Waiting for a default service account to be provisioned in namespace I1106 00:50:13.786] [BeforeEach] [single-az] I1106 00:50:13.786] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:58 I1106 00:50:13.786] [It] should create a volume on demand I1106 00:50:13.786] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:78 I1106 00:50:13.786] STEP: setting up the StorageClass I1106 00:50:13.786] STEP: creating a StorageClass I1106 00:50:13.879] STEP: setting up the PVC and PV I1106 00:50:13.879] STEP: creating a PVC I1106 00:50:13.970] STEP: waiting for PVC to be in phase "Bound" I1106 00:50:13.970] Nov 6 00:50:13.969: INFO: Waiting up to 5m0s for PersistentVolumeClaims [pvc-6snqm] to have phase Bound I1106 00:50:14.053] Nov 6 00:50:14.053: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:16.138] Nov 6 00:50:16.138: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:18.582] Nov 6 00:50:18.223: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:20.308] Nov 6 00:50:20.308: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:22.393] Nov 6 00:50:22.392: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:24.478] Nov 6 00:50:24.478: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:26.567] Nov 6 00:50:26.566: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:28.652] Nov 6 00:50:28.652: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:30.744] Nov 6 00:50:30.739: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:32.830] Nov 6 00:50:32.826: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:34.911] Nov 6 00:50:34.911: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:37.006] Nov 6 00:50:37.002: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:39.100] Nov 6 00:50:39.094: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:41.190] Nov 6 00:50:41.182: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:43.268] Nov 6 00:50:43.267: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:45.353] Nov 6 00:50:45.352: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:47.446] Nov 6 00:50:47.446: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:49.531] Nov 6 00:50:49.531: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:51.617] Nov 6 00:50:51.616: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:53.702] Nov 6 00:50:53.701: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:55.787] Nov 6 00:50:55.787: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:57.882] Nov 6 00:50:57.879: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:50:59.963] Nov 6 00:50:59.963: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:02.048] Nov 6 00:51:02.048: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:04.134] Nov 6 00:51:04.134: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:06.219] Nov 6 00:51:06.219: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:08.304] Nov 6 00:51:08.304: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:10.394] Nov 6 00:51:10.393: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:12.479] Nov 6 00:51:12.479: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:14.563] Nov 6 00:51:14.563: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:16.648] Nov 6 00:51:16.648: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:18.734] Nov 6 00:51:18.734: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:20.819] Nov 6 00:51:20.819: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:22.907] Nov 6 00:51:22.907: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:24.992] Nov 6 00:51:24.992: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:27.077] Nov 6 00:51:27.077: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:29.161] Nov 6 00:51:29.161: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:31.247] Nov 6 00:51:31.246: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:33.340] Nov 6 00:51:33.338: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:35.434] Nov 6 00:51:35.434: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:37.524] Nov 6 00:51:37.524: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:39.618] Nov 6 00:51:39.614: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:41.699] Nov 6 00:51:41.699: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:43.787] Nov 6 00:51:43.787: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:45.872] Nov 6 00:51:45.872: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:47.957] Nov 6 00:51:47.957: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:50.042] Nov 6 00:51:50.042: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:52.127] Nov 6 00:51:52.126: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:54.212] Nov 6 00:51:54.212: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:56.297] Nov 6 00:51:56.296: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:51:58.381] Nov 6 00:51:58.381: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:00.466] Nov 6 00:52:00.465: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:03.444] Nov 6 00:52:02.550: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:04.635] Nov 6 00:52:04.635: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:06.721] Nov 6 00:52:06.720: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:08.814] Nov 6 00:52:08.806: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:10.890] Nov 6 00:52:10.890: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:12.975] Nov 6 00:52:12.975: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:15.060] Nov 6 00:52:15.059: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:17.145] Nov 6 00:52:17.144: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:19.230] Nov 6 00:52:19.230: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:21.315] Nov 6 00:52:21.314: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:23.399] Nov 6 00:52:23.399: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:25.484] Nov 6 00:52:25.484: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:27.568] Nov 6 00:52:27.568: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:29.653] Nov 6 00:52:29.652: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:31.737] Nov 6 00:52:31.737: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:33.822] Nov 6 00:52:33.822: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:35.907] Nov 6 00:52:35.906: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:37.991] Nov 6 00:52:37.991: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:40.076] Nov 6 00:52:40.075: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:42.161] Nov 6 00:52:42.161: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:44.247] Nov 6 00:52:44.247: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:46.332] Nov 6 00:52:46.332: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:48.417] Nov 6 00:52:48.416: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:50.501] Nov 6 00:52:50.501: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:52.587] Nov 6 00:52:52.586: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:54.671] Nov 6 00:52:54.671: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:56.760] Nov 6 00:52:56.758: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:52:58.850] Nov 6 00:52:58.848: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:00.938] Nov 6 00:53:00.933: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:03.022] Nov 6 00:53:03.022: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:05.114] Nov 6 00:53:05.111: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:07.198] Nov 6 00:53:07.196: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:09.281] Nov 6 00:53:09.281: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:13.387] Nov 6 00:53:11.365: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:13.454] Nov 6 00:53:13.450: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:15.535] Nov 6 00:53:15.535: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:17.620] Nov 6 00:53:17.619: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:19.704] Nov 6 00:53:19.704: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:21.789] Nov 6 00:53:21.789: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:23.874] Nov 6 00:53:23.873: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:25.958] Nov 6 00:53:25.958: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:28.056] Nov 6 00:53:28.055: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:30.141] Nov 6 00:53:30.141: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:32.241] Nov 6 00:53:32.241: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:34.326] Nov 6 00:53:34.325: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:36.422] Nov 6 00:53:36.414: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:38.515] Nov 6 00:53:38.510: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:40.595] Nov 6 00:53:40.594: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:42.681] Nov 6 00:53:42.680: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:44.767] Nov 6 00:53:44.767: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:46.853] Nov 6 00:53:46.852: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:48.937] Nov 6 00:53:48.937: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:51.023] Nov 6 00:53:51.022: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:53.109] Nov 6 00:53:53.109: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:55.194] Nov 6 00:53:55.194: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:57.278] Nov 6 00:53:57.278: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:53:59.363] Nov 6 00:53:59.363: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:01.448] Nov 6 00:54:01.448: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:03.533] Nov 6 00:54:03.533: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:05.621] Nov 6 00:54:05.621: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:07.706] Nov 6 00:54:07.706: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:09.791] Nov 6 00:54:09.790: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:11.876] Nov 6 00:54:11.876: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:13.960] Nov 6 00:54:13.960: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:16.055] Nov 6 00:54:16.054: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:18.140] Nov 6 00:54:18.139: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:20.252] Nov 6 00:54:20.252: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:22.337] Nov 6 00:54:22.337: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:24.422] Nov 6 00:54:24.422: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:26.507] Nov 6 00:54:26.506: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:28.592] Nov 6 00:54:28.591: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:30.677] Nov 6 00:54:30.676: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:32.762] Nov 6 00:54:32.762: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:34.847] Nov 6 00:54:34.847: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:36.932] Nov 6 00:54:36.931: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:39.016] Nov 6 00:54:39.016: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:41.107] Nov 6 00:54:41.107: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:43.192] Nov 6 00:54:43.192: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:45.276] Nov 6 00:54:45.276: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:47.362] Nov 6 00:54:47.361: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:49.447] Nov 6 00:54:49.446: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:51.532] Nov 6 00:54:51.532: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:53.617] Nov 6 00:54:53.617: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:55.702] Nov 6 00:54:55.702: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:57.787] Nov 6 00:54:57.787: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:54:59.872] Nov 6 00:54:59.871: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:55:01.956] Nov 6 00:55:01.956: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:55:04.043] Nov 6 00:55:04.043: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:55:06.128] Nov 6 00:55:06.128: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:55:08.213] Nov 6 00:55:08.213: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:55:10.298] Nov 6 00:55:10.297: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:55:12.382] Nov 6 00:55:12.382: INFO: PersistentVolumeClaim pvc-6snqm found but phase is Pending instead of Bound. I1106 00:55:14.382] Nov 6 00:55:14.382: INFO: Unexpected error occurred: PersistentVolumeClaims [pvc-6snqm] not all in phase Bound within 5m0s I1106 00:55:14.383] [AfterEach] [single-az] I1106 00:55:14.383] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1106 00:55:14.383] STEP: Collecting events from namespace "azuredisk-8969". I1106 00:55:14.470] STEP: Found 3 events. I1106 00:55:14.470] Nov 6 00:55:14.470: INFO: At 2019-11-06 00:50:13 +0000 UTC - event for pvc-6snqm: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator I1106 00:55:14.470] Nov 6 00:55:14.470: INFO: At 2019-11-06 00:50:13 +0000 UTC - event for pvc-6snqm: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } Provisioning: External provisioner is provisioning volume for claim "azuredisk-8969/pvc-6snqm" I1106 00:55:14.471] Nov 6 00:55:14.470: INFO: At 2019-11-06 00:50:23 +0000 UTC - event for pvc-6snqm: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-8969-disk.csi.azure.com-dynamic-sc-4d6c6": rpc error: code = DeadlineExceeded desc = context deadline exceeded I1106 00:55:14.555] Nov 6 00:55:14.555: INFO: POD NODE PHASE GRACE CONDITIONS I1106 00:55:14.555] Nov 6 00:55:14.555: INFO: I1106 00:55:14.809] Nov 6 00:55:14.808: INFO: I1106 00:55:14.809] Logging node info for node k8s-agentpool-73731178-vmss000000 I1106 00:55:14.895] Nov 6 00:55:14.892: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000000,UID:e9bc0b16-6756-4155-b49c-e223c0ba9499,ResourceVersion:16522,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-1,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000000"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:18 +0000 UTC 2019-11-05 23:28:18 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:54:15 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:54:15 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:54:15 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:54:15 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.4} {Hostname k8s-agentpool-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:956ad861ae4a42099801f8e840b4e502,SystemUUID:439CF4B9-2B9F-B74E-9ED7-7379FD8BD0DF,BootID:bd3476e5-4fd4-4437-9b56-54fbe38a3a49,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1] 121711221} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/metrics-server-amd64@sha256:49a9f12f7067d11f42c803dbe61ed2c1299959ad85cb315b25ff7eef8e6b8892 k8s.gcr.io/metrics-server-amd64:v0.2.1] 42541759} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/disks/pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312],VolumesAttached:[],Config:nil,},} I1106 00:55:14.896] Nov 6 00:55:14.893: INFO: I1106 00:55:14.896] Logging kubelet events for node k8s-agentpool-73731178-vmss000000 I1106 00:55:14.977] Nov 6 00:55:14.977: INFO: I1106 00:55:14.978] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000000 I1106 00:55:15.067] Nov 6 00:55:15.067: INFO: kube-proxy-jnqp8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:15.067] Nov 6 00:55:15.067: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:55:15.067] Nov 6 00:55:15.067: INFO: kubernetes-dashboard-66dd8b8df7-4rnsp started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:55:15.067] Nov 6 00:55:15.067: INFO: Container kubernetes-dashboard ready: true, restart count 1 I1106 00:55:15.067] Nov 6 00:55:15.067: INFO: csi-azuredisk-node-g6wbm started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 00:55:15.068] Nov 6 00:55:15.067: INFO: Container azuredisk ready: true, restart count 0 I1106 00:55:15.068] Nov 6 00:55:15.067: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:55:15.068] Nov 6 00:55:15.067: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 00:55:15.068] Nov 6 00:55:15.067: INFO: blobfuse-flexvol-installer-cvgkv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:15.068] Nov 6 00:55:15.067: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 00:55:15.069] Nov 6 00:55:15.067: INFO: azure-ip-masq-agent-vn5zc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:15.069] Nov 6 00:55:15.067: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:55:15.069] Nov 6 00:55:15.067: INFO: keyvault-flexvolume-xr7v6 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:15.069] Nov 6 00:55:15.067: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 00:55:15.069] Nov 6 00:55:15.067: INFO: metrics-server-864ffbc5c-kb9cz started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:15.069] Nov 6 00:55:15.067: INFO: Container metrics-server ready: true, restart count 0 I1106 00:55:15.339] Nov 6 00:55:15.339: INFO: I1106 00:55:15.340] Latency metrics for node k8s-agentpool-73731178-vmss000000 I1106 00:55:15.340] Nov 6 00:55:15.339: INFO: I1106 00:55:15.340] Logging node info for node k8s-agentpool-73731178-vmss000001 I1106 00:55:15.427] Nov 6 00:55:15.423: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000001,UID:ab75ba9d-ec23-4ff7-ae5a-d1a19974c05d,ResourceVersion:16694,Generation:0,CreationTimestamp:2019-11-05 23:27:31 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-2,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000001"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.5.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:17 +0000 UTC 2019-11-05 23:28:17 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:55:15 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:55:15 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:55:15 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:55:15 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.5} {Hostname k8s-agentpool-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f0eae5e73d0f4ccb82dd0f22701c288f,SystemUUID:7E54C533-AED3-744D-8D17-EFF5E62EA06D,BootID:6d58e5a6-45fb-4a41-a491-bc2f3799f411,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[gcr.io/kubernetes-helm/tiller@sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1 gcr.io/kubernetes-helm/tiller:v2.11.0] 71821984} {[quay.io/k8scsi/csi-provisioner@sha256:d657c839dce87324fe2b677302913f9386f885f8746be7bea0ced5b0844e3433 quay.io/k8scsi/csi-provisioner:v1.3.1] 50596998} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0] 46226754} {[quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1] 45874691} {[quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb quay.io/k8scsi/csi-snapshotter:v1.1.0] 44325352} {[k8s.gcr.io/coredns@sha256:e83beb5e43f8513fa735e77ffc5859640baea30a882a11cc75c4c3244a737d3c k8s.gcr.io/coredns:1.5.0] 42488424} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0] 14967303} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:55:15.427] Nov 6 00:55:15.423: INFO: I1106 00:55:15.427] Logging kubelet events for node k8s-agentpool-73731178-vmss000001 I1106 00:55:15.508] Nov 6 00:55:15.508: INFO: I1106 00:55:15.508] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000001 I1106 00:55:15.597] Nov 6 00:55:15.597: INFO: coredns-7f68dcdbdb-f98nq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:15.597] Nov 6 00:55:15.597: INFO: Container coredns ready: true, restart count 0 I1106 00:55:15.597] Nov 6 00:55:15.597: INFO: azure-ip-masq-agent-6qqgc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:15.598] Nov 6 00:55:15.597: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:55:15.598] Nov 6 00:55:15.597: INFO: keyvault-flexvolume-7tztj started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:15.598] Nov 6 00:55:15.597: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 00:55:15.598] Nov 6 00:55:15.597: INFO: kube-proxy-z4hf8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:15.598] Nov 6 00:55:15.597: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:55:15.599] Nov 6 00:55:15.597: INFO: tiller-deploy-54c96cb5df-wlzbj started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:55:15.599] Nov 6 00:55:15.597: INFO: Container tiller ready: true, restart count 0 I1106 00:55:15.599] Nov 6 00:55:15.597: INFO: csi-azuredisk-controller-59bf945f54-k2p5m started at 2019-11-05 23:30:58 +0000 UTC (0+6 container statuses recorded) I1106 00:55:15.599] Nov 6 00:55:15.597: INFO: Container azuredisk ready: true, restart count 0 I1106 00:55:15.599] Nov 6 00:55:15.597: INFO: Container cluster-driver-registrar ready: true, restart count 0 I1106 00:55:15.599] Nov 6 00:55:15.597: INFO: Container csi-attacher ready: true, restart count 0 I1106 00:55:15.599] Nov 6 00:55:15.597: INFO: Container csi-provisioner ready: true, restart count 0 I1106 00:55:15.600] Nov 6 00:55:15.597: INFO: Container csi-snapshotter ready: true, restart count 0 I1106 00:55:15.600] Nov 6 00:55:15.597: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:55:15.600] Nov 6 00:55:15.597: INFO: blobfuse-flexvol-installer-589vv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:15.600] Nov 6 00:55:15.597: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 00:55:15.600] Nov 6 00:55:15.597: INFO: csi-azuredisk-node-ml68k started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 00:55:15.600] Nov 6 00:55:15.597: INFO: Container azuredisk ready: true, restart count 0 I1106 00:55:15.601] Nov 6 00:55:15.597: INFO: Container liveness-probe ready: true, restart count 0 I1106 00:55:15.601] Nov 6 00:55:15.597: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 00:55:15.873] Nov 6 00:55:15.872: INFO: I1106 00:55:15.873] Latency metrics for node k8s-agentpool-73731178-vmss000001 I1106 00:55:15.873] Nov 6 00:55:15.872: INFO: I1106 00:55:15.873] Logging node info for node k8s-master-73731178-vmss000000 I1106 00:55:15.959] Nov 6 00:55:15.956: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000000,UID:1f765350-accc-4e67-898b-e4d84be84901,ResourceVersion:16572,Generation:0,CreationTimestamp:2019-11-05 23:27:30 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:54:32 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:54:32 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:54:32 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:54:32 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.4} {Hostname k8s-master-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:836af7329e85492184d73f1ea7f63a4e,SystemUUID:D1C68207-4499-C24D-B9D6-ADA0554A1BE5,BootID:a29dde5d-b4dc-483e-a50e-76e79359d759,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:55:15.959] Nov 6 00:55:15.957: INFO: I1106 00:55:15.959] Logging kubelet events for node k8s-master-73731178-vmss000000 I1106 00:55:16.060] Nov 6 00:55:16.060: INFO: I1106 00:55:16.061] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000000 I1106 00:55:16.150] Nov 6 00:55:16.150: INFO: kube-addon-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:55:16.150] Nov 6 00:55:16.150: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:55:16.151] Nov 6 00:55:16.150: INFO: kube-apiserver-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:55:16.151] Nov 6 00:55:16.150: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:55:16.151] Nov 6 00:55:16.150: INFO: azure-ip-masq-agent-xmkx2 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:16.151] Nov 6 00:55:16.150: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:55:16.151] Nov 6 00:55:16.150: INFO: kube-proxy-2fwv9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:16.152] Nov 6 00:55:16.150: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:55:16.152] Nov 6 00:55:16.150: INFO: kube-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:55:16.152] Nov 6 00:55:16.150: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:55:16.152] Nov 6 00:55:16.150: INFO: kube-scheduler-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:55:16.152] Nov 6 00:55:16.150: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:55:16.153] Nov 6 00:55:16.150: INFO: cloud-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:55:16.153] Nov 6 00:55:16.150: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:55:16.430] Nov 6 00:55:16.430: INFO: I1106 00:55:16.430] Latency metrics for node k8s-master-73731178-vmss000000 I1106 00:55:16.430] Nov 6 00:55:16.430: INFO: I1106 00:55:16.431] Logging node info for node k8s-master-73731178-vmss000001 I1106 00:55:16.517] Nov 6 00:55:16.514: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000001,UID:442cf114-6b0a-4c80-a9e5-be62e184f94c,ResourceVersion:16693,Generation:0,CreationTimestamp:2019-11-05 23:27:42 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:19 +0000 UTC 2019-11-05 23:28:19 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:55:15 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:55:15 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:55:15 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:55:15 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.5} {Hostname k8s-master-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1a9da6632c314858a31bccaea0be0f50,SystemUUID:8F48A76E-30E1-B948-89B2-33C0048059B4,BootID:1597124c-68a3-452c-ae03-6cfe9bc1e57f,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:55:16.517] Nov 6 00:55:16.515: INFO: I1106 00:55:16.517] Logging kubelet events for node k8s-master-73731178-vmss000001 I1106 00:55:16.599] Nov 6 00:55:16.599: INFO: I1106 00:55:16.599] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000001 I1106 00:55:16.688] Nov 6 00:55:16.688: INFO: kube-scheduler-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:55:16.688] Nov 6 00:55:16.688: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:55:16.689] Nov 6 00:55:16.688: INFO: cloud-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:55:16.689] Nov 6 00:55:16.688: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:55:16.689] Nov 6 00:55:16.688: INFO: kube-addon-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:55:16.689] Nov 6 00:55:16.688: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:55:16.689] Nov 6 00:55:16.688: INFO: kube-apiserver-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:55:16.690] Nov 6 00:55:16.688: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:55:16.690] Nov 6 00:55:16.688: INFO: kube-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 00:55:16.690] Nov 6 00:55:16.688: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:55:16.690] Nov 6 00:55:16.688: INFO: azure-ip-masq-agent-825g9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:16.690] Nov 6 00:55:16.688: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:55:16.690] Nov 6 00:55:16.688: INFO: kube-proxy-8924t started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:16.690] Nov 6 00:55:16.688: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:55:16.960] Nov 6 00:55:16.959: INFO: I1106 00:55:16.960] Latency metrics for node k8s-master-73731178-vmss000001 I1106 00:55:16.960] Nov 6 00:55:16.959: INFO: I1106 00:55:16.960] Logging node info for node k8s-master-73731178-vmss000002 I1106 00:55:17.047] Nov 6 00:55:17.044: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000002,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000002,UID:6cf1398e-1b6b-4537-837d-9ffceb9a4f00,ResourceVersion:16582,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000002,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.6.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/2,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:27:55 +0000 UTC 2019-11-05 23:27:55 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:54:35 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:54:35 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:54:35 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:54:35 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.6} {Hostname k8s-master-73731178-vmss000002}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7964689c8ba4f448e6f435b3d4fefac,SystemUUID:9369535A-87BF-1E4B-86DF-5D1A23713C9F,BootID:74f93904-298f-454d-8df6-8d4bba193331,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:55:17.047] Nov 6 00:55:17.045: INFO: I1106 00:55:17.047] Logging kubelet events for node k8s-master-73731178-vmss000002 I1106 00:55:17.130] Nov 6 00:55:17.130: INFO: I1106 00:55:17.130] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000002 I1106 00:55:17.220] Nov 6 00:55:17.219: INFO: kube-proxy-t958f started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:17.220] Nov 6 00:55:17.219: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:55:17.220] Nov 6 00:55:17.219: INFO: kube-addon-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:18 +0000 UTC (0+1 container statuses recorded) I1106 00:55:17.221] Nov 6 00:55:17.219: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:55:17.221] Nov 6 00:55:17.219: INFO: kube-apiserver-k8s-master-73731178-vmss000002 started at 2019-11-05 23:28:42 +0000 UTC (0+1 container statuses recorded) I1106 00:55:17.221] Nov 6 00:55:17.219: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:55:17.221] Nov 6 00:55:17.219: INFO: kube-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:55:17.221] Nov 6 00:55:17.219: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:55:17.222] Nov 6 00:55:17.219: INFO: kube-scheduler-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:55:17.222] Nov 6 00:55:17.219: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:55:17.222] Nov 6 00:55:17.219: INFO: cloud-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 00:55:17.222] Nov 6 00:55:17.219: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:55:17.222] Nov 6 00:55:17.219: INFO: azure-ip-masq-agent-74xks started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:17.222] Nov 6 00:55:17.219: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:55:17.491] Nov 6 00:55:17.491: INFO: I1106 00:55:17.492] Latency metrics for node k8s-master-73731178-vmss000002 I1106 00:55:17.492] Nov 6 00:55:17.491: INFO: I1106 00:55:17.492] Logging node info for node k8s-master-73731178-vmss000003 I1106 00:55:17.578] Nov 6 00:55:17.575: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000003,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000003,UID:54efc1b0-183c-4153-b804-31d0d42ce204,ResourceVersion:16574,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000003,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/3,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:54:32 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:54:32 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:54:32 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:54:32 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{Hostname k8s-master-73731178-vmss000003} {InternalIP 10.240.0.7}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a448072d2d27400fa2252a0cb3c8ff37,SystemUUID:98F6A517-FFCA-8E4D-A914-52A5F1482433,BootID:50c0f9e6-7c4d-45ec-8984-248ea540d637,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:55:17.578] Nov 6 00:55:17.575: INFO: I1106 00:55:17.578] Logging kubelet events for node k8s-master-73731178-vmss000003 I1106 00:55:17.660] Nov 6 00:55:17.660: INFO: I1106 00:55:17.660] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000003 I1106 00:55:17.757] Nov 6 00:55:17.756: INFO: kube-addon-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:43 +0000 UTC (0+1 container statuses recorded) I1106 00:55:17.757] Nov 6 00:55:17.756: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:55:17.757] Nov 6 00:55:17.756: INFO: kube-apiserver-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:55:17.757] Nov 6 00:55:17.756: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:55:17.757] Nov 6 00:55:17.756: INFO: kube-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:55:17.758] Nov 6 00:55:17.756: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:55:17.758] Nov 6 00:55:17.756: INFO: kube-scheduler-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:55:17.758] Nov 6 00:55:17.756: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:55:17.758] Nov 6 00:55:17.756: INFO: azure-ip-masq-agent-4nshf started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:17.758] Nov 6 00:55:17.756: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:55:17.758] Nov 6 00:55:17.756: INFO: kube-proxy-qm7rq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 00:55:17.758] Nov 6 00:55:17.756: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:55:17.758] Nov 6 00:55:17.756: INFO: cloud-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:55:17.759] Nov 6 00:55:17.756: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:55:18.026] Nov 6 00:55:18.026: INFO: I1106 00:55:18.026] Latency metrics for node k8s-master-73731178-vmss000003 I1106 00:55:18.026] Nov 6 00:55:18.026: INFO: I1106 00:55:18.026] Logging node info for node k8s-master-73731178-vmss000004 I1106 00:55:18.113] Nov 6 00:55:18.111: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000004,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000004,UID:4a582f8b-6cf2-4e91-8770-fde6f9c22194,ResourceVersion:16566,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000004,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/4,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:32 +0000 UTC 2019-11-05 23:28:32 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 00:54:30 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 00:54:30 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 00:54:30 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 00:54:30 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.8} {Hostname k8s-master-73731178-vmss000004}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:252c632059f2483d87e2d8d689053e48,SystemUUID:5BBFFB00-FBAB-0F4A-8F63-6B99DE219F64,BootID:165ca62a-8171-48e8-92f7-3ad786cb6b9a,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 00:55:18.114] Nov 6 00:55:18.111: INFO: I1106 00:55:18.114] Logging kubelet events for node k8s-master-73731178-vmss000004 I1106 00:55:18.196] Nov 6 00:55:18.196: INFO: I1106 00:55:18.196] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000004 I1106 00:55:18.289] Nov 6 00:55:18.288: INFO: kube-scheduler-k8s-master-73731178-vmss000004 started at 2019-11-05 23:28:31 +0000 UTC (0+1 container statuses recorded) I1106 00:55:18.289] Nov 6 00:55:18.288: INFO: Container kube-scheduler ready: true, restart count 0 I1106 00:55:18.289] Nov 6 00:55:18.288: INFO: azure-ip-masq-agent-rh9pr started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:55:18.289] Nov 6 00:55:18.288: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 00:55:18.289] Nov 6 00:55:18.288: INFO: kube-proxy-rk5r6 started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 00:55:18.290] Nov 6 00:55:18.288: INFO: Container kube-proxy ready: true, restart count 0 I1106 00:55:18.290] Nov 6 00:55:18.288: INFO: cloud-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:55:18.290] Nov 6 00:55:18.288: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 00:55:18.290] Nov 6 00:55:18.288: INFO: kube-addon-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:55:18.290] Nov 6 00:55:18.288: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 00:55:18.291] Nov 6 00:55:18.288: INFO: kube-apiserver-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:55:18.291] Nov 6 00:55:18.288: INFO: Container kube-apiserver ready: true, restart count 0 I1106 00:55:18.291] Nov 6 00:55:18.288: INFO: kube-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 00:55:18.291] Nov 6 00:55:18.288: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 00:55:18.555] Nov 6 00:55:18.555: INFO: I1106 00:55:18.555] Latency metrics for node k8s-master-73731178-vmss000004 I1106 00:55:18.555] Nov 6 00:55:18.555: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1106 00:55:18.641] STEP: Destroying namespace "azuredisk-8969" for this suite. I1106 00:55:32.899] Nov 6 00:55:32.899: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1106 00:55:36.088] Nov 6 00:55:36.087: INFO: namespace azuredisk-8969 deletion completed in 17.446497782s I1106 00:55:36.088] I1106 00:55:36.088] • Failure [322.913 seconds] I1106 00:55:36.088] [azuredisk-csi-e2e] Dynamic Provisioning I1106 00:55:36.088] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:33 I1106 00:55:36.088] [single-az] I1106 00:55:36.088] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:36 I1106 00:55:36.089] should create a volume on demand [It] I1106 00:55:36.089] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:78 I1106 00:55:36.089] I1106 00:55:36.089] Unexpected error: I1106 00:55:36.089] <*errors.errorString | 0xc00094fc10>: { I1106 00:55:36.089] s: "PersistentVolumeClaims [pvc-6snqm] not all in phase Bound within 5m0s", I1106 00:55:36.089] } I1106 00:55:36.090] PersistentVolumeClaims [pvc-6snqm] not all in phase Bound within 5m0s I1106 00:55:36.090] occurred I1106 00:55:36.090] I1106 00:55:36.090] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1106 00:55:36.090] ------------------------------ I1106 00:55:36.090] [azuredisk-csi-e2e] Dynamic Provisioning [multi-az] I1106 00:55:36.090] should create a volume on demand I1106 00:55:36.090] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:78 I1106 00:55:36.090] [BeforeEach] [multi-az] I1106 00:55:36.091] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1106 00:55:36.091] STEP: Creating a kubernetes client I1106 00:55:36.091] Nov 6 00:55:36.088: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1106 00:55:36.091] STEP: Building a namespace api object, basename azuredisk I1106 00:55:36.343] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-1499 I1106 00:55:36.616] STEP: Waiting for a default service account to be provisioned in namespace I1106 00:55:36.698] [BeforeEach] [multi-az] I1106 00:55:36.698] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:58 I1106 00:55:36.698] [It] should create a volume on demand I1106 00:55:36.698] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:78 I1106 00:55:36.698] STEP: setting up the StorageClass I1106 00:55:36.699] STEP: creating a StorageClass I1106 00:55:36.792] STEP: setting up the PVC and PV I1106 00:55:36.792] STEP: creating a PVC I1106 00:55:36.885] STEP: deploying the pod I1106 00:55:36.983] STEP: checking that the pods command exits with no error I1106 00:55:36.983] Nov 6 00:55:36.983: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-ksl4f" in namespace "azuredisk-1499" to be "success or failure" I1106 00:55:37.067] Nov 6 00:55:37.067: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 84.165753ms I1106 00:55:39.152] Nov 6 00:55:39.152: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.16922832s I1106 00:55:41.238] Nov 6 00:55:41.238: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4.255086794s I1106 00:55:43.322] Nov 6 00:55:43.322: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6.339293154s I1106 00:55:45.407] Nov 6 00:55:45.407: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8.423823917s I1106 00:55:47.501] Nov 6 00:55:47.501: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10.518190957s I1106 00:55:49.586] Nov 6 00:55:49.585: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12.602694319s I1106 00:55:51.671] Nov 6 00:55:51.671: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14.687865987s I1106 00:55:53.756] Nov 6 00:55:53.756: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 16.773256356s I1106 00:55:55.841] Nov 6 00:55:55.841: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 18.85796922s I1106 00:55:57.926] Nov 6 00:55:57.926: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 20.943035887s I1106 00:56:00.019] Nov 6 00:56:00.018: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 23.035686912s I1106 00:56:02.105] Nov 6 00:56:02.104: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 25.121551985s I1106 00:56:04.189] Nov 6 00:56:04.189: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 27.205895645s I1106 00:56:06.274] Nov 6 00:56:06.274: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 29.291380615s I1106 00:56:08.360] Nov 6 00:56:08.360: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 31.376826684s I1106 00:56:10.445] Nov 6 00:56:10.444: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 33.461555648s I1106 00:56:12.530] Nov 6 00:56:12.530: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 35.547086417s I1106 00:56:14.615] Nov 6 00:56:14.615: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 37.632002682s I1106 00:56:16.701] Nov 6 00:56:16.700: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 39.717658052s I1106 00:56:18.786] Nov 6 00:56:18.786: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 41.803261222s I1106 00:56:20.871] Nov 6 00:56:20.871: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 43.888080586s I1106 00:56:22.956] Nov 6 00:56:22.956: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 45.97301015s I1106 00:56:25.041] Nov 6 00:56:25.041: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 48.057762513s I1106 00:56:27.126] Nov 6 00:56:27.126: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 50.143305983s I1106 00:56:29.210] Nov 6 00:56:29.210: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 52.227473441s I1106 00:56:31.295] Nov 6 00:56:31.295: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 54.311888101s I1106 00:56:33.380] Nov 6 00:56:33.380: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 56.396962766s I1106 00:56:35.466] Nov 6 00:56:35.466: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 58.482961039s I1106 00:56:37.551] Nov 6 00:56:37.551: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.568008203s I1106 00:56:39.643] Nov 6 00:56:39.643: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.660211824s I1106 00:56:41.733] Nov 6 00:56:41.733: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.749785523s I1106 00:56:43.818] Nov 6 00:56:43.818: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.835002189s I1106 00:56:45.903] Nov 6 00:56:45.903: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.920111754s I1106 00:56:47.988] Nov 6 00:56:47.988: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.004835516s I1106 00:56:50.073] Nov 6 00:56:50.072: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.089611078s I1106 00:56:52.157] Nov 6 00:56:52.157: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.174187239s I1106 00:56:54.242] Nov 6 00:56:54.242: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.259006101s I1106 00:56:56.327] Nov 6 00:56:56.327: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.344291767s I1106 00:56:58.413] Nov 6 00:56:58.412: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m21.429698734s I1106 00:57:00.498] Nov 6 00:57:00.497: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m23.514519596s I1106 00:57:02.582] Nov 6 00:57:02.582: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m25.599208157s I1106 00:57:04.667] Nov 6 00:57:04.667: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m27.684325722s I1106 00:57:06.758] Nov 6 00:57:06.758: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m29.774877428s I1106 00:57:08.843] Nov 6 00:57:08.843: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m31.859940792s I1106 00:57:10.928] Nov 6 00:57:10.927: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m33.944516851s I1106 00:57:13.013] Nov 6 00:57:13.012: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.029644516s I1106 00:57:15.098] Nov 6 00:57:15.098: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.11488028s I1106 00:57:17.183] Nov 6 00:57:17.183: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.200091945s I1106 00:57:21.774] Nov 6 00:57:21.773: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.79057413s I1106 00:57:23.858] Nov 6 00:57:23.858: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.874778687s I1106 00:57:25.942] Nov 6 00:57:25.942: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.959405246s I1106 00:57:28.033] Nov 6 00:57:28.033: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m51.049809951s I1106 00:57:30.118] Nov 6 00:57:30.118: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m53.134764013s I1106 00:57:32.202] Nov 6 00:57:32.202: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m55.219181971s I1106 00:57:34.287] Nov 6 00:57:34.287: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m57.304091632s I1106 00:57:36.372] Nov 6 00:57:36.372: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m59.389386997s I1106 00:57:38.458] Nov 6 00:57:38.457: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m1.47449876s I1106 00:57:40.542] Nov 6 00:57:40.542: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m3.559385821s I1106 00:57:42.628] Nov 6 00:57:42.627: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m5.644559284s I1106 00:57:44.712] Nov 6 00:57:44.712: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m7.729145543s I1106 00:57:46.797] Nov 6 00:57:46.797: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m9.814157705s I1106 00:57:48.882] Nov 6 00:57:48.882: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m11.899338568s I1106 00:57:50.968] Nov 6 00:57:50.967: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m13.984642732s I1106 00:57:53.053] Nov 6 00:57:53.053: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.069795295s I1106 00:57:55.138] Nov 6 00:57:55.138: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.155156759s I1106 00:57:57.223] Nov 6 00:57:57.223: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.240296322s I1106 00:57:59.308] Nov 6 00:57:59.308: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.324746079s I1106 00:58:01.393] Nov 6 00:58:01.393: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.409893742s I1106 00:58:03.478] Nov 6 00:58:03.477: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.4945422s I1106 00:58:05.562] Nov 6 00:58:05.562: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.579437461s I1106 00:58:07.647] Nov 6 00:58:07.647: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.664328021s I1106 00:58:09.732] Nov 6 00:58:09.732: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.749446883s I1106 00:58:11.818] Nov 6 00:58:11.818: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.83517385s I1106 00:58:13.903] Nov 6 00:58:13.903: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.920186011s I1106 00:58:15.988] Nov 6 00:58:15.988: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m39.00505297s I1106 00:58:18.073] Nov 6 00:58:18.072: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m41.089665128s I1106 00:58:20.157] Nov 6 00:58:20.157: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m43.174461187s I1106 00:58:22.241] Nov 6 00:58:22.241: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m45.258196438s I1106 00:58:24.326] Nov 6 00:58:24.326: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m47.342960497s I1106 00:58:26.410] Nov 6 00:58:26.410: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m49.426779448s I1106 00:58:28.494] Nov 6 00:58:28.494: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m51.511292305s I1106 00:58:30.578] Nov 6 00:58:30.578: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m53.595172057s I1106 00:58:32.663] Nov 6 00:58:32.662: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m55.679640913s I1106 00:58:34.747] Nov 6 00:58:34.747: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m57.764156469s I1106 00:58:36.832] Nov 6 00:58:36.831: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m59.848736226s I1106 00:58:38.916] Nov 6 00:58:38.916: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m1.933403884s I1106 00:58:41.001] Nov 6 00:58:41.001: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.01791474s I1106 00:58:43.085] Nov 6 00:58:43.085: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.102318696s I1106 00:58:45.170] Nov 6 00:58:45.170: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.186898552s I1106 00:58:47.265] Nov 6 00:58:47.264: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.281600787s I1106 00:58:49.349] Nov 6 00:58:49.348: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.365525739s I1106 00:58:51.437] Nov 6 00:58:51.437: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.454415929s I1106 00:58:53.521] Nov 6 00:58:53.521: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.53840418s I1106 00:58:55.606] Nov 6 00:58:55.605: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.622578234s I1106 00:58:57.690] Nov 6 00:58:57.690: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.706859488s I1106 00:58:59.774] Nov 6 00:58:59.774: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.791200942s I1106 00:59:01.858] Nov 6 00:59:01.858: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.874816591s I1106 00:59:03.942] Nov 6 00:59:03.942: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.959402347s I1106 00:59:06.026] Nov 6 00:59:06.026: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m29.043327698s I1106 00:59:08.111] Nov 6 00:59:08.110: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m31.127538651s I1106 00:59:10.195] Nov 6 00:59:10.195: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m33.212281808s I1106 00:59:12.279] Nov 6 00:59:12.279: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m35.296161958s I1106 00:59:14.363] Nov 6 00:59:14.363: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m37.38026211s I1106 00:59:16.449] Nov 6 00:59:16.448: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m39.465675373s I1106 00:59:18.533] Nov 6 00:59:18.533: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m41.550268528s I1106 00:59:20.618] Nov 6 00:59:20.618: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m43.635152786s I1106 00:59:22.702] Nov 6 00:59:22.702: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m45.719192238s I1106 00:59:24.790] Nov 6 00:59:24.789: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m47.806645515s I1106 00:59:26.874] Nov 6 00:59:26.874: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m49.891041269s I1106 00:59:28.958] Nov 6 00:59:28.958: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m51.975266022s I1106 00:59:31.043] Nov 6 00:59:31.042: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.059704476s I1106 00:59:33.127] Nov 6 00:59:33.127: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.14415833s I1106 00:59:35.211] Nov 6 00:59:35.211: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.228265482s I1106 00:59:37.296] Nov 6 00:59:37.295: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.312567235s I1106 00:59:39.380] Nov 6 00:59:39.380: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.397339892s I1106 00:59:41.465] Nov 6 00:59:41.465: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.48231245s I1106 00:59:43.550] Nov 6 00:59:43.550: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.566965905s I1106 00:59:45.634] Nov 6 00:59:45.634: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.651443359s I1106 00:59:47.727] Nov 6 00:59:47.726: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.743568472s I1106 00:59:49.810] Nov 6 00:59:49.810: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.827507522s I1106 00:59:51.904] Nov 6 00:59:51.904: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.920783644s I1106 00:59:53.988] Nov 6 00:59:53.988: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m17.005228698s I1106 00:59:56.072] Nov 6 00:59:56.072: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m19.088834845s I1106 00:59:58.156] Nov 6 00:59:58.156: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m21.173234298s I1106 01:00:00.255] Nov 6 01:00:00.255: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m23.272316265s I1106 01:00:02.339] Nov 6 01:00:02.339: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m25.356200314s I1106 01:00:04.423] Nov 6 01:00:04.423: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m27.440127163s I1106 01:00:06.507] Nov 6 01:00:06.507: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m29.524320715s I1106 01:00:08.591] Nov 6 01:00:08.591: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m31.608087363s I1106 01:00:10.675] Nov 6 01:00:10.675: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m33.692064612s I1106 01:00:12.759] Nov 6 01:00:12.759: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m35.776321664s I1106 01:00:14.844] Nov 6 01:00:14.844: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m37.861477622s I1106 01:00:16.928] Nov 6 01:00:16.928: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m39.945020768s I1106 01:00:19.012] Nov 6 01:00:19.012: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.02929672s I1106 01:00:21.096] Nov 6 01:00:21.096: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.113153868s I1106 01:00:23.180] Nov 6 01:00:23.180: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.196962916s I1106 01:00:25.264] Nov 6 01:00:25.264: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.281147867s I1106 01:00:27.349] Nov 6 01:00:27.348: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.36567772s I1106 01:00:29.433] Nov 6 01:00:29.433: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.450131873s I1106 01:00:31.517] Nov 6 01:00:31.517: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.53385732s I1106 01:00:33.603] Nov 6 01:00:33.602: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.619689284s I1106 01:00:35.687] Nov 6 01:00:35.687: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.703911034s I1106 01:00:37.772] Nov 6 01:00:37.771: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.788568488s I1106 01:00:39.856] Nov 6 01:00:39.855: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m2.872630238s I1106 01:00:41.940] Nov 6 01:00:41.940: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m4.957205791s I1106 01:00:44.032] Nov 6 01:00:44.032: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m7.0489736s I1106 01:00:46.118] Nov 6 01:00:46.118: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m9.135025165s I1106 01:00:48.203] Nov 6 01:00:48.203: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m11.220107122s I1106 01:00:50.287] Nov 6 01:00:50.287: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m13.304308372s I1106 01:00:52.372] Nov 6 01:00:52.372: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m15.38940403s I1106 01:00:54.457] Nov 6 01:00:54.457: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m17.474281885s I1106 01:00:56.541] Nov 6 01:00:56.541: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m19.558278134s I1106 01:00:58.626] Nov 6 01:00:58.626: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m21.643486091s I1106 01:01:00.711] Nov 6 01:01:00.711: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m23.728104545s I1106 01:01:02.796] Nov 6 01:01:02.795: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m25.812527296s I1106 01:01:04.880] Nov 6 01:01:04.879: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m27.896702646s I1106 01:01:06.964] Nov 6 01:01:06.964: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m29.981341899s I1106 01:01:09.049] Nov 6 01:01:09.049: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m32.066079753s I1106 01:01:11.134] Nov 6 01:01:11.134: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m34.150749207s I1106 01:01:13.218] Nov 6 01:01:13.218: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m36.23548286s I1106 01:01:15.304] Nov 6 01:01:15.304: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m38.320810419s I1106 01:01:17.388] Nov 6 01:01:17.388: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m40.405387671s I1106 01:01:19.476] Nov 6 01:01:19.476: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m42.492785346s I1106 01:01:21.559] Nov 6 01:01:21.559: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m44.576391791s I1106 01:01:23.644] Nov 6 01:01:23.643: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m46.660474939s I1106 01:01:25.728] Nov 6 01:01:25.728: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m48.745118692s I1106 01:01:27.812] Nov 6 01:01:27.812: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m50.829378442s I1106 01:01:29.897] Nov 6 01:01:29.897: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m52.913976394s I1106 01:01:31.986] Nov 6 01:01:31.986: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m55.00293528s I1106 01:01:34.070] Nov 6 01:01:34.070: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m57.087470532s I1106 01:01:36.155] Nov 6 01:01:36.154: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m59.171627281s I1106 01:01:38.239] Nov 6 01:01:38.239: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m1.256445735s I1106 01:01:40.324] Nov 6 01:01:40.324: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m3.340852686s I1106 01:01:42.408] Nov 6 01:01:42.408: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m5.425164736s I1106 01:01:44.493] Nov 6 01:01:44.493: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m7.509969289s I1106 01:01:46.578] Nov 6 01:01:46.577: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m9.594509741s I1106 01:01:48.662] Nov 6 01:01:48.661: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m11.678548889s I1106 01:01:50.746] Nov 6 01:01:50.746: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m13.763003039s I1106 01:01:52.831] Nov 6 01:01:52.831: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m15.847806993s I1106 01:01:54.915] Nov 6 01:01:54.915: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m17.932217343s I1106 01:01:57.000] Nov 6 01:01:56.999: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.016615894s I1106 01:01:59.084] Nov 6 01:01:59.084: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.101158745s I1106 01:02:01.169] Nov 6 01:02:01.168: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m24.185679196s I1106 01:02:03.254] Nov 6 01:02:03.254: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m26.270949353s I1106 01:02:05.338] Nov 6 01:02:05.338: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m28.354762398s I1106 01:02:07.422] Nov 6 01:02:07.422: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m30.439247849s I1106 01:02:09.507] Nov 6 01:02:09.507: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m32.523956102s I1106 01:02:11.591] Nov 6 01:02:11.591: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m34.60820275s I1106 01:02:13.676] Nov 6 01:02:13.676: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m36.692879602s I1106 01:02:15.760] Nov 6 01:02:15.760: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m38.777484854s I1106 01:02:17.846] Nov 6 01:02:17.846: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m40.862947712s I1106 01:02:19.931] Nov 6 01:02:19.931: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m42.947884066s I1106 01:02:22.015] Nov 6 01:02:22.015: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m45.032442517s I1106 01:02:24.101] Nov 6 01:02:24.101: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m47.117956075s I1106 01:02:26.186] Nov 6 01:02:26.186: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m49.203333932s I1106 01:02:28.271] Nov 6 01:02:28.271: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m51.287922484s I1106 01:02:30.356] Nov 6 01:02:30.355: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m53.372716136s I1106 01:02:32.441] Nov 6 01:02:32.440: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m55.45762559s I1106 01:02:34.526] Nov 6 01:02:34.526: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m57.54347155s I1106 01:02:36.612] Nov 6 01:02:36.611: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 6m59.628633606s I1106 01:02:38.698] Nov 6 01:02:38.698: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m1.715415774s I1106 01:02:40.792] Nov 6 01:02:40.792: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m3.809168895s I1106 01:02:42.877] Nov 6 01:02:42.877: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m5.894326551s I1106 01:02:44.962] Nov 6 01:02:44.962: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m7.979021002s I1106 01:02:47.047] Nov 6 01:02:47.047: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.064205758s I1106 01:02:49.132] Nov 6 01:02:49.132: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m12.14900361s I1106 01:02:51.218] Nov 6 01:02:51.218: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m14.23483117s I1106 01:02:53.303] Nov 6 01:02:53.303: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m16.319983525s I1106 01:02:55.388] Nov 6 01:02:55.388: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m18.40510778s I1106 01:02:57.473] Nov 6 01:02:57.473: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m20.490040833s I1106 01:02:59.558] Nov 6 01:02:59.557: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m22.574731584s I1106 01:03:01.643] Nov 6 01:03:01.643: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m24.660120641s I1106 01:03:03.728] Nov 6 01:03:03.728: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m26.745320896s I1106 01:03:05.813] Nov 6 01:03:05.813: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m28.829893746s I1106 01:03:07.897] Nov 6 01:03:07.897: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m30.914332095s I1106 01:03:09.982] Nov 6 01:03:09.982: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m32.998743144s I1106 01:03:12.068] Nov 6 01:03:12.067: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m35.084532004s I1106 01:03:14.152] Nov 6 01:03:14.152: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m37.169243555s I1106 01:03:16.252] Nov 6 01:03:16.251: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m39.26869772s I1106 01:03:18.337] Nov 6 01:03:18.337: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m41.353884375s I1106 01:03:20.421] Nov 6 01:03:20.421: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m43.438116922s I1106 01:03:22.506] Nov 6 01:03:22.505: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m45.522688272s I1106 01:03:24.591] Nov 6 01:03:24.591: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m47.608007128s I1106 01:03:26.676] Nov 6 01:03:26.676: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m49.693231783s I1106 01:03:28.761] Nov 6 01:03:28.761: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m51.777809733s I1106 01:03:30.846] Nov 6 01:03:30.846: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m53.862788786s I1106 01:03:32.931] Nov 6 01:03:32.930: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m55.947643237s I1106 01:03:35.015] Nov 6 01:03:35.015: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.032150687s I1106 01:03:37.100] Nov 6 01:03:37.100: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m0.116875437s I1106 01:03:39.189] Nov 6 01:03:39.189: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m2.206358425s I1106 01:03:41.274] Nov 6 01:03:41.274: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m4.290898174s I1106 01:03:43.359] Nov 6 01:03:43.359: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m6.376012828s I1106 01:03:45.444] Nov 6 01:03:45.444: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m8.460769379s I1106 01:03:47.528] Nov 6 01:03:47.528: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m10.545405629s I1106 01:03:49.613] Nov 6 01:03:49.613: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m12.630373282s I1106 01:03:51.698] Nov 6 01:03:51.698: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m14.715448435s I1106 01:03:53.786] Nov 6 01:03:53.785: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m16.802512704s I1106 01:03:55.873] Nov 6 01:03:55.872: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m18.889645273s I1106 01:03:57.958] Nov 6 01:03:57.957: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m20.974703626s I1106 01:04:00.054] Nov 6 01:04:00.054: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m23.070840365s I1106 01:04:02.140] Nov 6 01:04:02.139: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m25.156505622s I1106 01:04:04.244] Nov 6 01:04:04.243: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m27.260340621s I1106 01:04:06.338] Nov 6 01:04:06.334: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m29.350984917s I1106 01:04:08.426] Nov 6 01:04:08.426: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m31.443016424s I1106 01:04:10.518] Nov 6 01:04:10.515: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m33.531922307s I1106 01:04:12.607] Nov 6 01:04:12.606: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m35.622987206s I1106 01:04:14.698] Nov 6 01:04:14.694: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m37.711002382s I1106 01:04:16.790] Nov 6 01:04:16.787: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m39.8045485s I1106 01:04:18.882] Nov 6 01:04:18.874: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m41.890995764s I1106 01:04:20.970] Nov 6 01:04:20.963: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m43.979820245s I1106 01:04:23.054] Nov 6 01:04:23.054: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m46.071149847s I1106 01:04:25.146] Nov 6 01:04:25.144: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m48.161239738s I1106 01:04:27.238] Nov 6 01:04:27.234: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m50.250996127s I1106 01:04:29.328] Nov 6 01:04:29.326: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m52.342999934s I1106 01:04:31.421] Nov 6 01:04:31.418: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m54.43501884s I1106 01:04:33.506] Nov 6 01:04:33.506: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m56.523014415s I1106 01:04:35.598] Nov 6 01:04:35.595: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 8m58.6122241s I1106 01:04:37.682] Nov 6 01:04:37.680: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m0.697451554s I1106 01:04:39.766] Nov 6 01:04:39.766: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m2.782957309s I1106 01:04:41.854] Nov 6 01:04:41.852: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m4.868992269s I1106 01:04:43.938] Nov 6 01:04:43.938: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m6.954984129s I1106 01:04:46.034] Nov 6 01:04:46.026: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m9.043462008s I1106 01:04:48.123] Nov 6 01:04:48.122: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m11.139509645s I1106 01:04:50.208] Nov 6 01:04:50.207: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m13.224519397s I1106 01:04:52.293] Nov 6 01:04:52.292: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m15.309539249s I1106 01:04:54.377] Nov 6 01:04:54.377: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m17.394315199s I1106 01:04:56.462] Nov 6 01:04:56.462: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m19.479406951s I1106 01:04:58.547] Nov 6 01:04:58.547: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m21.564398803s I1106 01:05:00.635] Nov 6 01:05:00.634: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m23.651734472s I1106 01:05:02.719] Nov 6 01:05:02.719: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m25.73618342s I1106 01:05:04.808] Nov 6 01:05:04.808: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m27.825260803s I1106 01:05:06.893] Nov 6 01:05:06.892: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m29.90969825s I1106 01:05:08.977] Nov 6 01:05:08.977: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m31.994109997s I1106 01:05:11.062] Nov 6 01:05:11.062: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m34.079121948s I1106 01:05:13.156] Nov 6 01:05:13.155: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m36.172560965s I1106 01:05:15.240] Nov 6 01:05:15.240: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m38.256895511s I1106 01:05:17.325] Nov 6 01:05:17.325: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m40.342133165s I1106 01:05:19.410] Nov 6 01:05:19.410: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m42.427247417s I1106 01:05:21.495] Nov 6 01:05:21.495: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m44.511871965s I1106 01:05:23.579] Nov 6 01:05:23.579: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m46.596330412s I1106 01:05:25.664] Nov 6 01:05:25.664: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m48.681176562s I1106 01:05:27.749] Nov 6 01:05:27.749: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m50.765862511s I1106 01:05:29.833] Nov 6 01:05:29.833: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m52.850309458s I1106 01:05:31.917] Nov 6 01:05:31.917: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m54.934029899s I1106 01:05:34.001] Nov 6 01:05:34.001: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m57.017996042s I1106 01:05:36.085] Nov 6 01:05:36.085: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 9m59.101980786s I1106 01:05:38.170] Nov 6 01:05:38.169: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m1.186530833s I1106 01:05:40.254] Nov 6 01:05:40.254: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m3.271291482s I1106 01:05:42.338] Nov 6 01:05:42.338: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m5.355145525s I1106 01:05:44.423] Nov 6 01:05:44.423: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m7.440386377s I1106 01:05:46.509] Nov 6 01:05:46.508: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m9.525706231s I1106 01:05:48.595] Nov 6 01:05:48.594: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m11.611630689s I1106 01:05:50.678] Nov 6 01:05:50.678: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m13.69532493s I1106 01:05:52.763] Nov 6 01:05:52.763: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m15.780029678s I1106 01:05:54.847] Nov 6 01:05:54.847: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m17.864032921s I1106 01:05:56.931] Nov 6 01:05:56.931: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m19.948349267s I1106 01:05:59.016] Nov 6 01:05:59.016: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m22.033341218s I1106 01:06:01.101] Nov 6 01:06:01.101: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m24.117935365s I1106 01:06:03.186] Nov 6 01:06:03.185: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m26.202523713s I1106 01:06:05.271] Nov 6 01:06:05.271: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m28.287948367s I1106 01:06:07.355] Nov 6 01:06:07.355: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m30.372265712s I1106 01:06:09.440] Nov 6 01:06:09.440: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m32.457430364s I1106 01:06:11.524] Nov 6 01:06:11.524: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m34.541232405s I1106 01:06:13.608] Nov 6 01:06:13.608: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m36.625057247s I1106 01:06:15.693] Nov 6 01:06:15.692: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m38.709668294s I1106 01:06:17.777] Nov 6 01:06:17.776: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m40.793659837s I1106 01:06:19.861] Nov 6 01:06:19.861: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m42.877921082s I1106 01:06:21.945] Nov 6 01:06:21.945: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m44.961996725s I1106 01:06:24.067] Nov 6 01:06:24.067: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m47.083888562s I1106 01:06:26.152] Nov 6 01:06:26.152: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m49.169358616s I1106 01:06:28.252] Nov 6 01:06:28.252: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m51.269359782s I1106 01:06:30.337] Nov 6 01:06:30.337: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m53.35397473s I1106 01:06:32.421] Nov 6 01:06:32.421: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m55.437859871s I1106 01:06:34.505] Nov 6 01:06:34.505: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m57.522166316s I1106 01:06:36.590] Nov 6 01:06:36.590: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 10m59.606766363s I1106 01:06:38.674] Nov 6 01:06:38.674: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m1.691164009s I1106 01:06:40.760] Nov 6 01:06:40.759: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m3.776530262s I1106 01:06:42.844] Nov 6 01:06:42.844: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m5.86116701s I1106 01:06:44.929] Nov 6 01:06:44.929: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m7.946323861s I1106 01:06:47.014] Nov 6 01:06:47.014: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m10.030891408s I1106 01:06:49.108] Nov 6 01:06:49.107: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m12.124609225s I1106 01:06:51.192] Nov 6 01:06:51.192: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m14.209448774s I1106 01:06:53.276] Nov 6 01:06:53.276: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m16.293273815s I1106 01:06:55.361] Nov 6 01:06:55.361: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m18.377864462s I1106 01:06:57.446] Nov 6 01:06:57.445: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m20.462494109s I1106 01:06:59.530] Nov 6 01:06:59.530: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m22.546968155s I1106 01:07:01.615] Nov 6 01:07:01.614: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m24.631532202s I1106 01:07:03.700] Nov 6 01:07:03.699: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m26.716606352s I1106 01:07:05.784] Nov 6 01:07:05.784: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m28.801008498s I1106 01:07:07.869] Nov 6 01:07:07.869: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m30.885861447s I1106 01:07:09.954] Nov 6 01:07:09.954: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m32.970942097s I1106 01:07:12.065] Nov 6 01:07:12.065: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m35.08209645s I1106 01:07:14.150] Nov 6 01:07:14.150: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m37.166931398s I1106 01:07:16.239] Nov 6 01:07:16.239: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m39.25611648s I1106 01:07:18.324] Nov 6 01:07:18.324: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m41.340822228s I1106 01:07:20.408] Nov 6 01:07:20.408: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m43.425206373s I1106 01:07:22.495] Nov 6 01:07:22.495: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m45.51246994s I1106 01:07:24.580] Nov 6 01:07:24.580: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m47.597106687s I1106 01:07:26.665] Nov 6 01:07:26.665: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m49.682377539s I1106 01:07:28.750] Nov 6 01:07:28.750: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m51.766934185s I1106 01:07:30.834] Nov 6 01:07:30.834: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m53.851229629s I1106 01:07:32.920] Nov 6 01:07:32.920: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m55.936878984s I1106 01:07:35.005] Nov 6 01:07:35.005: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 11m58.022462038s I1106 01:07:37.090] Nov 6 01:07:37.090: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m0.107145685s I1106 01:07:39.176] Nov 6 01:07:39.175: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m2.192513938s I1106 01:07:41.268] Nov 6 01:07:41.268: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m4.285443149s I1106 01:07:43.352] Nov 6 01:07:43.352: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m6.36933609s I1106 01:07:45.436] Nov 6 01:07:45.436: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m8.453369732s I1106 01:07:47.521] Nov 6 01:07:47.521: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m10.537779776s I1106 01:07:49.606] Nov 6 01:07:49.605: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m12.622736126s I1106 01:07:51.690] Nov 6 01:07:51.690: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m14.707327572s I1106 01:07:53.775] Nov 6 01:07:53.775: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m16.792351721s I1106 01:07:55.861] Nov 6 01:07:55.860: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m18.877501872s I1106 01:07:57.946] Nov 6 01:07:57.945: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m20.962495521s I1106 01:08:00.038] Nov 6 01:08:00.038: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m23.055302531s I1106 01:08:02.123] Nov 6 01:08:02.122: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m25.139698476s I1106 01:08:04.207] Nov 6 01:08:04.207: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m27.224350822s I1106 01:08:06.292] Nov 6 01:08:06.292: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m29.308921968s I1106 01:08:08.376] Nov 6 01:08:08.376: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m31.393285313s I1106 01:08:10.461] Nov 6 01:08:10.461: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m33.47801906s I1106 01:08:12.546] Nov 6 01:08:12.546: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m35.562844908s I1106 01:08:14.630] Nov 6 01:08:14.630: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m37.647316653s I1106 01:08:16.714] Nov 6 01:08:16.714: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m39.731253094s I1106 01:08:18.799] Nov 6 01:08:18.799: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m41.816099042s I1106 01:08:20.883] Nov 6 01:08:20.883: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m43.900471486s I1106 01:08:22.968] Nov 6 01:08:22.968: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m45.985043132s I1106 01:08:25.052] Nov 6 01:08:25.052: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m48.069132974s I1106 01:08:27.137] Nov 6 01:08:27.137: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m50.154078122s I1106 01:08:29.237] Nov 6 01:08:29.237: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m52.254186988s I1106 01:08:31.321] Nov 6 01:08:31.321: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m54.338319431s I1106 01:08:33.406] Nov 6 01:08:33.406: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m56.423229979s I1106 01:08:35.490] Nov 6 01:08:35.490: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 12m58.507390621s I1106 01:08:37.575] Nov 6 01:08:37.575: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m0.592059068s I1106 01:08:39.660] Nov 6 01:08:39.659: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m2.676458412s I1106 01:08:41.745] Nov 6 01:08:41.744: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m4.761486161s I1106 01:08:43.829] Nov 6 01:08:43.829: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m6.846239908s I1106 01:08:45.914] Nov 6 01:08:45.914: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m8.931180457s I1106 01:08:47.999] Nov 6 01:08:47.999: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m11.016004304s I1106 01:08:50.084] Nov 6 01:08:50.083: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m13.10057305s I1106 01:08:52.169] Nov 6 01:08:52.169: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m15.186364805s I1106 01:08:54.254] Nov 6 01:08:54.254: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m17.27097015s I1106 01:08:56.338] Nov 6 01:08:56.338: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m19.355358294s I1106 01:08:58.422] Nov 6 01:08:58.422: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m21.439154334s I1106 01:09:00.507] Nov 6 01:09:00.507: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m23.524295284s I1106 01:09:02.592] Nov 6 01:09:02.592: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m25.608840029s I1106 01:09:04.676] Nov 6 01:09:04.676: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m27.693402974s I1106 01:09:06.761] Nov 6 01:09:06.760: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m29.777615417s I1106 01:09:08.848] Nov 6 01:09:08.848: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m31.864840483s I1106 01:09:10.933] Nov 6 01:09:10.932: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m33.949552329s I1106 01:09:13.017] Nov 6 01:09:13.017: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m36.034030074s I1106 01:09:15.106] Nov 6 01:09:15.105: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m38.12256255s I1106 01:09:17.195] Nov 6 01:09:17.195: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m40.212397536s I1106 01:09:19.280] Nov 6 01:09:19.280: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m42.297148882s I1106 01:09:21.366] Nov 6 01:09:21.365: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m44.382417633s I1106 01:09:23.450] Nov 6 01:09:23.450: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m46.467032478s I1106 01:09:25.536] Nov 6 01:09:25.535: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m48.552543731s I1106 01:09:27.620] Nov 6 01:09:27.620: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m50.637320278s I1106 01:09:29.706] Nov 6 01:09:29.706: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m52.722916631s I1106 01:09:31.791] Nov 6 01:09:31.791: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m54.808205181s I1106 01:09:33.876] Nov 6 01:09:33.876: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m56.893076829s I1106 01:09:35.962] Nov 6 01:09:35.962: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 13m58.979334287s I1106 01:09:38.047] Nov 6 01:09:38.047: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m1.064249335s I1106 01:09:40.133] Nov 6 01:09:40.133: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m3.150020989s I1106 01:09:42.218] Nov 6 01:09:42.218: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m5.235074138s I1106 01:09:44.303] Nov 6 01:09:44.303: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m7.320466789s I1106 01:09:46.388] Nov 6 01:09:46.388: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m9.405371837s I1106 01:09:48.474] Nov 6 01:09:48.473: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m11.490696988s I1106 01:09:50.560] Nov 6 01:09:50.560: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m13.576866645s I1106 01:09:52.645] Nov 6 01:09:52.645: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m15.662375597s I1106 01:09:54.730] Nov 6 01:09:54.730: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m17.747482446s I1106 01:09:56.817] Nov 6 01:09:56.817: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m19.833820005s I1106 01:09:58.902] Nov 6 01:09:58.902: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m21.919180156s I1106 01:10:00.987] Nov 6 01:10:00.987: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m24.004013003s I1106 01:10:03.072] Nov 6 01:10:03.071: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m26.088698949s I1106 01:10:05.157] Nov 6 01:10:05.157: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m28.173782797s I1106 01:10:07.242] Nov 6 01:10:07.242: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m30.25935445s I1106 01:10:09.327] Nov 6 01:10:09.327: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m32.343888994s I1106 01:10:11.412] Nov 6 01:10:11.412: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m34.429269746s I1106 01:10:13.497] Nov 6 01:10:13.497: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m36.514393595s I1106 01:10:15.583] Nov 6 01:10:15.583: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m38.599843346s I1106 01:10:17.670] Nov 6 01:10:17.670: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m40.687378414s I1106 01:10:19.756] Nov 6 01:10:19.756: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m42.772875066s I1106 01:10:21.841] Nov 6 01:10:21.841: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m44.857773813s I1106 01:10:23.928] Nov 6 01:10:23.928: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m46.945029779s I1106 01:10:26.013] Nov 6 01:10:26.013: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m49.030108127s I1106 01:10:28.098] Nov 6 01:10:28.098: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m51.115210576s I1106 01:10:30.183] Nov 6 01:10:30.183: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m53.200025022s I1106 01:10:32.268] Nov 6 01:10:32.268: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m55.285195272s I1106 01:10:34.355] Nov 6 01:10:34.355: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m57.372016834s I1106 01:10:36.439] Nov 6 01:10:36.439: INFO: Pod "azuredisk-volume-tester-ksl4f": Phase="Pending", Reason="", readiness=false. Elapsed: 14m59.456475277s I1106 01:10:38.440] Nov 6 01:10:38.439: INFO: Unexpected error occurred: Gave up after waiting 15m0s for pod "azuredisk-volume-tester-ksl4f" to be "success or failure" I1106 01:10:38.440] Nov 6 01:10:38.440: INFO: deleting Pod "azuredisk-1499"/"azuredisk-volume-tester-ksl4f" I1106 01:10:38.525] Nov 6 01:10:38.525: INFO: Pod azuredisk-volume-tester-ksl4f has the following logs: I1106 01:10:38.525] STEP: Deleting pod azuredisk-volume-tester-ksl4f in namespace azuredisk-1499 I1106 01:10:38.712] STEP: validating provisioned PV I1106 01:10:38.713] Nov 6 01:10:38.712: INFO: Unexpected error occurred: resource name may not be empty I1106 01:10:38.713] Nov 6 01:10:38.712: INFO: deleting StorageClass azuredisk-1499-disk.csi.azure.com-dynamic-sc-mc826 I1106 01:10:38.806] [AfterEach] [multi-az] I1106 01:10:38.806] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1106 01:10:38.806] STEP: Collecting events from namespace "azuredisk-1499". I1106 01:10:38.890] STEP: Found 6 events. I1106 01:10:38.890] Nov 6 01:10:38.890: INFO: At 2019-11-06 00:55:36 +0000 UTC - event for pvc-h4dl8: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding I1106 01:10:38.891] Nov 6 01:10:38.890: INFO: At 2019-11-06 00:55:36 +0000 UTC - event for pvc-h4dl8: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator I1106 01:10:38.891] Nov 6 01:10:38.890: INFO: At 2019-11-06 00:55:36 +0000 UTC - event for pvc-h4dl8: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } Provisioning: External provisioner is provisioning volume for claim "azuredisk-1499/pvc-h4dl8" I1106 01:10:38.891] Nov 6 01:10:38.890: INFO: At 2019-11-06 00:55:46 +0000 UTC - event for pvc-h4dl8: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-1499-disk.csi.azure.com-dynamic-sc-mc826": rpc error: code = DeadlineExceeded desc = context deadline exceeded I1106 01:10:38.891] Nov 6 01:10:38.890: INFO: At 2019-11-06 01:05:36 +0000 UTC - event for azuredisk-volume-tester-ksl4f: {default-scheduler } FailedScheduling: timed out waiting for the condition I1106 01:10:38.891] Nov 6 01:10:38.890: INFO: At 2019-11-06 01:10:38 +0000 UTC - event for azuredisk-volume-tester-ksl4f: {default-scheduler } FailedScheduling: skip schedule deleting pod: azuredisk-1499/azuredisk-volume-tester-ksl4f I1106 01:10:38.975] Nov 6 01:10:38.974: INFO: POD NODE PHASE GRACE CONDITIONS I1106 01:10:38.975] Nov 6 01:10:38.974: INFO: I1106 01:10:39.225] Nov 6 01:10:39.225: INFO: I1106 01:10:39.226] Logging node info for node k8s-agentpool-73731178-vmss000000 I1106 01:10:39.313] Nov 6 01:10:39.309: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000000,UID:e9bc0b16-6756-4155-b49c-e223c0ba9499,ResourceVersion:19296,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-1,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000000"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:18 +0000 UTC 2019-11-05 23:28:18 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:10:17 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:10:17 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:10:17 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:10:17 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.4} {Hostname k8s-agentpool-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:956ad861ae4a42099801f8e840b4e502,SystemUUID:439CF4B9-2B9F-B74E-9ED7-7379FD8BD0DF,BootID:bd3476e5-4fd4-4437-9b56-54fbe38a3a49,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1] 121711221} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/metrics-server-amd64@sha256:49a9f12f7067d11f42c803dbe61ed2c1299959ad85cb315b25ff7eef8e6b8892 k8s.gcr.io/metrics-server-amd64:v0.2.1] 42541759} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/disks/pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312],VolumesAttached:[],Config:nil,},} I1106 01:10:39.313] Nov 6 01:10:39.310: INFO: I1106 01:10:39.313] Logging kubelet events for node k8s-agentpool-73731178-vmss000000 I1106 01:10:39.397] Nov 6 01:10:39.396: INFO: I1106 01:10:39.397] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000000 I1106 01:10:39.486] Nov 6 01:10:39.486: INFO: blobfuse-flexvol-installer-cvgkv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:39.486] Nov 6 01:10:39.486: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 01:10:39.486] Nov 6 01:10:39.486: INFO: azure-ip-masq-agent-vn5zc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:39.487] Nov 6 01:10:39.486: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:10:39.487] Nov 6 01:10:39.486: INFO: keyvault-flexvolume-xr7v6 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:39.487] Nov 6 01:10:39.486: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 01:10:39.487] Nov 6 01:10:39.486: INFO: metrics-server-864ffbc5c-kb9cz started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:39.487] Nov 6 01:10:39.486: INFO: Container metrics-server ready: true, restart count 0 I1106 01:10:39.487] Nov 6 01:10:39.486: INFO: kube-proxy-jnqp8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:39.487] Nov 6 01:10:39.486: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:10:39.488] Nov 6 01:10:39.486: INFO: kubernetes-dashboard-66dd8b8df7-4rnsp started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:10:39.488] Nov 6 01:10:39.486: INFO: Container kubernetes-dashboard ready: true, restart count 1 I1106 01:10:39.488] Nov 6 01:10:39.486: INFO: csi-azuredisk-node-g6wbm started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 01:10:39.488] Nov 6 01:10:39.486: INFO: Container azuredisk ready: true, restart count 0 I1106 01:10:39.488] Nov 6 01:10:39.486: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:10:39.488] Nov 6 01:10:39.486: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 01:10:39.771] Nov 6 01:10:39.771: INFO: I1106 01:10:39.771] Latency metrics for node k8s-agentpool-73731178-vmss000000 I1106 01:10:39.771] Nov 6 01:10:39.771: INFO: I1106 01:10:39.771] Logging node info for node k8s-agentpool-73731178-vmss000001 I1106 01:10:39.859] Nov 6 01:10:39.855: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000001,UID:ab75ba9d-ec23-4ff7-ae5a-d1a19974c05d,ResourceVersion:19297,Generation:0,CreationTimestamp:2019-11-05 23:27:31 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-2,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000001"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.5.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:17 +0000 UTC 2019-11-05 23:28:17 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:10:17 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:10:17 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:10:17 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:10:17 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.5} {Hostname k8s-agentpool-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f0eae5e73d0f4ccb82dd0f22701c288f,SystemUUID:7E54C533-AED3-744D-8D17-EFF5E62EA06D,BootID:6d58e5a6-45fb-4a41-a491-bc2f3799f411,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[gcr.io/kubernetes-helm/tiller@sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1 gcr.io/kubernetes-helm/tiller:v2.11.0] 71821984} {[quay.io/k8scsi/csi-provisioner@sha256:d657c839dce87324fe2b677302913f9386f885f8746be7bea0ced5b0844e3433 quay.io/k8scsi/csi-provisioner:v1.3.1] 50596998} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0] 46226754} {[quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1] 45874691} {[quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb quay.io/k8scsi/csi-snapshotter:v1.1.0] 44325352} {[k8s.gcr.io/coredns@sha256:e83beb5e43f8513fa735e77ffc5859640baea30a882a11cc75c4c3244a737d3c k8s.gcr.io/coredns:1.5.0] 42488424} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0] 14967303} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:10:39.859] Nov 6 01:10:39.855: INFO: I1106 01:10:39.859] Logging kubelet events for node k8s-agentpool-73731178-vmss000001 I1106 01:10:39.940] Nov 6 01:10:39.940: INFO: I1106 01:10:39.940] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000001 I1106 01:10:40.040] Nov 6 01:10:40.039: INFO: csi-azuredisk-node-ml68k started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 01:10:40.040] Nov 6 01:10:40.039: INFO: Container azuredisk ready: true, restart count 0 I1106 01:10:40.040] Nov 6 01:10:40.039: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:10:40.040] Nov 6 01:10:40.039: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 01:10:40.040] Nov 6 01:10:40.039: INFO: azure-ip-masq-agent-6qqgc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:40.040] Nov 6 01:10:40.039: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:10:40.040] Nov 6 01:10:40.039: INFO: keyvault-flexvolume-7tztj started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:40.040] Nov 6 01:10:40.039: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 01:10:40.041] Nov 6 01:10:40.039: INFO: kube-proxy-z4hf8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:40.041] Nov 6 01:10:40.039: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:10:40.041] Nov 6 01:10:40.039: INFO: tiller-deploy-54c96cb5df-wlzbj started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:10:40.041] Nov 6 01:10:40.039: INFO: Container tiller ready: true, restart count 0 I1106 01:10:40.041] Nov 6 01:10:40.039: INFO: csi-azuredisk-controller-59bf945f54-k2p5m started at 2019-11-05 23:30:58 +0000 UTC (0+6 container statuses recorded) I1106 01:10:40.041] Nov 6 01:10:40.039: INFO: Container azuredisk ready: true, restart count 0 I1106 01:10:40.042] Nov 6 01:10:40.039: INFO: Container cluster-driver-registrar ready: true, restart count 0 I1106 01:10:40.042] Nov 6 01:10:40.039: INFO: Container csi-attacher ready: true, restart count 0 I1106 01:10:40.042] Nov 6 01:10:40.039: INFO: Container csi-provisioner ready: true, restart count 0 I1106 01:10:40.042] Nov 6 01:10:40.039: INFO: Container csi-snapshotter ready: true, restart count 0 I1106 01:10:40.042] Nov 6 01:10:40.039: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:10:40.042] Nov 6 01:10:40.039: INFO: blobfuse-flexvol-installer-589vv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:40.042] Nov 6 01:10:40.039: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 01:10:40.043] Nov 6 01:10:40.039: INFO: coredns-7f68dcdbdb-f98nq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:40.043] Nov 6 01:10:40.039: INFO: Container coredns ready: true, restart count 0 I1106 01:10:40.320] Nov 6 01:10:40.320: INFO: I1106 01:10:40.321] Latency metrics for node k8s-agentpool-73731178-vmss000001 I1106 01:10:40.321] Nov 6 01:10:40.320: INFO: I1106 01:10:40.321] Logging node info for node k8s-master-73731178-vmss000000 I1106 01:10:40.406] Nov 6 01:10:40.404: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000000,UID:1f765350-accc-4e67-898b-e4d84be84901,ResourceVersion:19348,Generation:0,CreationTimestamp:2019-11-05 23:27:30 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:10:34 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:10:34 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:10:34 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:10:34 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.4} {Hostname k8s-master-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:836af7329e85492184d73f1ea7f63a4e,SystemUUID:D1C68207-4499-C24D-B9D6-ADA0554A1BE5,BootID:a29dde5d-b4dc-483e-a50e-76e79359d759,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:10:40.407] Nov 6 01:10:40.404: INFO: I1106 01:10:40.407] Logging kubelet events for node k8s-master-73731178-vmss000000 I1106 01:10:40.488] Nov 6 01:10:40.488: INFO: I1106 01:10:40.489] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000000 I1106 01:10:40.578] Nov 6 01:10:40.577: INFO: kube-proxy-2fwv9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:40.578] Nov 6 01:10:40.578: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:10:40.578] Nov 6 01:10:40.578: INFO: kube-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:10:40.578] Nov 6 01:10:40.578: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:10:40.579] Nov 6 01:10:40.578: INFO: kube-scheduler-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:10:40.579] Nov 6 01:10:40.578: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:10:40.579] Nov 6 01:10:40.578: INFO: cloud-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:10:40.579] Nov 6 01:10:40.578: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:10:40.579] Nov 6 01:10:40.578: INFO: kube-addon-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:10:40.579] Nov 6 01:10:40.578: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:10:40.579] Nov 6 01:10:40.578: INFO: kube-apiserver-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:10:40.579] Nov 6 01:10:40.578: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:10:40.580] Nov 6 01:10:40.578: INFO: azure-ip-masq-agent-xmkx2 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:40.580] Nov 6 01:10:40.578: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:10:40.850] Nov 6 01:10:40.850: INFO: I1106 01:10:40.850] Latency metrics for node k8s-master-73731178-vmss000000 I1106 01:10:40.850] Nov 6 01:10:40.850: INFO: I1106 01:10:40.850] Logging node info for node k8s-master-73731178-vmss000001 I1106 01:10:40.937] Nov 6 01:10:40.935: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000001,UID:442cf114-6b0a-4c80-a9e5-be62e184f94c,ResourceVersion:19294,Generation:0,CreationTimestamp:2019-11-05 23:27:42 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:19 +0000 UTC 2019-11-05 23:28:19 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:10:17 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:10:17 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:10:17 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:10:17 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.5} {Hostname k8s-master-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1a9da6632c314858a31bccaea0be0f50,SystemUUID:8F48A76E-30E1-B948-89B2-33C0048059B4,BootID:1597124c-68a3-452c-ae03-6cfe9bc1e57f,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:10:40.938] Nov 6 01:10:40.935: INFO: I1106 01:10:40.938] Logging kubelet events for node k8s-master-73731178-vmss000001 I1106 01:10:41.019] Nov 6 01:10:41.019: INFO: I1106 01:10:41.020] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000001 I1106 01:10:41.110] Nov 6 01:10:41.110: INFO: kube-scheduler-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:10:41.110] Nov 6 01:10:41.110: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:10:41.111] Nov 6 01:10:41.110: INFO: cloud-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:10:41.111] Nov 6 01:10:41.110: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:10:41.111] Nov 6 01:10:41.110: INFO: kube-addon-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:10:41.111] Nov 6 01:10:41.110: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:10:41.111] Nov 6 01:10:41.110: INFO: kube-apiserver-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:10:41.111] Nov 6 01:10:41.110: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:10:41.111] Nov 6 01:10:41.110: INFO: kube-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:10:41.112] Nov 6 01:10:41.110: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:10:41.112] Nov 6 01:10:41.110: INFO: azure-ip-masq-agent-825g9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:41.112] Nov 6 01:10:41.110: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:10:41.112] Nov 6 01:10:41.110: INFO: kube-proxy-8924t started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:41.112] Nov 6 01:10:41.110: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:10:41.391] Nov 6 01:10:41.390: INFO: I1106 01:10:41.391] Latency metrics for node k8s-master-73731178-vmss000001 I1106 01:10:41.391] Nov 6 01:10:41.391: INFO: I1106 01:10:41.391] Logging node info for node k8s-master-73731178-vmss000002 I1106 01:10:41.482] Nov 6 01:10:41.480: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000002,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000002,UID:6cf1398e-1b6b-4537-837d-9ffceb9a4f00,ResourceVersion:19354,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000002,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.6.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/2,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:27:55 +0000 UTC 2019-11-05 23:27:55 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:10:37 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:10:37 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:10:37 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:10:37 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.6} {Hostname k8s-master-73731178-vmss000002}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7964689c8ba4f448e6f435b3d4fefac,SystemUUID:9369535A-87BF-1E4B-86DF-5D1A23713C9F,BootID:74f93904-298f-454d-8df6-8d4bba193331,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:10:41.483] Nov 6 01:10:41.480: INFO: I1106 01:10:41.483] Logging kubelet events for node k8s-master-73731178-vmss000002 I1106 01:10:41.565] Nov 6 01:10:41.564: INFO: I1106 01:10:41.565] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000002 I1106 01:10:41.653] Nov 6 01:10:41.653: INFO: kube-addon-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:18 +0000 UTC (0+1 container statuses recorded) I1106 01:10:41.654] Nov 6 01:10:41.653: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:10:41.654] Nov 6 01:10:41.653: INFO: kube-apiserver-k8s-master-73731178-vmss000002 started at 2019-11-05 23:28:42 +0000 UTC (0+1 container statuses recorded) I1106 01:10:41.654] Nov 6 01:10:41.653: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:10:41.654] Nov 6 01:10:41.653: INFO: kube-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:10:41.654] Nov 6 01:10:41.653: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:10:41.655] Nov 6 01:10:41.653: INFO: kube-scheduler-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:10:41.655] Nov 6 01:10:41.653: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:10:41.655] Nov 6 01:10:41.653: INFO: cloud-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:10:41.655] Nov 6 01:10:41.653: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:10:41.655] Nov 6 01:10:41.653: INFO: azure-ip-masq-agent-74xks started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:41.655] Nov 6 01:10:41.653: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:10:41.656] Nov 6 01:10:41.653: INFO: kube-proxy-t958f started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:41.656] Nov 6 01:10:41.653: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:10:41.928] Nov 6 01:10:41.928: INFO: I1106 01:10:41.928] Latency metrics for node k8s-master-73731178-vmss000002 I1106 01:10:41.928] Nov 6 01:10:41.928: INFO: I1106 01:10:41.928] Logging node info for node k8s-master-73731178-vmss000003 I1106 01:10:42.015] Nov 6 01:10:42.012: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000003,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000003,UID:54efc1b0-183c-4153-b804-31d0d42ce204,ResourceVersion:19349,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000003,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/3,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:10:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:10:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:10:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:10:35 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{Hostname k8s-master-73731178-vmss000003} {InternalIP 10.240.0.7}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a448072d2d27400fa2252a0cb3c8ff37,SystemUUID:98F6A517-FFCA-8E4D-A914-52A5F1482433,BootID:50c0f9e6-7c4d-45ec-8984-248ea540d637,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:10:42.015] Nov 6 01:10:42.012: INFO: I1106 01:10:42.015] Logging kubelet events for node k8s-master-73731178-vmss000003 I1106 01:10:42.097] Nov 6 01:10:42.097: INFO: I1106 01:10:42.097] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000003 I1106 01:10:42.187] Nov 6 01:10:42.187: INFO: azure-ip-masq-agent-4nshf started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:42.187] Nov 6 01:10:42.187: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:10:42.187] Nov 6 01:10:42.187: INFO: kube-proxy-qm7rq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:10:42.187] Nov 6 01:10:42.187: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:10:42.188] Nov 6 01:10:42.187: INFO: cloud-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:10:42.188] Nov 6 01:10:42.187: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:10:42.188] Nov 6 01:10:42.187: INFO: kube-addon-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:43 +0000 UTC (0+1 container statuses recorded) I1106 01:10:42.188] Nov 6 01:10:42.187: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:10:42.188] Nov 6 01:10:42.187: INFO: kube-apiserver-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:10:42.188] Nov 6 01:10:42.187: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:10:42.188] Nov 6 01:10:42.187: INFO: kube-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:10:42.189] Nov 6 01:10:42.187: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:10:42.189] Nov 6 01:10:42.187: INFO: kube-scheduler-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:10:42.189] Nov 6 01:10:42.187: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:10:42.460] Nov 6 01:10:42.459: INFO: I1106 01:10:42.460] Latency metrics for node k8s-master-73731178-vmss000003 I1106 01:10:42.460] Nov 6 01:10:42.459: INFO: I1106 01:10:42.460] Logging node info for node k8s-master-73731178-vmss000004 I1106 01:10:42.547] Nov 6 01:10:42.544: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000004,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000004,UID:4a582f8b-6cf2-4e91-8770-fde6f9c22194,ResourceVersion:19342,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000004,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/4,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:32 +0000 UTC 2019-11-05 23:28:32 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:10:33 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:10:33 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:10:33 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:10:33 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.8} {Hostname k8s-master-73731178-vmss000004}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:252c632059f2483d87e2d8d689053e48,SystemUUID:5BBFFB00-FBAB-0F4A-8F63-6B99DE219F64,BootID:165ca62a-8171-48e8-92f7-3ad786cb6b9a,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:10:42.547] Nov 6 01:10:42.544: INFO: I1106 01:10:42.547] Logging kubelet events for node k8s-master-73731178-vmss000004 I1106 01:10:42.628] Nov 6 01:10:42.628: INFO: I1106 01:10:42.629] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000004 I1106 01:10:42.717] Nov 6 01:10:42.717: INFO: kube-addon-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:10:42.717] Nov 6 01:10:42.717: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:10:42.717] Nov 6 01:10:42.717: INFO: kube-apiserver-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:10:42.717] Nov 6 01:10:42.717: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:10:42.717] Nov 6 01:10:42.717: INFO: kube-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:10:42.718] Nov 6 01:10:42.717: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:10:42.718] Nov 6 01:10:42.717: INFO: kube-scheduler-k8s-master-73731178-vmss000004 started at 2019-11-05 23:28:31 +0000 UTC (0+1 container statuses recorded) I1106 01:10:42.718] Nov 6 01:10:42.717: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:10:42.718] Nov 6 01:10:42.717: INFO: azure-ip-masq-agent-rh9pr started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:10:42.718] Nov 6 01:10:42.717: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:10:42.718] Nov 6 01:10:42.717: INFO: kube-proxy-rk5r6 started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:10:42.718] Nov 6 01:10:42.717: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:10:42.718] Nov 6 01:10:42.717: INFO: cloud-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:10:42.719] Nov 6 01:10:42.717: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:10:42.983] Nov 6 01:10:42.983: INFO: I1106 01:10:42.983] Latency metrics for node k8s-master-73731178-vmss000004 I1106 01:10:42.983] Nov 6 01:10:42.983: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1106 01:10:43.068] STEP: Destroying namespace "azuredisk-1499" for this suite. I1106 01:10:57.332] Nov 6 01:10:57.332: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1106 01:11:00.539] Nov 6 01:11:00.539: INFO: namespace azuredisk-1499 deletion completed in 17.470731706s I1106 01:11:00.539] I1106 01:11:00.539] • Failure [924.451 seconds] I1106 01:11:00.539] [azuredisk-csi-e2e] Dynamic Provisioning I1106 01:11:00.539] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:33 I1106 01:11:00.540] [multi-az] I1106 01:11:00.540] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:40 I1106 01:11:00.540] should create a volume on demand [It] I1106 01:11:00.540] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:78 I1106 01:11:00.540] I1106 01:11:00.540] Unexpected error: I1106 01:11:00.540] <*errors.errorString | 0xc000eaa9d0>: { I1106 01:11:00.541] s: "Gave up after waiting 15m0s for pod \"azuredisk-volume-tester-ksl4f\" to be \"success or failure\"", I1106 01:11:00.541] } I1106 01:11:00.541] Gave up after waiting 15m0s for pod "azuredisk-volume-tester-ksl4f" to be "success or failure" I1106 01:11:00.541] occurred I1106 01:11:00.541] I1106 01:11:00.541] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:529 I1106 01:11:00.541] ------------------------------ I1106 01:11:00.541] [azuredisk-csi-e2e] Dynamic Provisioning [single-az] I1106 01:11:00.542] should create a deployment object, write and read to it, delete the pod and write and read to it again I1106 01:11:00.542] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:193 I1106 01:11:00.542] [BeforeEach] [single-az] I1106 01:11:00.542] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1106 01:11:00.542] STEP: Creating a kubernetes client I1106 01:11:00.542] Nov 6 01:11:00.539: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1106 01:11:00.542] STEP: Building a namespace api object, basename azuredisk I1106 01:11:00.800] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-7154 I1106 01:11:01.074] STEP: Waiting for a default service account to be provisioned in namespace I1106 01:11:01.156] [BeforeEach] [single-az] I1106 01:11:01.156] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:58 I1106 01:11:01.157] [It] should create a deployment object, write and read to it, delete the pod and write and read to it again I1106 01:11:01.157] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:193 I1106 01:11:01.157] STEP: setting up the StorageClass I1106 01:11:01.157] STEP: creating a StorageClass I1106 01:11:01.256] STEP: setting up the PVC I1106 01:11:01.256] STEP: creating a PVC I1106 01:11:01.347] STEP: waiting for PVC to be in phase "Bound" I1106 01:11:01.348] Nov 6 01:11:01.347: INFO: Waiting up to 5m0s for PersistentVolumeClaims [pvc-vgrmd] to have phase Bound I1106 01:11:01.434] Nov 6 01:11:01.434: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:03.519] Nov 6 01:11:03.519: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:05.605] Nov 6 01:11:05.604: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:07.690] Nov 6 01:11:07.689: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:09.774] Nov 6 01:11:09.774: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:11.858] Nov 6 01:11:11.858: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:13.943] Nov 6 01:11:13.943: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:16.046] Nov 6 01:11:16.045: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:18.130] Nov 6 01:11:18.130: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:20.215] Nov 6 01:11:20.215: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:22.304] Nov 6 01:11:22.303: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:24.389] Nov 6 01:11:24.388: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:26.474] Nov 6 01:11:26.473: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:28.559] Nov 6 01:11:28.558: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:30.643] Nov 6 01:11:30.643: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:32.728] Nov 6 01:11:32.728: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:34.813] Nov 6 01:11:34.813: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:36.898] Nov 6 01:11:36.898: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:38.983] Nov 6 01:11:38.982: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:41.067] Nov 6 01:11:41.067: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:43.151] Nov 6 01:11:43.151: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:45.237] Nov 6 01:11:45.236: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:47.321] Nov 6 01:11:47.321: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:49.406] Nov 6 01:11:49.406: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:51.492] Nov 6 01:11:51.492: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:53.576] Nov 6 01:11:53.576: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:55.662] Nov 6 01:11:55.661: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:57.747] Nov 6 01:11:57.747: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:11:59.832] Nov 6 01:11:59.831: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:01.916] Nov 6 01:12:01.916: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:04.002] Nov 6 01:12:04.001: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:06.087] Nov 6 01:12:06.087: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:08.171] Nov 6 01:12:08.171: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:10.256] Nov 6 01:12:10.256: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:12.341] Nov 6 01:12:12.341: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:14.426] Nov 6 01:12:14.425: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:16.510] Nov 6 01:12:16.510: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:18.585] Nov 6 01:12:18.585: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:20.661] Nov 6 01:12:20.661: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:22.737] Nov 6 01:12:22.737: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:24.812] Nov 6 01:12:24.812: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:26.887] Nov 6 01:12:26.887: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:28.963] Nov 6 01:12:28.963: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:31.039] Nov 6 01:12:31.038: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:33.114] Nov 6 01:12:33.113: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:35.189] Nov 6 01:12:35.189: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:37.264] Nov 6 01:12:37.264: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:39.339] Nov 6 01:12:39.339: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:41.414] Nov 6 01:12:41.414: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:43.489] Nov 6 01:12:43.489: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:45.565] Nov 6 01:12:45.565: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:47.640] Nov 6 01:12:47.640: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:49.715] Nov 6 01:12:49.715: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:51.791] Nov 6 01:12:51.791: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:53.867] Nov 6 01:12:53.866: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:55.942] Nov 6 01:12:55.942: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:12:58.018] Nov 6 01:12:58.018: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:00.093] Nov 6 01:13:00.093: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:02.168] Nov 6 01:13:02.168: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:04.243] Nov 6 01:13:04.243: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:06.319] Nov 6 01:13:06.319: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:08.394] Nov 6 01:13:08.394: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:10.469] Nov 6 01:13:10.469: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:12.545] Nov 6 01:13:12.545: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:14.625] Nov 6 01:13:14.625: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:16.700] Nov 6 01:13:16.700: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:18.775] Nov 6 01:13:18.775: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:20.850] Nov 6 01:13:20.850: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:22.926] Nov 6 01:13:22.926: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:25.001] Nov 6 01:13:25.001: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:27.076] Nov 6 01:13:27.076: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:29.151] Nov 6 01:13:29.151: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:31.226] Nov 6 01:13:31.226: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:33.304] Nov 6 01:13:33.304: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:35.379] Nov 6 01:13:35.379: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:37.455] Nov 6 01:13:37.455: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:39.531] Nov 6 01:13:39.531: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:41.606] Nov 6 01:13:41.606: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:43.681] Nov 6 01:13:43.681: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:45.758] Nov 6 01:13:45.758: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:47.834] Nov 6 01:13:47.834: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:49.909] Nov 6 01:13:49.909: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:51.985] Nov 6 01:13:51.984: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:54.060] Nov 6 01:13:54.060: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:56.136] Nov 6 01:13:56.136: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:13:58.211] Nov 6 01:13:58.211: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:00.287] Nov 6 01:14:00.286: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:02.362] Nov 6 01:14:02.361: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:04.437] Nov 6 01:14:04.437: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:06.513] Nov 6 01:14:06.513: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:08.589] Nov 6 01:14:08.588: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:10.663] Nov 6 01:14:10.663: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:12.739] Nov 6 01:14:12.738: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:14.814] Nov 6 01:14:14.814: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:16.890] Nov 6 01:14:16.889: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:18.965] Nov 6 01:14:18.965: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:21.041] Nov 6 01:14:21.040: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:23.116] Nov 6 01:14:23.116: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:25.191] Nov 6 01:14:25.191: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:27.266] Nov 6 01:14:27.266: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:29.342] Nov 6 01:14:29.342: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:31.417] Nov 6 01:14:31.417: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:33.492] Nov 6 01:14:33.492: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:35.568] Nov 6 01:14:35.567: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:37.644] Nov 6 01:14:37.644: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:39.720] Nov 6 01:14:39.719: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:41.795] Nov 6 01:14:41.795: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:43.870] Nov 6 01:14:43.870: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:45.948] Nov 6 01:14:45.948: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:48.029] Nov 6 01:14:48.029: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:50.104] Nov 6 01:14:50.104: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:52.180] Nov 6 01:14:52.180: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:54.255] Nov 6 01:14:54.255: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:56.330] Nov 6 01:14:56.330: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:14:58.407] Nov 6 01:14:58.407: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:00.483] Nov 6 01:15:00.483: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:02.559] Nov 6 01:15:02.559: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:04.635] Nov 6 01:15:04.634: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:06.710] Nov 6 01:15:06.710: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:08.785] Nov 6 01:15:08.785: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:10.860] Nov 6 01:15:10.860: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:12.945] Nov 6 01:15:12.945: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:15.030] Nov 6 01:15:15.030: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:17.114] Nov 6 01:15:17.114: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:19.198] Nov 6 01:15:19.198: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:21.282] Nov 6 01:15:21.282: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:23.366] Nov 6 01:15:23.366: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:25.451] Nov 6 01:15:25.450: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:27.535] Nov 6 01:15:27.535: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:29.619] Nov 6 01:15:29.619: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:31.704] Nov 6 01:15:31.703: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:33.794] Nov 6 01:15:33.794: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:35.878] Nov 6 01:15:35.878: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:37.962] Nov 6 01:15:37.961: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:40.062] Nov 6 01:15:40.062: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:42.147] Nov 6 01:15:42.146: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:44.239] Nov 6 01:15:44.239: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:46.325] Nov 6 01:15:46.324: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:48.410] Nov 6 01:15:48.410: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:50.494] Nov 6 01:15:50.493: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:52.578] Nov 6 01:15:52.578: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:54.662] Nov 6 01:15:54.662: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:56.747] Nov 6 01:15:56.746: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:15:58.830] Nov 6 01:15:58.830: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:16:00.914] Nov 6 01:16:00.914: INFO: PersistentVolumeClaim pvc-vgrmd found but phase is Pending instead of Bound. I1106 01:16:02.915] Nov 6 01:16:02.914: INFO: Unexpected error occurred: PersistentVolumeClaims [pvc-vgrmd] not all in phase Bound within 5m0s I1106 01:16:02.915] [AfterEach] [single-az] I1106 01:16:02.915] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1106 01:16:02.915] STEP: Collecting events from namespace "azuredisk-7154". I1106 01:16:02.999] STEP: Found 3 events. I1106 01:16:03.000] Nov 6 01:16:02.999: INFO: At 2019-11-06 01:11:01 +0000 UTC - event for pvc-vgrmd: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator I1106 01:16:03.000] Nov 6 01:16:02.999: INFO: At 2019-11-06 01:11:01 +0000 UTC - event for pvc-vgrmd: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } Provisioning: External provisioner is provisioning volume for claim "azuredisk-7154/pvc-vgrmd" I1106 01:16:03.000] Nov 6 01:16:02.999: INFO: At 2019-11-06 01:11:11 +0000 UTC - event for pvc-vgrmd: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-7154-disk.csi.azure.com-dynamic-sc-9hbzj": rpc error: code = DeadlineExceeded desc = context deadline exceeded I1106 01:16:03.083] Nov 6 01:16:03.083: INFO: POD NODE PHASE GRACE CONDITIONS I1106 01:16:03.084] Nov 6 01:16:03.083: INFO: I1106 01:16:03.336] Nov 6 01:16:03.336: INFO: I1106 01:16:03.337] Logging node info for node k8s-agentpool-73731178-vmss000000 I1106 01:16:03.423] Nov 6 01:16:03.420: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000000,UID:e9bc0b16-6756-4155-b49c-e223c0ba9499,ResourceVersion:20203,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-1,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000000"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:18 +0000 UTC 2019-11-05 23:28:18 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:15:18 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:15:18 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:15:18 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:15:18 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.4} {Hostname k8s-agentpool-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:956ad861ae4a42099801f8e840b4e502,SystemUUID:439CF4B9-2B9F-B74E-9ED7-7379FD8BD0DF,BootID:bd3476e5-4fd4-4437-9b56-54fbe38a3a49,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1] 121711221} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/metrics-server-amd64@sha256:49a9f12f7067d11f42c803dbe61ed2c1299959ad85cb315b25ff7eef8e6b8892 k8s.gcr.io/metrics-server-amd64:v0.2.1] 42541759} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/disks/pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312],VolumesAttached:[],Config:nil,},} I1106 01:16:03.424] Nov 6 01:16:03.420: INFO: I1106 01:16:03.424] Logging kubelet events for node k8s-agentpool-73731178-vmss000000 I1106 01:16:03.504] Nov 6 01:16:03.504: INFO: I1106 01:16:03.504] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000000 I1106 01:16:03.593] Nov 6 01:16:03.593: INFO: metrics-server-864ffbc5c-kb9cz started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:03.593] Nov 6 01:16:03.593: INFO: Container metrics-server ready: true, restart count 0 I1106 01:16:03.593] Nov 6 01:16:03.593: INFO: kube-proxy-jnqp8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:03.593] Nov 6 01:16:03.593: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:16:03.594] Nov 6 01:16:03.593: INFO: kubernetes-dashboard-66dd8b8df7-4rnsp started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:16:03.594] Nov 6 01:16:03.593: INFO: Container kubernetes-dashboard ready: true, restart count 1 I1106 01:16:03.594] Nov 6 01:16:03.593: INFO: csi-azuredisk-node-g6wbm started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 01:16:03.594] Nov 6 01:16:03.593: INFO: Container azuredisk ready: true, restart count 0 I1106 01:16:03.594] Nov 6 01:16:03.593: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:16:03.594] Nov 6 01:16:03.593: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 01:16:03.595] Nov 6 01:16:03.593: INFO: blobfuse-flexvol-installer-cvgkv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:03.595] Nov 6 01:16:03.593: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 01:16:03.595] Nov 6 01:16:03.593: INFO: azure-ip-masq-agent-vn5zc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:03.595] Nov 6 01:16:03.593: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:16:03.595] Nov 6 01:16:03.593: INFO: keyvault-flexvolume-xr7v6 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:03.595] Nov 6 01:16:03.593: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 01:16:03.864] Nov 6 01:16:03.864: INFO: I1106 01:16:03.864] Latency metrics for node k8s-agentpool-73731178-vmss000000 I1106 01:16:03.865] Nov 6 01:16:03.864: INFO: I1106 01:16:03.865] Logging node info for node k8s-agentpool-73731178-vmss000001 I1106 01:16:03.955] Nov 6 01:16:03.951: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000001,UID:ab75ba9d-ec23-4ff7-ae5a-d1a19974c05d,ResourceVersion:20205,Generation:0,CreationTimestamp:2019-11-05 23:27:31 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-2,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000001"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.5.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:17 +0000 UTC 2019-11-05 23:28:17 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:15:18 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:15:18 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:15:18 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:15:18 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.5} {Hostname k8s-agentpool-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f0eae5e73d0f4ccb82dd0f22701c288f,SystemUUID:7E54C533-AED3-744D-8D17-EFF5E62EA06D,BootID:6d58e5a6-45fb-4a41-a491-bc2f3799f411,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[gcr.io/kubernetes-helm/tiller@sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1 gcr.io/kubernetes-helm/tiller:v2.11.0] 71821984} {[quay.io/k8scsi/csi-provisioner@sha256:d657c839dce87324fe2b677302913f9386f885f8746be7bea0ced5b0844e3433 quay.io/k8scsi/csi-provisioner:v1.3.1] 50596998} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0] 46226754} {[quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1] 45874691} {[quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb quay.io/k8scsi/csi-snapshotter:v1.1.0] 44325352} {[k8s.gcr.io/coredns@sha256:e83beb5e43f8513fa735e77ffc5859640baea30a882a11cc75c4c3244a737d3c k8s.gcr.io/coredns:1.5.0] 42488424} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0] 14967303} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:16:03.955] Nov 6 01:16:03.951: INFO: I1106 01:16:03.955] Logging kubelet events for node k8s-agentpool-73731178-vmss000001 I1106 01:16:04.061] Nov 6 01:16:04.060: INFO: I1106 01:16:04.061] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000001 I1106 01:16:04.151] Nov 6 01:16:04.150: INFO: kube-proxy-z4hf8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:04.151] Nov 6 01:16:04.150: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:16:04.151] Nov 6 01:16:04.150: INFO: tiller-deploy-54c96cb5df-wlzbj started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:16:04.151] Nov 6 01:16:04.150: INFO: Container tiller ready: true, restart count 0 I1106 01:16:04.151] Nov 6 01:16:04.150: INFO: csi-azuredisk-controller-59bf945f54-k2p5m started at 2019-11-05 23:30:58 +0000 UTC (0+6 container statuses recorded) I1106 01:16:04.151] Nov 6 01:16:04.150: INFO: Container azuredisk ready: true, restart count 0 I1106 01:16:04.152] Nov 6 01:16:04.150: INFO: Container cluster-driver-registrar ready: true, restart count 0 I1106 01:16:04.152] Nov 6 01:16:04.150: INFO: Container csi-attacher ready: true, restart count 0 I1106 01:16:04.152] Nov 6 01:16:04.150: INFO: Container csi-provisioner ready: true, restart count 0 I1106 01:16:04.152] Nov 6 01:16:04.150: INFO: Container csi-snapshotter ready: true, restart count 0 I1106 01:16:04.152] Nov 6 01:16:04.150: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:16:04.152] Nov 6 01:16:04.150: INFO: blobfuse-flexvol-installer-589vv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:04.152] Nov 6 01:16:04.150: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 01:16:04.152] Nov 6 01:16:04.150: INFO: coredns-7f68dcdbdb-f98nq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:04.153] Nov 6 01:16:04.150: INFO: Container coredns ready: true, restart count 0 I1106 01:16:04.153] Nov 6 01:16:04.150: INFO: azure-ip-masq-agent-6qqgc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:04.153] Nov 6 01:16:04.150: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:16:04.153] Nov 6 01:16:04.150: INFO: keyvault-flexvolume-7tztj started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:04.153] Nov 6 01:16:04.150: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 01:16:04.153] Nov 6 01:16:04.150: INFO: csi-azuredisk-node-ml68k started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 01:16:04.153] Nov 6 01:16:04.150: INFO: Container azuredisk ready: true, restart count 0 I1106 01:16:04.154] Nov 6 01:16:04.150: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:16:04.154] Nov 6 01:16:04.150: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 01:16:04.435] Nov 6 01:16:04.434: INFO: I1106 01:16:04.435] Latency metrics for node k8s-agentpool-73731178-vmss000001 I1106 01:16:04.435] Nov 6 01:16:04.434: INFO: I1106 01:16:04.435] Logging node info for node k8s-master-73731178-vmss000000 I1106 01:16:04.521] Nov 6 01:16:04.518: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000000,UID:1f765350-accc-4e67-898b-e4d84be84901,ResourceVersion:20254,Generation:0,CreationTimestamp:2019-11-05 23:27:30 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.4} {Hostname k8s-master-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:836af7329e85492184d73f1ea7f63a4e,SystemUUID:D1C68207-4499-C24D-B9D6-ADA0554A1BE5,BootID:a29dde5d-b4dc-483e-a50e-76e79359d759,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:16:04.521] Nov 6 01:16:04.518: INFO: I1106 01:16:04.521] Logging kubelet events for node k8s-master-73731178-vmss000000 I1106 01:16:04.602] Nov 6 01:16:04.602: INFO: I1106 01:16:04.603] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000000 I1106 01:16:04.692] Nov 6 01:16:04.692: INFO: kube-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:04.692] Nov 6 01:16:04.692: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:16:04.692] Nov 6 01:16:04.692: INFO: kube-scheduler-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:04.692] Nov 6 01:16:04.692: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:16:04.693] Nov 6 01:16:04.692: INFO: cloud-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:04.693] Nov 6 01:16:04.692: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:16:04.693] Nov 6 01:16:04.692: INFO: kube-addon-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:04.693] Nov 6 01:16:04.692: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:16:04.693] Nov 6 01:16:04.692: INFO: kube-apiserver-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:04.694] Nov 6 01:16:04.692: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:16:04.694] Nov 6 01:16:04.692: INFO: azure-ip-masq-agent-xmkx2 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:04.694] Nov 6 01:16:04.692: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:16:04.694] Nov 6 01:16:04.692: INFO: kube-proxy-2fwv9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:04.694] Nov 6 01:16:04.692: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:16:04.965] Nov 6 01:16:04.965: INFO: I1106 01:16:04.966] Latency metrics for node k8s-master-73731178-vmss000000 I1106 01:16:04.966] Nov 6 01:16:04.965: INFO: I1106 01:16:04.966] Logging node info for node k8s-master-73731178-vmss000001 I1106 01:16:05.052] Nov 6 01:16:05.049: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000001,UID:442cf114-6b0a-4c80-a9e5-be62e184f94c,ResourceVersion:20200,Generation:0,CreationTimestamp:2019-11-05 23:27:42 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:19 +0000 UTC 2019-11-05 23:28:19 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:15:17 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:15:17 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:15:17 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:15:17 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.5} {Hostname k8s-master-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1a9da6632c314858a31bccaea0be0f50,SystemUUID:8F48A76E-30E1-B948-89B2-33C0048059B4,BootID:1597124c-68a3-452c-ae03-6cfe9bc1e57f,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:16:05.053] Nov 6 01:16:05.050: INFO: I1106 01:16:05.053] Logging kubelet events for node k8s-master-73731178-vmss000001 I1106 01:16:05.134] Nov 6 01:16:05.133: INFO: I1106 01:16:05.134] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000001 I1106 01:16:05.223] Nov 6 01:16:05.222: INFO: kube-scheduler-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:16:05.223] Nov 6 01:16:05.223: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:16:05.223] Nov 6 01:16:05.223: INFO: cloud-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:16:05.223] Nov 6 01:16:05.223: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:16:05.224] Nov 6 01:16:05.223: INFO: kube-addon-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:16:05.224] Nov 6 01:16:05.223: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:16:05.224] Nov 6 01:16:05.223: INFO: kube-apiserver-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:16:05.224] Nov 6 01:16:05.223: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:16:05.224] Nov 6 01:16:05.223: INFO: kube-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:16:05.224] Nov 6 01:16:05.223: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:16:05.224] Nov 6 01:16:05.223: INFO: azure-ip-masq-agent-825g9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:05.224] Nov 6 01:16:05.223: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:16:05.225] Nov 6 01:16:05.223: INFO: kube-proxy-8924t started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:05.225] Nov 6 01:16:05.223: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:16:05.491] Nov 6 01:16:05.491: INFO: I1106 01:16:05.491] Latency metrics for node k8s-master-73731178-vmss000001 I1106 01:16:05.491] Nov 6 01:16:05.491: INFO: I1106 01:16:05.492] Logging node info for node k8s-master-73731178-vmss000002 I1106 01:16:05.577] Nov 6 01:16:05.574: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000002,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000002,UID:6cf1398e-1b6b-4537-837d-9ffceb9a4f00,ResourceVersion:20262,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000002,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.6.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/2,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:27:55 +0000 UTC 2019-11-05 23:27:55 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:15:38 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:15:38 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:15:38 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:15:38 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.6} {Hostname k8s-master-73731178-vmss000002}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7964689c8ba4f448e6f435b3d4fefac,SystemUUID:9369535A-87BF-1E4B-86DF-5D1A23713C9F,BootID:74f93904-298f-454d-8df6-8d4bba193331,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:16:05.577] Nov 6 01:16:05.575: INFO: I1106 01:16:05.577] Logging kubelet events for node k8s-master-73731178-vmss000002 I1106 01:16:05.658] Nov 6 01:16:05.658: INFO: I1106 01:16:05.659] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000002 I1106 01:16:05.749] Nov 6 01:16:05.749: INFO: kube-apiserver-k8s-master-73731178-vmss000002 started at 2019-11-05 23:28:42 +0000 UTC (0+1 container statuses recorded) I1106 01:16:05.749] Nov 6 01:16:05.749: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:16:05.750] Nov 6 01:16:05.749: INFO: kube-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:16:05.750] Nov 6 01:16:05.749: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:16:05.750] Nov 6 01:16:05.749: INFO: kube-scheduler-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:16:05.750] Nov 6 01:16:05.749: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:16:05.750] Nov 6 01:16:05.749: INFO: cloud-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:16:05.751] Nov 6 01:16:05.749: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:16:05.751] Nov 6 01:16:05.749: INFO: azure-ip-masq-agent-74xks started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:05.751] Nov 6 01:16:05.749: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:16:05.751] Nov 6 01:16:05.749: INFO: kube-proxy-t958f started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:05.751] Nov 6 01:16:05.749: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:16:05.751] Nov 6 01:16:05.749: INFO: kube-addon-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:18 +0000 UTC (0+1 container statuses recorded) I1106 01:16:05.752] Nov 6 01:16:05.749: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:16:06.015] Nov 6 01:16:06.015: INFO: I1106 01:16:06.015] Latency metrics for node k8s-master-73731178-vmss000002 I1106 01:16:06.015] Nov 6 01:16:06.015: INFO: I1106 01:16:06.015] Logging node info for node k8s-master-73731178-vmss000003 I1106 01:16:06.101] Nov 6 01:16:06.098: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000003,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000003,UID:54efc1b0-183c-4153-b804-31d0d42ce204,ResourceVersion:20256,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000003,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/3,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{Hostname k8s-master-73731178-vmss000003} {InternalIP 10.240.0.7}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a448072d2d27400fa2252a0cb3c8ff37,SystemUUID:98F6A517-FFCA-8E4D-A914-52A5F1482433,BootID:50c0f9e6-7c4d-45ec-8984-248ea540d637,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:16:06.101] Nov 6 01:16:06.099: INFO: I1106 01:16:06.101] Logging kubelet events for node k8s-master-73731178-vmss000003 I1106 01:16:06.182] Nov 6 01:16:06.182: INFO: I1106 01:16:06.183] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000003 I1106 01:16:06.272] Nov 6 01:16:06.272: INFO: kube-proxy-qm7rq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:06.272] Nov 6 01:16:06.272: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:16:06.272] Nov 6 01:16:06.272: INFO: cloud-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:06.272] Nov 6 01:16:06.272: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:16:06.272] Nov 6 01:16:06.272: INFO: kube-addon-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:43 +0000 UTC (0+1 container statuses recorded) I1106 01:16:06.273] Nov 6 01:16:06.272: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:16:06.273] Nov 6 01:16:06.272: INFO: kube-apiserver-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:06.273] Nov 6 01:16:06.272: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:16:06.273] Nov 6 01:16:06.272: INFO: kube-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:06.273] Nov 6 01:16:06.272: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:16:06.273] Nov 6 01:16:06.272: INFO: kube-scheduler-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:06.273] Nov 6 01:16:06.272: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:16:06.274] Nov 6 01:16:06.272: INFO: azure-ip-masq-agent-4nshf started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:06.274] Nov 6 01:16:06.272: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:16:06.539] Nov 6 01:16:06.539: INFO: I1106 01:16:06.539] Latency metrics for node k8s-master-73731178-vmss000003 I1106 01:16:06.539] Nov 6 01:16:06.539: INFO: I1106 01:16:06.540] Logging node info for node k8s-master-73731178-vmss000004 I1106 01:16:06.625] Nov 6 01:16:06.623: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000004,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000004,UID:4a582f8b-6cf2-4e91-8770-fde6f9c22194,ResourceVersion:20249,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000004,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/4,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:32 +0000 UTC 2019-11-05 23:28:32 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:15:33 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:15:33 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:15:33 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:15:33 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.8} {Hostname k8s-master-73731178-vmss000004}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:252c632059f2483d87e2d8d689053e48,SystemUUID:5BBFFB00-FBAB-0F4A-8F63-6B99DE219F64,BootID:165ca62a-8171-48e8-92f7-3ad786cb6b9a,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:16:06.626] Nov 6 01:16:06.623: INFO: I1106 01:16:06.626] Logging kubelet events for node k8s-master-73731178-vmss000004 I1106 01:16:06.707] Nov 6 01:16:06.706: INFO: I1106 01:16:06.707] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000004 I1106 01:16:06.795] Nov 6 01:16:06.795: INFO: kube-proxy-rk5r6 started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:16:06.795] Nov 6 01:16:06.795: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:16:06.795] Nov 6 01:16:06.795: INFO: cloud-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:06.795] Nov 6 01:16:06.795: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:16:06.796] Nov 6 01:16:06.795: INFO: kube-addon-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:06.796] Nov 6 01:16:06.795: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:16:06.796] Nov 6 01:16:06.795: INFO: kube-apiserver-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:06.796] Nov 6 01:16:06.795: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:16:06.796] Nov 6 01:16:06.795: INFO: kube-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:06.796] Nov 6 01:16:06.795: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:16:06.797] Nov 6 01:16:06.795: INFO: kube-scheduler-k8s-master-73731178-vmss000004 started at 2019-11-05 23:28:31 +0000 UTC (0+1 container statuses recorded) I1106 01:16:06.797] Nov 6 01:16:06.795: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:16:06.797] Nov 6 01:16:06.795: INFO: azure-ip-masq-agent-rh9pr started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:16:06.797] Nov 6 01:16:06.795: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:16:07.067] Nov 6 01:16:07.067: INFO: I1106 01:16:07.067] Latency metrics for node k8s-master-73731178-vmss000004 I1106 01:16:07.067] Nov 6 01:16:07.067: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1106 01:16:07.151] STEP: Destroying namespace "azuredisk-7154" for this suite. I1106 01:16:21.410] Nov 6 01:16:21.410: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1106 01:16:24.582] Nov 6 01:16:24.582: INFO: namespace azuredisk-7154 deletion completed in 17.430586381s I1106 01:16:24.582] I1106 01:16:24.583] • Failure [324.043 seconds] I1106 01:16:24.583] [azuredisk-csi-e2e] Dynamic Provisioning I1106 01:16:24.583] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:33 I1106 01:16:24.583] [single-az] I1106 01:16:24.583] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:36 I1106 01:16:24.583] should create a deployment object, write and read to it, delete the pod and write and read to it again [It] I1106 01:16:24.583] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:193 I1106 01:16:24.584] I1106 01:16:24.584] Unexpected error: I1106 01:16:24.584] <*errors.errorString | 0xc000996db0>: { I1106 01:16:24.584] s: "PersistentVolumeClaims [pvc-vgrmd] not all in phase Bound within 5m0s", I1106 01:16:24.584] } I1106 01:16:24.584] PersistentVolumeClaims [pvc-vgrmd] not all in phase Bound within 5m0s I1106 01:16:24.584] occurred I1106 01:16:24.584] I1106 01:16:24.584] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1106 01:16:24.585] ------------------------------ I1106 01:16:24.585] [azuredisk-csi-e2e] [single-az] Pre-Provisioned I1106 01:16:24.585] [env] should use a pre-provisioned volume and retain PV with reclaimPolicy "Retain" I1106 01:16:24.585] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning.go:100 I1106 01:16:24.585] [BeforeEach] [azuredisk-csi-e2e] [single-az] Pre-Provisioned I1106 01:16:24.585] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1106 01:16:24.585] STEP: Creating a kubernetes client I1106 01:16:24.585] Nov 6 01:16:24.582: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1106 01:16:24.586] STEP: Building a namespace api object, basename azuredisk I1106 01:16:24.837] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-7467 I1106 01:16:25.109] STEP: Waiting for a default service account to be provisioned in namespace I1106 01:16:25.190] [BeforeEach] [azuredisk-csi-e2e] [single-az] Pre-Provisioned I1106 01:16:25.190] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning.go:48 I1106 01:16:25.191] [It] [env] should use a pre-provisioned volume and retain PV with reclaimPolicy "Retain" I1106 01:16:25.191] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning.go:100 I1106 01:16:27.074] STEP: Successfully provisioned AzureDisk volume: "/subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/disks/pre-provisioned-retain-reclaimPolicy" I1106 01:16:27.074] I1106 01:16:27.074] STEP: setting up the PV I1106 01:16:27.074] STEP: creating a PV I1106 01:16:27.161] STEP: setting up the PVC I1106 01:16:27.162] STEP: creating a PVC I1106 01:16:27.256] STEP: waiting for PVC to be in phase "Bound" I1106 01:16:27.256] Nov 6 01:16:27.255: INFO: Waiting up to 5m0s for PersistentVolumeClaims [pvc-txn7v] to have phase Bound I1106 01:16:27.339] Nov 6 01:16:27.339: INFO: PersistentVolumeClaim pvc-txn7v found and phase=Bound (83.741248ms) I1106 01:16:27.340] STEP: checking the PVC I1106 01:16:27.423] STEP: validating provisioned PV I1106 01:16:27.507] STEP: checking the PV I1106 01:16:27.507] [AfterEach] [azuredisk-csi-e2e] [single-az] Pre-Provisioned I1106 01:16:27.507] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1106 01:16:27.507] STEP: Collecting events from namespace "azuredisk-7467". I1106 01:16:27.591] STEP: Found 0 events. I1106 01:16:27.676] Nov 6 01:16:27.676: INFO: POD NODE PHASE GRACE CONDITIONS I1106 01:16:27.676] Nov 6 01:16:27.676: INFO: I1106 01:16:27.926] Nov 6 01:16:27.925: INFO: I1106 01:16:27.926] Logging node info for node k8s-agentpool-73731178-vmss000000 I1106 01:16:28.012] Nov 6 01:16:28.009: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000000,UID:e9bc0b16-6756-4155-b49c-e223c0ba9499,ResourceVersion:20385,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-1,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000000"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:18 +0000 UTC 2019-11-05 23:28:18 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:16:18 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:16:18 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:16:18 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:16:18 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.4} {Hostname k8s-agentpool-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:956ad861ae4a42099801f8e840b4e502,SystemUUID:439CF4B9-2B9F-B74E-9ED7-7379FD8BD0DF,BootID:bd3476e5-4fd4-4437-9b56-54fbe38a3a49,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1] 121711221} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/metrics-server-amd64@sha256:49a9f12f7067d11f42c803dbe61ed2c1299959ad85cb315b25ff7eef8e6b8892 k8s.gcr.io/metrics-server-amd64:v0.2.1] 42541759} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/disks/pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312],VolumesAttached:[],Config:nil,},} I1106 01:16:28.013] Nov 6 01:16:28.010: INFO: I1106 01:16:28.013] Logging kubelet events for node k8s-agentpool-73731178-vmss000000 I1106 01:16:28.094] Nov 6 01:16:28.094: INFO: I1106 01:16:28.094] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000000 I1106 01:16:28.185] Nov 6 01:16:28.185: INFO: blobfuse-flexvol-installer-cvgkv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:28.185] Nov 6 01:16:28.185: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 01:16:28.186] Nov 6 01:16:28.185: INFO: azure-ip-masq-agent-vn5zc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:28.186] Nov 6 01:16:28.185: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:16:28.186] Nov 6 01:16:28.185: INFO: keyvault-flexvolume-xr7v6 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:28.186] Nov 6 01:16:28.185: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 01:16:28.186] Nov 6 01:16:28.185: INFO: metrics-server-864ffbc5c-kb9cz started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:28.186] Nov 6 01:16:28.185: INFO: Container metrics-server ready: true, restart count 0 I1106 01:16:28.187] Nov 6 01:16:28.185: INFO: kube-proxy-jnqp8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:28.187] Nov 6 01:16:28.185: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:16:28.187] Nov 6 01:16:28.185: INFO: kubernetes-dashboard-66dd8b8df7-4rnsp started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:16:28.187] Nov 6 01:16:28.185: INFO: Container kubernetes-dashboard ready: true, restart count 1 I1106 01:16:28.187] Nov 6 01:16:28.185: INFO: csi-azuredisk-node-g6wbm started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 01:16:28.187] Nov 6 01:16:28.185: INFO: Container azuredisk ready: true, restart count 0 I1106 01:16:28.187] Nov 6 01:16:28.185: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:16:28.188] Nov 6 01:16:28.185: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 01:16:28.452] Nov 6 01:16:28.451: INFO: I1106 01:16:28.452] Latency metrics for node k8s-agentpool-73731178-vmss000000 I1106 01:16:28.453] Nov 6 01:16:28.451: INFO: I1106 01:16:28.453] Logging node info for node k8s-agentpool-73731178-vmss000001 I1106 01:16:28.539] Nov 6 01:16:28.535: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000001,UID:ab75ba9d-ec23-4ff7-ae5a-d1a19974c05d,ResourceVersion:20386,Generation:0,CreationTimestamp:2019-11-05 23:27:31 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-2,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000001"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.5.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:17 +0000 UTC 2019-11-05 23:28:17 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:16:18 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:16:18 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:16:18 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:16:18 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.5} {Hostname k8s-agentpool-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f0eae5e73d0f4ccb82dd0f22701c288f,SystemUUID:7E54C533-AED3-744D-8D17-EFF5E62EA06D,BootID:6d58e5a6-45fb-4a41-a491-bc2f3799f411,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[gcr.io/kubernetes-helm/tiller@sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1 gcr.io/kubernetes-helm/tiller:v2.11.0] 71821984} {[quay.io/k8scsi/csi-provisioner@sha256:d657c839dce87324fe2b677302913f9386f885f8746be7bea0ced5b0844e3433 quay.io/k8scsi/csi-provisioner:v1.3.1] 50596998} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0] 46226754} {[quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1] 45874691} {[quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb quay.io/k8scsi/csi-snapshotter:v1.1.0] 44325352} {[k8s.gcr.io/coredns@sha256:e83beb5e43f8513fa735e77ffc5859640baea30a882a11cc75c4c3244a737d3c k8s.gcr.io/coredns:1.5.0] 42488424} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0] 14967303} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:16:28.539] Nov 6 01:16:28.535: INFO: I1106 01:16:28.539] Logging kubelet events for node k8s-agentpool-73731178-vmss000001 I1106 01:16:28.619] Nov 6 01:16:28.619: INFO: I1106 01:16:28.619] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000001 I1106 01:16:28.710] Nov 6 01:16:28.709: INFO: csi-azuredisk-node-ml68k started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 01:16:28.710] Nov 6 01:16:28.709: INFO: Container azuredisk ready: true, restart count 0 I1106 01:16:28.710] Nov 6 01:16:28.709: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:16:28.710] Nov 6 01:16:28.709: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 01:16:28.710] Nov 6 01:16:28.709: INFO: coredns-7f68dcdbdb-f98nq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:28.710] Nov 6 01:16:28.709: INFO: Container coredns ready: true, restart count 0 I1106 01:16:28.710] Nov 6 01:16:28.709: INFO: azure-ip-masq-agent-6qqgc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:28.711] Nov 6 01:16:28.709: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:16:28.711] Nov 6 01:16:28.709: INFO: keyvault-flexvolume-7tztj started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:28.711] Nov 6 01:16:28.709: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 01:16:28.711] Nov 6 01:16:28.709: INFO: kube-proxy-z4hf8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:28.711] Nov 6 01:16:28.710: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:16:28.711] Nov 6 01:16:28.710: INFO: tiller-deploy-54c96cb5df-wlzbj started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:16:28.711] Nov 6 01:16:28.710: INFO: Container tiller ready: true, restart count 0 I1106 01:16:28.711] Nov 6 01:16:28.710: INFO: csi-azuredisk-controller-59bf945f54-k2p5m started at 2019-11-05 23:30:58 +0000 UTC (0+6 container statuses recorded) I1106 01:16:28.712] Nov 6 01:16:28.710: INFO: Container azuredisk ready: true, restart count 0 I1106 01:16:28.712] Nov 6 01:16:28.710: INFO: Container cluster-driver-registrar ready: true, restart count 0 I1106 01:16:28.712] Nov 6 01:16:28.710: INFO: Container csi-attacher ready: true, restart count 0 I1106 01:16:28.712] Nov 6 01:16:28.710: INFO: Container csi-provisioner ready: true, restart count 0 I1106 01:16:28.712] Nov 6 01:16:28.710: INFO: Container csi-snapshotter ready: true, restart count 0 I1106 01:16:28.712] Nov 6 01:16:28.710: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:16:28.712] Nov 6 01:16:28.710: INFO: blobfuse-flexvol-installer-589vv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:28.712] Nov 6 01:16:28.710: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 01:16:28.975] Nov 6 01:16:28.975: INFO: I1106 01:16:28.975] Latency metrics for node k8s-agentpool-73731178-vmss000001 I1106 01:16:28.975] Nov 6 01:16:28.975: INFO: I1106 01:16:28.975] Logging node info for node k8s-master-73731178-vmss000000 I1106 01:16:29.062] Nov 6 01:16:29.060: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000000,UID:1f765350-accc-4e67-898b-e4d84be84901,ResourceVersion:20254,Generation:0,CreationTimestamp:2019-11-05 23:27:30 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.4} {Hostname k8s-master-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:836af7329e85492184d73f1ea7f63a4e,SystemUUID:D1C68207-4499-C24D-B9D6-ADA0554A1BE5,BootID:a29dde5d-b4dc-483e-a50e-76e79359d759,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:16:29.062] Nov 6 01:16:29.060: INFO: I1106 01:16:29.063] Logging kubelet events for node k8s-master-73731178-vmss000000 I1106 01:16:29.144] Nov 6 01:16:29.144: INFO: I1106 01:16:29.144] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000000 I1106 01:16:29.235] Nov 6 01:16:29.235: INFO: kube-scheduler-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:29.236] Nov 6 01:16:29.235: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:16:29.236] Nov 6 01:16:29.235: INFO: cloud-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:29.236] Nov 6 01:16:29.235: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:16:29.236] Nov 6 01:16:29.235: INFO: kube-addon-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:29.236] Nov 6 01:16:29.235: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:16:29.236] Nov 6 01:16:29.235: INFO: kube-apiserver-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:29.237] Nov 6 01:16:29.235: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:16:29.237] Nov 6 01:16:29.235: INFO: azure-ip-masq-agent-xmkx2 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:29.237] Nov 6 01:16:29.235: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:16:29.237] Nov 6 01:16:29.235: INFO: kube-proxy-2fwv9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:29.237] Nov 6 01:16:29.235: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:16:29.237] Nov 6 01:16:29.235: INFO: kube-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:29.237] Nov 6 01:16:29.235: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:16:29.504] Nov 6 01:16:29.504: INFO: I1106 01:16:29.505] Latency metrics for node k8s-master-73731178-vmss000000 I1106 01:16:29.505] Nov 6 01:16:29.504: INFO: I1106 01:16:29.505] Logging node info for node k8s-master-73731178-vmss000001 I1106 01:16:29.590] Nov 6 01:16:29.588: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000001,UID:442cf114-6b0a-4c80-a9e5-be62e184f94c,ResourceVersion:20381,Generation:0,CreationTimestamp:2019-11-05 23:27:42 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:19 +0000 UTC 2019-11-05 23:28:19 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:16:18 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:16:18 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:16:18 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:16:18 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.5} {Hostname k8s-master-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1a9da6632c314858a31bccaea0be0f50,SystemUUID:8F48A76E-30E1-B948-89B2-33C0048059B4,BootID:1597124c-68a3-452c-ae03-6cfe9bc1e57f,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:16:29.590] Nov 6 01:16:29.588: INFO: I1106 01:16:29.590] Logging kubelet events for node k8s-master-73731178-vmss000001 I1106 01:16:29.671] Nov 6 01:16:29.671: INFO: I1106 01:16:29.671] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000001 I1106 01:16:29.759] Nov 6 01:16:29.759: INFO: kube-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:16:29.759] Nov 6 01:16:29.759: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:16:29.759] Nov 6 01:16:29.759: INFO: azure-ip-masq-agent-825g9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:29.760] Nov 6 01:16:29.759: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:16:29.760] Nov 6 01:16:29.759: INFO: kube-proxy-8924t started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:29.760] Nov 6 01:16:29.759: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:16:29.760] Nov 6 01:16:29.759: INFO: kube-scheduler-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:16:29.760] Nov 6 01:16:29.759: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:16:29.761] Nov 6 01:16:29.759: INFO: cloud-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:16:29.761] Nov 6 01:16:29.759: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:16:29.761] Nov 6 01:16:29.759: INFO: kube-addon-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:16:29.761] Nov 6 01:16:29.759: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:16:29.761] Nov 6 01:16:29.759: INFO: kube-apiserver-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:16:29.761] Nov 6 01:16:29.759: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:16:30.031] Nov 6 01:16:30.031: INFO: I1106 01:16:30.032] Latency metrics for node k8s-master-73731178-vmss000001 I1106 01:16:30.032] Nov 6 01:16:30.031: INFO: I1106 01:16:30.032] Logging node info for node k8s-master-73731178-vmss000002 I1106 01:16:30.117] Nov 6 01:16:30.115: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000002,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000002,UID:6cf1398e-1b6b-4537-837d-9ffceb9a4f00,ResourceVersion:20262,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000002,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.6.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/2,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:27:55 +0000 UTC 2019-11-05 23:27:55 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:15:38 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:15:38 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:15:38 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:15:38 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.6} {Hostname k8s-master-73731178-vmss000002}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7964689c8ba4f448e6f435b3d4fefac,SystemUUID:9369535A-87BF-1E4B-86DF-5D1A23713C9F,BootID:74f93904-298f-454d-8df6-8d4bba193331,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:16:30.118] Nov 6 01:16:30.115: INFO: I1106 01:16:30.118] Logging kubelet events for node k8s-master-73731178-vmss000002 I1106 01:16:30.199] Nov 6 01:16:30.199: INFO: I1106 01:16:30.199] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000002 I1106 01:16:30.286] Nov 6 01:16:30.286: INFO: cloud-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:16:30.286] Nov 6 01:16:30.286: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:16:30.287] Nov 6 01:16:30.286: INFO: azure-ip-masq-agent-74xks started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:30.287] Nov 6 01:16:30.286: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:16:30.287] Nov 6 01:16:30.286: INFO: kube-proxy-t958f started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:30.287] Nov 6 01:16:30.286: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:16:30.287] Nov 6 01:16:30.286: INFO: kube-addon-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:18 +0000 UTC (0+1 container statuses recorded) I1106 01:16:30.287] Nov 6 01:16:30.286: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:16:30.288] Nov 6 01:16:30.286: INFO: kube-apiserver-k8s-master-73731178-vmss000002 started at 2019-11-05 23:28:42 +0000 UTC (0+1 container statuses recorded) I1106 01:16:30.288] Nov 6 01:16:30.286: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:16:30.288] Nov 6 01:16:30.286: INFO: kube-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:16:30.288] Nov 6 01:16:30.286: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:16:30.288] Nov 6 01:16:30.286: INFO: kube-scheduler-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:16:30.288] Nov 6 01:16:30.286: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:16:30.557] Nov 6 01:16:30.557: INFO: I1106 01:16:30.557] Latency metrics for node k8s-master-73731178-vmss000002 I1106 01:16:30.557] Nov 6 01:16:30.557: INFO: I1106 01:16:30.557] Logging node info for node k8s-master-73731178-vmss000003 I1106 01:16:30.644] Nov 6 01:16:30.641: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000003,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000003,UID:54efc1b0-183c-4153-b804-31d0d42ce204,ResourceVersion:20256,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000003,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/3,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:15:35 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{Hostname k8s-master-73731178-vmss000003} {InternalIP 10.240.0.7}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a448072d2d27400fa2252a0cb3c8ff37,SystemUUID:98F6A517-FFCA-8E4D-A914-52A5F1482433,BootID:50c0f9e6-7c4d-45ec-8984-248ea540d637,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:16:30.644] Nov 6 01:16:30.641: INFO: I1106 01:16:30.644] Logging kubelet events for node k8s-master-73731178-vmss000003 I1106 01:16:30.725] Nov 6 01:16:30.725: INFO: I1106 01:16:30.725] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000003 I1106 01:16:30.813] Nov 6 01:16:30.813: INFO: kube-apiserver-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:30.813] Nov 6 01:16:30.813: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:16:30.814] Nov 6 01:16:30.813: INFO: kube-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:30.814] Nov 6 01:16:30.813: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:16:30.814] Nov 6 01:16:30.813: INFO: kube-scheduler-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:30.814] Nov 6 01:16:30.813: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:16:30.814] Nov 6 01:16:30.813: INFO: azure-ip-masq-agent-4nshf started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:30.814] Nov 6 01:16:30.813: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:16:30.815] Nov 6 01:16:30.813: INFO: kube-proxy-qm7rq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:16:30.815] Nov 6 01:16:30.813: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:16:30.815] Nov 6 01:16:30.813: INFO: cloud-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:30.815] Nov 6 01:16:30.813: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:16:30.815] Nov 6 01:16:30.813: INFO: kube-addon-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:43 +0000 UTC (0+1 container statuses recorded) I1106 01:16:30.815] Nov 6 01:16:30.813: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:16:31.082] Nov 6 01:16:31.081: INFO: I1106 01:16:31.082] Latency metrics for node k8s-master-73731178-vmss000003 I1106 01:16:31.082] Nov 6 01:16:31.081: INFO: I1106 01:16:31.082] Logging node info for node k8s-master-73731178-vmss000004 I1106 01:16:31.168] Nov 6 01:16:31.165: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000004,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000004,UID:4a582f8b-6cf2-4e91-8770-fde6f9c22194,ResourceVersion:20249,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000004,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/4,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:32 +0000 UTC 2019-11-05 23:28:32 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:15:33 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:15:33 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:15:33 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:15:33 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.8} {Hostname k8s-master-73731178-vmss000004}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:252c632059f2483d87e2d8d689053e48,SystemUUID:5BBFFB00-FBAB-0F4A-8F63-6B99DE219F64,BootID:165ca62a-8171-48e8-92f7-3ad786cb6b9a,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:16:31.168] Nov 6 01:16:31.166: INFO: I1106 01:16:31.168] Logging kubelet events for node k8s-master-73731178-vmss000004 I1106 01:16:31.249] Nov 6 01:16:31.249: INFO: I1106 01:16:31.250] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000004 I1106 01:16:31.336] Nov 6 01:16:31.336: INFO: kube-addon-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:31.337] Nov 6 01:16:31.336: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:16:31.337] Nov 6 01:16:31.336: INFO: kube-apiserver-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:31.337] Nov 6 01:16:31.336: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:16:31.337] Nov 6 01:16:31.336: INFO: kube-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:31.337] Nov 6 01:16:31.336: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:16:31.338] Nov 6 01:16:31.336: INFO: kube-scheduler-k8s-master-73731178-vmss000004 started at 2019-11-05 23:28:31 +0000 UTC (0+1 container statuses recorded) I1106 01:16:31.338] Nov 6 01:16:31.336: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:16:31.338] Nov 6 01:16:31.336: INFO: azure-ip-masq-agent-rh9pr started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:16:31.338] Nov 6 01:16:31.336: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:16:31.338] Nov 6 01:16:31.336: INFO: kube-proxy-rk5r6 started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:16:31.339] Nov 6 01:16:31.336: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:16:31.339] Nov 6 01:16:31.336: INFO: cloud-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:16:31.339] Nov 6 01:16:31.336: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:16:31.614] Nov 6 01:16:31.613: INFO: I1106 01:16:31.614] Latency metrics for node k8s-master-73731178-vmss000004 I1106 01:16:31.614] Nov 6 01:16:31.613: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1106 01:16:31.699] STEP: Destroying namespace "azuredisk-7467" for this suite. I1106 01:16:45.961] Nov 6 01:16:45.961: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1106 01:16:49.168] Nov 6 01:16:49.167: INFO: namespace azuredisk-7467 deletion completed in 17.468760576s I1106 01:16:49.168] [AfterEach] [azuredisk-csi-e2e] [single-az] Pre-Provisioned I1106 01:16:49.168] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning.go:54 I1106 01:16:49.666] I1106 01:16:49.666] •! Panic [25.084 seconds] I1106 01:16:49.666] [azuredisk-csi-e2e] [single-az] Pre-Provisioned I1106 01:16:49.666] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning.go:36 I1106 01:16:49.666] [env] should use a pre-provisioned volume and retain PV with reclaimPolicy "Retain" [It] I1106 01:16:49.667] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning.go:100 I1106 01:16:49.667] I1106 01:16:49.667] Test Panicked I1106 01:16:49.667] runtime error: invalid memory address or nil pointer dereference I1106 01:16:49.667] /usr/local/go/src/runtime/panic.go:82 I1106 01:16:49.667] I1106 01:16:49.667] Full Stack Trace I1106 01:16:49.667] /usr/local/go/src/runtime/panic.go:522 +0x1b5 I1106 01:16:49.668] sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*TestPersistentVolumeClaim).Cleanup(0xc000bfc8a0) I1106 01:16:49.668] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:313 +0x3b I1106 01:16:49.668] sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites.(*PreProvisionedReclaimPolicyTest).Run(0xc000ef34e0, 0x20e15e0, 0xc000842000, 0xc000b64840) I1106 01:16:49.668] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/pre_provisioned_reclaim_policy_tester.go:37 +0x10f I1106 01:16:49.668] sigs.k8s.io/azuredisk-csi-driver/test/e2e.glob..func2.4() I1106 01:16:49.669] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning.go:123 +0x529 I1106 01:16:49.669] sigs.k8s.io/azuredisk-csi-driver/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).runSync(0xc0000d1c80, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) I1106 01:16:49.669] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:132 +0xa4 I1106 01:16:49.669] testing.tRunner(0xc0002a8900, 0x1e2db38) I1106 01:16:49.669] /usr/local/go/src/testing/testing.go:865 +0xc0 I1106 01:16:49.669] created by testing.(*T).Run I1106 01:16:49.670] /usr/local/go/src/testing/testing.go:916 +0x35a I1106 01:16:49.670] I1106 01:16:49.670] ------------------------------ I1106 01:16:49.670] [azuredisk-csi-e2e] Dynamic Provisioning [multi-az] I1106 01:16:49.670] [env] should retain PV with reclaimPolicy "Retain" I1106 01:16:49.670] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:240 I1106 01:16:49.670] [BeforeEach] [multi-az] I1106 01:16:49.671] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1106 01:16:49.671] STEP: Creating a kubernetes client I1106 01:16:49.671] Nov 6 01:16:49.666: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1106 01:16:49.671] STEP: Building a namespace api object, basename azuredisk I1106 01:16:49.928] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-5705 I1106 01:16:50.201] STEP: Waiting for a default service account to be provisioned in namespace I1106 01:16:50.282] [BeforeEach] [multi-az] I1106 01:16:50.283] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:58 I1106 01:16:50.283] [It] [env] should retain PV with reclaimPolicy "Retain" I1106 01:16:50.283] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:240 I1106 01:16:50.283] STEP: setting up the StorageClass I1106 01:16:50.283] STEP: creating a StorageClass I1106 01:16:50.375] STEP: setting up the PVC and PV I1106 01:16:50.375] STEP: creating a PVC I1106 01:16:50.467] STEP: waiting for PVC to be in phase "Bound" I1106 01:16:50.468] Nov 6 01:16:50.467: INFO: Waiting up to 5m0s for PersistentVolumeClaims [pvc-l88cs] to have phase Bound I1106 01:16:50.551] Nov 6 01:16:50.550: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:16:52.639] Nov 6 01:16:52.638: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:16:54.723] Nov 6 01:16:54.723: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:16:56.807] Nov 6 01:16:56.807: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:16:58.891] Nov 6 01:16:58.891: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:00.976] Nov 6 01:17:00.976: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:03.060] Nov 6 01:17:03.060: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:05.146] Nov 6 01:17:05.145: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:07.232] Nov 6 01:17:07.231: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:09.317] Nov 6 01:17:09.316: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:11.401] Nov 6 01:17:11.401: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:13.485] Nov 6 01:17:13.485: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:15.570] Nov 6 01:17:15.570: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:17.654] Nov 6 01:17:17.654: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:19.738] Nov 6 01:17:19.738: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:21.824] Nov 6 01:17:21.824: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:23.908] Nov 6 01:17:23.908: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:25.992] Nov 6 01:17:25.992: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:28.077] Nov 6 01:17:28.076: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:30.163] Nov 6 01:17:30.163: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:32.248] Nov 6 01:17:32.247: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:34.332] Nov 6 01:17:34.332: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:36.416] Nov 6 01:17:36.416: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:38.503] Nov 6 01:17:38.502: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:40.587] Nov 6 01:17:40.587: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:42.672] Nov 6 01:17:42.671: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:44.757] Nov 6 01:17:44.756: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:46.845] Nov 6 01:17:46.845: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:48.930] Nov 6 01:17:48.929: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:51.013] Nov 6 01:17:51.013: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:53.100] Nov 6 01:17:53.100: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:55.184] Nov 6 01:17:55.184: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:57.269] Nov 6 01:17:57.269: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:17:59.353] Nov 6 01:17:59.353: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:01.438] Nov 6 01:18:01.438: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:03.522] Nov 6 01:18:03.522: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:05.606] Nov 6 01:18:05.606: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:07.690] Nov 6 01:18:07.690: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:09.774] Nov 6 01:18:09.774: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:11.858] Nov 6 01:18:11.857: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:13.942] Nov 6 01:18:13.941: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:16.061] Nov 6 01:18:16.061: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:18.145] Nov 6 01:18:18.144: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:20.241] Nov 6 01:18:20.240: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:22.325] Nov 6 01:18:22.324: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:24.409] Nov 6 01:18:24.409: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:26.493] Nov 6 01:18:26.493: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:28.580] Nov 6 01:18:28.579: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:30.664] Nov 6 01:18:30.664: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:32.749] Nov 6 01:18:32.749: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:34.833] Nov 6 01:18:34.833: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:36.918] Nov 6 01:18:36.917: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:39.002] Nov 6 01:18:39.002: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:41.086] Nov 6 01:18:41.086: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:43.170] Nov 6 01:18:43.170: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:45.255] Nov 6 01:18:45.255: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:47.340] Nov 6 01:18:47.340: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:49.424] Nov 6 01:18:49.424: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:51.509] Nov 6 01:18:51.508: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:53.593] Nov 6 01:18:53.593: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:55.677] Nov 6 01:18:55.677: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:57.762] Nov 6 01:18:57.762: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:18:59.846] Nov 6 01:18:59.846: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:01.932] Nov 6 01:19:01.931: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:04.032] Nov 6 01:19:04.032: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:06.116] Nov 6 01:19:06.115: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:08.201] Nov 6 01:19:08.201: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:10.285] Nov 6 01:19:10.285: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:12.370] Nov 6 01:19:12.370: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:14.455] Nov 6 01:19:14.454: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:16.539] Nov 6 01:19:16.538: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:18.623] Nov 6 01:19:18.623: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:20.707] Nov 6 01:19:20.707: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:22.792] Nov 6 01:19:22.792: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:24.876] Nov 6 01:19:24.876: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:26.961] Nov 6 01:19:26.961: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:29.046] Nov 6 01:19:29.046: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:31.130] Nov 6 01:19:31.130: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:33.215] Nov 6 01:19:33.215: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:35.299] Nov 6 01:19:35.298: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:37.383] Nov 6 01:19:37.383: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:39.467] Nov 6 01:19:39.467: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:41.552] Nov 6 01:19:41.552: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:43.636] Nov 6 01:19:43.636: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:45.720] Nov 6 01:19:45.720: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:47.805] Nov 6 01:19:47.805: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:49.889] Nov 6 01:19:49.889: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:51.974] Nov 6 01:19:51.973: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:54.058] Nov 6 01:19:54.058: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:56.142] Nov 6 01:19:56.142: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:19:58.226] Nov 6 01:19:58.226: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:00.311] Nov 6 01:20:00.310: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:02.395] Nov 6 01:20:02.394: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:04.479] Nov 6 01:20:04.478: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:06.563] Nov 6 01:20:06.563: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:08.648] Nov 6 01:20:08.647: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:10.732] Nov 6 01:20:10.732: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:12.816] Nov 6 01:20:12.816: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:14.901] Nov 6 01:20:14.901: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:16.985] Nov 6 01:20:16.985: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:19.070] Nov 6 01:20:19.070: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:21.155] Nov 6 01:20:21.154: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:23.240] Nov 6 01:20:23.239: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:25.324] Nov 6 01:20:25.324: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:27.408] Nov 6 01:20:27.408: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:29.493] Nov 6 01:20:29.493: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:31.577] Nov 6 01:20:31.577: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:33.662] Nov 6 01:20:33.662: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:35.746] Nov 6 01:20:35.746: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:37.830] Nov 6 01:20:37.830: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:39.915] Nov 6 01:20:39.915: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:42.000] Nov 6 01:20:41.999: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:44.084] Nov 6 01:20:44.084: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:46.169] Nov 6 01:20:46.169: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:48.253] Nov 6 01:20:48.253: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:50.340] Nov 6 01:20:50.340: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:52.424] Nov 6 01:20:52.424: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:54.509] Nov 6 01:20:54.509: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:56.594] Nov 6 01:20:56.593: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:20:58.678] Nov 6 01:20:58.677: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:00.762] Nov 6 01:21:00.762: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:02.846] Nov 6 01:21:02.846: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:04.931] Nov 6 01:21:04.931: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:07.016] Nov 6 01:21:07.015: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:09.099] Nov 6 01:21:09.099: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:11.184] Nov 6 01:21:11.184: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:13.268] Nov 6 01:21:13.268: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:15.352] Nov 6 01:21:15.352: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:17.436] Nov 6 01:21:17.436: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:19.521] Nov 6 01:21:19.520: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:21.605] Nov 6 01:21:21.605: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:23.689] Nov 6 01:21:23.689: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:25.774] Nov 6 01:21:25.773: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:27.859] Nov 6 01:21:27.858: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:29.943] Nov 6 01:21:29.943: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:32.035] Nov 6 01:21:32.035: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:34.119] Nov 6 01:21:34.119: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:36.203] Nov 6 01:21:36.203: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:38.287] Nov 6 01:21:38.287: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:40.372] Nov 6 01:21:40.372: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:42.456] Nov 6 01:21:42.456: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:44.542] Nov 6 01:21:44.542: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:46.627] Nov 6 01:21:46.627: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:48.711] Nov 6 01:21:48.711: INFO: PersistentVolumeClaim pvc-l88cs found but phase is Pending instead of Bound. I1106 01:21:50.712] Nov 6 01:21:50.711: INFO: Unexpected error occurred: PersistentVolumeClaims [pvc-l88cs] not all in phase Bound within 5m0s I1106 01:21:50.712] [AfterEach] [multi-az] I1106 01:21:50.712] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1106 01:21:50.712] STEP: Collecting events from namespace "azuredisk-5705". I1106 01:21:50.796] STEP: Found 3 events. I1106 01:21:50.796] Nov 6 01:21:50.796: INFO: At 2019-11-06 01:16:50 +0000 UTC - event for pvc-l88cs: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator I1106 01:21:50.797] Nov 6 01:21:50.796: INFO: At 2019-11-06 01:16:50 +0000 UTC - event for pvc-l88cs: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } Provisioning: External provisioner is provisioning volume for claim "azuredisk-5705/pvc-l88cs" I1106 01:21:50.797] Nov 6 01:21:50.796: INFO: At 2019-11-06 01:17:00 +0000 UTC - event for pvc-l88cs: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-5705-disk.csi.azure.com-dynamic-sc-4gwx7": rpc error: code = DeadlineExceeded desc = context deadline exceeded I1106 01:21:50.880] Nov 6 01:21:50.880: INFO: POD NODE PHASE GRACE CONDITIONS I1106 01:21:50.881] Nov 6 01:21:50.880: INFO: I1106 01:21:51.130] Nov 6 01:21:51.130: INFO: I1106 01:21:51.130] Logging node info for node k8s-agentpool-73731178-vmss000000 I1106 01:21:51.217] Nov 6 01:21:51.214: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000000,UID:e9bc0b16-6756-4155-b49c-e223c0ba9499,ResourceVersion:21294,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-1,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000000"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:18 +0000 UTC 2019-11-05 23:28:18 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:21:19 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:21:19 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:21:19 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:21:19 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.4} {Hostname k8s-agentpool-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:956ad861ae4a42099801f8e840b4e502,SystemUUID:439CF4B9-2B9F-B74E-9ED7-7379FD8BD0DF,BootID:bd3476e5-4fd4-4437-9b56-54fbe38a3a49,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1] 121711221} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/metrics-server-amd64@sha256:49a9f12f7067d11f42c803dbe61ed2c1299959ad85cb315b25ff7eef8e6b8892 k8s.gcr.io/metrics-server-amd64:v0.2.1] 42541759} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/disks/pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312],VolumesAttached:[],Config:nil,},} I1106 01:21:51.218] Nov 6 01:21:51.214: INFO: I1106 01:21:51.218] Logging kubelet events for node k8s-agentpool-73731178-vmss000000 I1106 01:21:51.298] Nov 6 01:21:51.298: INFO: I1106 01:21:51.298] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000000 I1106 01:21:51.387] Nov 6 01:21:51.387: INFO: kubernetes-dashboard-66dd8b8df7-4rnsp started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:21:51.387] Nov 6 01:21:51.387: INFO: Container kubernetes-dashboard ready: true, restart count 1 I1106 01:21:51.388] Nov 6 01:21:51.387: INFO: csi-azuredisk-node-g6wbm started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 01:21:51.388] Nov 6 01:21:51.387: INFO: Container azuredisk ready: true, restart count 0 I1106 01:21:51.388] Nov 6 01:21:51.387: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:21:51.388] Nov 6 01:21:51.387: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 01:21:51.388] Nov 6 01:21:51.387: INFO: blobfuse-flexvol-installer-cvgkv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:51.388] Nov 6 01:21:51.387: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 01:21:51.389] Nov 6 01:21:51.387: INFO: azure-ip-masq-agent-vn5zc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:51.389] Nov 6 01:21:51.387: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:21:51.389] Nov 6 01:21:51.387: INFO: keyvault-flexvolume-xr7v6 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:51.389] Nov 6 01:21:51.387: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 01:21:51.389] Nov 6 01:21:51.387: INFO: metrics-server-864ffbc5c-kb9cz started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:51.389] Nov 6 01:21:51.387: INFO: Container metrics-server ready: true, restart count 0 I1106 01:21:51.389] Nov 6 01:21:51.387: INFO: kube-proxy-jnqp8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:51.390] Nov 6 01:21:51.387: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:21:51.660] Nov 6 01:21:51.660: INFO: I1106 01:21:51.661] Latency metrics for node k8s-agentpool-73731178-vmss000000 I1106 01:21:51.661] Nov 6 01:21:51.660: INFO: I1106 01:21:51.661] Logging node info for node k8s-agentpool-73731178-vmss000001 I1106 01:21:51.748] Nov 6 01:21:51.745: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000001,UID:ab75ba9d-ec23-4ff7-ae5a-d1a19974c05d,ResourceVersion:21295,Generation:0,CreationTimestamp:2019-11-05 23:27:31 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-2,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000001"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.5.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:17 +0000 UTC 2019-11-05 23:28:17 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:21:19 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:21:19 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:21:19 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:21:19 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.5} {Hostname k8s-agentpool-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f0eae5e73d0f4ccb82dd0f22701c288f,SystemUUID:7E54C533-AED3-744D-8D17-EFF5E62EA06D,BootID:6d58e5a6-45fb-4a41-a491-bc2f3799f411,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[gcr.io/kubernetes-helm/tiller@sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1 gcr.io/kubernetes-helm/tiller:v2.11.0] 71821984} {[quay.io/k8scsi/csi-provisioner@sha256:d657c839dce87324fe2b677302913f9386f885f8746be7bea0ced5b0844e3433 quay.io/k8scsi/csi-provisioner:v1.3.1] 50596998} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0] 46226754} {[quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1] 45874691} {[quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb quay.io/k8scsi/csi-snapshotter:v1.1.0] 44325352} {[k8s.gcr.io/coredns@sha256:e83beb5e43f8513fa735e77ffc5859640baea30a882a11cc75c4c3244a737d3c k8s.gcr.io/coredns:1.5.0] 42488424} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0] 14967303} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:21:51.748] Nov 6 01:21:51.745: INFO: I1106 01:21:51.749] Logging kubelet events for node k8s-agentpool-73731178-vmss000001 I1106 01:21:51.834] Nov 6 01:21:51.834: INFO: I1106 01:21:51.834] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000001 I1106 01:21:51.924] Nov 6 01:21:51.924: INFO: csi-azuredisk-node-ml68k started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 01:21:51.925] Nov 6 01:21:51.924: INFO: Container azuredisk ready: true, restart count 0 I1106 01:21:51.925] Nov 6 01:21:51.924: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:21:51.925] Nov 6 01:21:51.924: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 01:21:51.925] Nov 6 01:21:51.924: INFO: kube-proxy-z4hf8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:51.925] Nov 6 01:21:51.924: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:21:51.926] Nov 6 01:21:51.924: INFO: tiller-deploy-54c96cb5df-wlzbj started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:21:51.926] Nov 6 01:21:51.924: INFO: Container tiller ready: true, restart count 0 I1106 01:21:51.926] Nov 6 01:21:51.924: INFO: csi-azuredisk-controller-59bf945f54-k2p5m started at 2019-11-05 23:30:58 +0000 UTC (0+6 container statuses recorded) I1106 01:21:51.926] Nov 6 01:21:51.924: INFO: Container azuredisk ready: true, restart count 0 I1106 01:21:51.926] Nov 6 01:21:51.924: INFO: Container cluster-driver-registrar ready: true, restart count 0 I1106 01:21:51.927] Nov 6 01:21:51.924: INFO: Container csi-attacher ready: true, restart count 0 I1106 01:21:51.927] Nov 6 01:21:51.924: INFO: Container csi-provisioner ready: true, restart count 0 I1106 01:21:51.927] Nov 6 01:21:51.924: INFO: Container csi-snapshotter ready: true, restart count 0 I1106 01:21:51.927] Nov 6 01:21:51.924: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:21:51.927] Nov 6 01:21:51.924: INFO: blobfuse-flexvol-installer-589vv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:51.927] Nov 6 01:21:51.924: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 01:21:51.928] Nov 6 01:21:51.924: INFO: coredns-7f68dcdbdb-f98nq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:51.928] Nov 6 01:21:51.924: INFO: Container coredns ready: true, restart count 0 I1106 01:21:51.928] Nov 6 01:21:51.924: INFO: azure-ip-masq-agent-6qqgc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:51.929] Nov 6 01:21:51.924: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:21:51.929] Nov 6 01:21:51.924: INFO: keyvault-flexvolume-7tztj started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:51.929] Nov 6 01:21:51.924: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 01:21:52.204] Nov 6 01:21:52.204: INFO: I1106 01:21:52.204] Latency metrics for node k8s-agentpool-73731178-vmss000001 I1106 01:21:52.204] Nov 6 01:21:52.204: INFO: I1106 01:21:52.204] Logging node info for node k8s-master-73731178-vmss000000 I1106 01:21:52.291] Nov 6 01:21:52.288: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000000,UID:1f765350-accc-4e67-898b-e4d84be84901,ResourceVersion:21345,Generation:0,CreationTimestamp:2019-11-05 23:27:30 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:21:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:21:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:21:35 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:21:35 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.4} {Hostname k8s-master-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:836af7329e85492184d73f1ea7f63a4e,SystemUUID:D1C68207-4499-C24D-B9D6-ADA0554A1BE5,BootID:a29dde5d-b4dc-483e-a50e-76e79359d759,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:21:52.291] Nov 6 01:21:52.288: INFO: I1106 01:21:52.291] Logging kubelet events for node k8s-master-73731178-vmss000000 I1106 01:21:52.378] Nov 6 01:21:52.378: INFO: I1106 01:21:52.379] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000000 I1106 01:21:52.468] Nov 6 01:21:52.467: INFO: cloud-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:21:52.468] Nov 6 01:21:52.467: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:21:52.468] Nov 6 01:21:52.467: INFO: kube-addon-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:21:52.468] Nov 6 01:21:52.467: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:21:52.469] Nov 6 01:21:52.467: INFO: kube-apiserver-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:21:52.469] Nov 6 01:21:52.467: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:21:52.469] Nov 6 01:21:52.467: INFO: azure-ip-masq-agent-xmkx2 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:52.469] Nov 6 01:21:52.467: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:21:52.469] Nov 6 01:21:52.467: INFO: kube-proxy-2fwv9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:52.469] Nov 6 01:21:52.467: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:21:52.470] Nov 6 01:21:52.467: INFO: kube-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:21:52.470] Nov 6 01:21:52.467: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:21:52.470] Nov 6 01:21:52.467: INFO: kube-scheduler-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:21:52.470] Nov 6 01:21:52.467: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:21:52.743] Nov 6 01:21:52.743: INFO: I1106 01:21:52.743] Latency metrics for node k8s-master-73731178-vmss000000 I1106 01:21:52.743] Nov 6 01:21:52.743: INFO: I1106 01:21:52.743] Logging node info for node k8s-master-73731178-vmss000001 I1106 01:21:52.830] Nov 6 01:21:52.827: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000001,UID:442cf114-6b0a-4c80-a9e5-be62e184f94c,ResourceVersion:21293,Generation:0,CreationTimestamp:2019-11-05 23:27:42 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:19 +0000 UTC 2019-11-05 23:28:19 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:21:18 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:21:18 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:21:18 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:21:18 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.5} {Hostname k8s-master-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1a9da6632c314858a31bccaea0be0f50,SystemUUID:8F48A76E-30E1-B948-89B2-33C0048059B4,BootID:1597124c-68a3-452c-ae03-6cfe9bc1e57f,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:21:52.830] Nov 6 01:21:52.827: INFO: I1106 01:21:52.830] Logging kubelet events for node k8s-master-73731178-vmss000001 I1106 01:21:52.911] Nov 6 01:21:52.911: INFO: I1106 01:21:52.911] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000001 I1106 01:21:53.001] Nov 6 01:21:53.001: INFO: kube-scheduler-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:21:53.001] Nov 6 01:21:53.001: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:21:53.002] Nov 6 01:21:53.001: INFO: cloud-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:21:53.002] Nov 6 01:21:53.001: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:21:53.002] Nov 6 01:21:53.001: INFO: kube-addon-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:21:53.002] Nov 6 01:21:53.001: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:21:53.002] Nov 6 01:21:53.001: INFO: kube-apiserver-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:21:53.003] Nov 6 01:21:53.001: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:21:53.003] Nov 6 01:21:53.001: INFO: kube-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:21:53.003] Nov 6 01:21:53.001: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:21:53.003] Nov 6 01:21:53.001: INFO: azure-ip-masq-agent-825g9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:53.003] Nov 6 01:21:53.001: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:21:53.003] Nov 6 01:21:53.001: INFO: kube-proxy-8924t started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:53.004] Nov 6 01:21:53.001: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:21:53.278] Nov 6 01:21:53.277: INFO: I1106 01:21:53.278] Latency metrics for node k8s-master-73731178-vmss000001 I1106 01:21:53.278] Nov 6 01:21:53.277: INFO: I1106 01:21:53.278] Logging node info for node k8s-master-73731178-vmss000002 I1106 01:21:53.364] Nov 6 01:21:53.361: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000002,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000002,UID:6cf1398e-1b6b-4537-837d-9ffceb9a4f00,ResourceVersion:21356,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000002,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.6.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/2,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:27:55 +0000 UTC 2019-11-05 23:27:55 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:21:38 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:21:38 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:21:38 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:21:38 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.6} {Hostname k8s-master-73731178-vmss000002}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7964689c8ba4f448e6f435b3d4fefac,SystemUUID:9369535A-87BF-1E4B-86DF-5D1A23713C9F,BootID:74f93904-298f-454d-8df6-8d4bba193331,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:21:53.364] Nov 6 01:21:53.361: INFO: I1106 01:21:53.364] Logging kubelet events for node k8s-master-73731178-vmss000002 I1106 01:21:53.446] Nov 6 01:21:53.446: INFO: I1106 01:21:53.446] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000002 I1106 01:21:53.535] Nov 6 01:21:53.535: INFO: cloud-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:21:53.536] Nov 6 01:21:53.535: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:21:53.536] Nov 6 01:21:53.535: INFO: azure-ip-masq-agent-74xks started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:53.536] Nov 6 01:21:53.535: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:21:53.536] Nov 6 01:21:53.535: INFO: kube-proxy-t958f started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:53.536] Nov 6 01:21:53.535: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:21:53.536] Nov 6 01:21:53.535: INFO: kube-addon-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:18 +0000 UTC (0+1 container statuses recorded) I1106 01:21:53.537] Nov 6 01:21:53.535: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:21:53.537] Nov 6 01:21:53.535: INFO: kube-apiserver-k8s-master-73731178-vmss000002 started at 2019-11-05 23:28:42 +0000 UTC (0+1 container statuses recorded) I1106 01:21:53.537] Nov 6 01:21:53.535: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:21:53.537] Nov 6 01:21:53.535: INFO: kube-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:21:53.537] Nov 6 01:21:53.535: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:21:53.538] Nov 6 01:21:53.535: INFO: kube-scheduler-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:21:53.538] Nov 6 01:21:53.535: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:21:53.806] Nov 6 01:21:53.806: INFO: I1106 01:21:53.806] Latency metrics for node k8s-master-73731178-vmss000002 I1106 01:21:53.807] Nov 6 01:21:53.806: INFO: I1106 01:21:53.807] Logging node info for node k8s-master-73731178-vmss000003 I1106 01:21:53.893] Nov 6 01:21:53.890: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000003,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000003,UID:54efc1b0-183c-4153-b804-31d0d42ce204,ResourceVersion:21350,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000003,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/3,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:21:36 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:21:36 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:21:36 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:21:36 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{Hostname k8s-master-73731178-vmss000003} {InternalIP 10.240.0.7}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a448072d2d27400fa2252a0cb3c8ff37,SystemUUID:98F6A517-FFCA-8E4D-A914-52A5F1482433,BootID:50c0f9e6-7c4d-45ec-8984-248ea540d637,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:21:53.893] Nov 6 01:21:53.890: INFO: I1106 01:21:53.893] Logging kubelet events for node k8s-master-73731178-vmss000003 I1106 01:21:53.974] Nov 6 01:21:53.974: INFO: I1106 01:21:53.975] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000003 I1106 01:21:54.064] Nov 6 01:21:54.064: INFO: kube-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:21:54.064] Nov 6 01:21:54.064: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:21:54.065] Nov 6 01:21:54.064: INFO: kube-scheduler-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:21:54.065] Nov 6 01:21:54.064: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:21:54.065] Nov 6 01:21:54.064: INFO: azure-ip-masq-agent-4nshf started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:54.065] Nov 6 01:21:54.064: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:21:54.065] Nov 6 01:21:54.064: INFO: kube-proxy-qm7rq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:21:54.066] Nov 6 01:21:54.064: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:21:54.066] Nov 6 01:21:54.064: INFO: cloud-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:21:54.066] Nov 6 01:21:54.064: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:21:54.066] Nov 6 01:21:54.064: INFO: kube-addon-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:43 +0000 UTC (0+1 container statuses recorded) I1106 01:21:54.066] Nov 6 01:21:54.064: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:21:54.066] Nov 6 01:21:54.064: INFO: kube-apiserver-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:21:54.067] Nov 6 01:21:54.064: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:21:54.334] Nov 6 01:21:54.333: INFO: I1106 01:21:54.334] Latency metrics for node k8s-master-73731178-vmss000003 I1106 01:21:54.334] Nov 6 01:21:54.334: INFO: I1106 01:21:54.334] Logging node info for node k8s-master-73731178-vmss000004 I1106 01:21:54.421] Nov 6 01:21:54.418: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000004,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000004,UID:4a582f8b-6cf2-4e91-8770-fde6f9c22194,ResourceVersion:21343,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000004,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/4,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:32 +0000 UTC 2019-11-05 23:28:32 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:21:34 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:21:34 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:21:34 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:21:34 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.8} {Hostname k8s-master-73731178-vmss000004}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:252c632059f2483d87e2d8d689053e48,SystemUUID:5BBFFB00-FBAB-0F4A-8F63-6B99DE219F64,BootID:165ca62a-8171-48e8-92f7-3ad786cb6b9a,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:21:54.421] Nov 6 01:21:54.418: INFO: I1106 01:21:54.421] Logging kubelet events for node k8s-master-73731178-vmss000004 I1106 01:21:54.502] Nov 6 01:21:54.502: INFO: I1106 01:21:54.502] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000004 I1106 01:21:54.590] Nov 6 01:21:54.590: INFO: cloud-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:21:54.590] Nov 6 01:21:54.590: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:21:54.590] Nov 6 01:21:54.590: INFO: kube-addon-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:21:54.591] Nov 6 01:21:54.590: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:21:54.591] Nov 6 01:21:54.590: INFO: kube-apiserver-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:21:54.591] Nov 6 01:21:54.590: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:21:54.591] Nov 6 01:21:54.590: INFO: kube-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:21:54.591] Nov 6 01:21:54.590: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:21:54.592] Nov 6 01:21:54.590: INFO: kube-scheduler-k8s-master-73731178-vmss000004 started at 2019-11-05 23:28:31 +0000 UTC (0+1 container statuses recorded) I1106 01:21:54.592] Nov 6 01:21:54.590: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:21:54.592] Nov 6 01:21:54.590: INFO: azure-ip-masq-agent-rh9pr started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:21:54.592] Nov 6 01:21:54.590: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:21:54.592] Nov 6 01:21:54.590: INFO: kube-proxy-rk5r6 started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:21:54.592] Nov 6 01:21:54.590: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:21:54.861] Nov 6 01:21:54.860: INFO: I1106 01:21:54.861] Latency metrics for node k8s-master-73731178-vmss000004 I1106 01:21:54.861] Nov 6 01:21:54.860: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1106 01:21:54.945] STEP: Destroying namespace "azuredisk-5705" for this suite. I1106 01:22:09.203] Nov 6 01:22:09.203: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1106 01:22:12.413] Nov 6 01:22:12.412: INFO: namespace azuredisk-5705 deletion completed in 17.467345157s I1106 01:22:12.413] I1106 01:22:12.413] • Failure [322.747 seconds] I1106 01:22:12.413] [azuredisk-csi-e2e] Dynamic Provisioning I1106 01:22:12.413] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:33 I1106 01:22:12.413] [multi-az] I1106 01:22:12.414] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:40 I1106 01:22:12.414] [env] should retain PV with reclaimPolicy "Retain" [It] I1106 01:22:12.414] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:240 I1106 01:22:12.414] I1106 01:22:12.414] Unexpected error: I1106 01:22:12.414] <*errors.errorString | 0xc000bc16f0>: { I1106 01:22:12.414] s: "PersistentVolumeClaims [pvc-l88cs] not all in phase Bound within 5m0s", I1106 01:22:12.415] } I1106 01:22:12.415] PersistentVolumeClaims [pvc-l88cs] not all in phase Bound within 5m0s I1106 01:22:12.415] occurred I1106 01:22:12.415] I1106 01:22:12.415] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1106 01:22:12.415] ------------------------------ I1106 01:22:12.415] [azuredisk-csi-e2e] Dynamic Provisioning [multi-az] I1106 01:22:12.416] should create a volume on demand and mount it as readOnly in a pod I1106 01:22:12.416] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:126 I1106 01:22:12.416] [BeforeEach] [multi-az] I1106 01:22:12.416] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:150 I1106 01:22:12.416] STEP: Creating a kubernetes client I1106 01:22:12.416] Nov 6 01:22:12.413: INFO: >>> kubeConfig: /workspace/aks761846597/kubeconfig/kubeconfig.eastus2.json I1106 01:22:12.417] STEP: Building a namespace api object, basename azuredisk I1106 01:22:12.673] STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in azuredisk-4885 I1106 01:22:12.944] STEP: Waiting for a default service account to be provisioned in namespace I1106 01:22:13.026] [BeforeEach] [multi-az] I1106 01:22:13.026] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:58 I1106 01:22:13.026] [It] should create a volume on demand and mount it as readOnly in a pod I1106 01:22:13.026] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:126 I1106 01:22:13.026] STEP: setting up the StorageClass I1106 01:22:13.026] STEP: creating a StorageClass I1106 01:22:13.110] STEP: setting up the PVC and PV I1106 01:22:13.110] STEP: creating a PVC I1106 01:22:13.196] STEP: deploying the pod I1106 01:22:13.275] STEP: checking that the pods command exits with an error I1106 01:22:13.275] Nov 6 01:22:13.275: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-qtf4g" in namespace "azuredisk-4885" to be "Error status code" I1106 01:22:13.349] Nov 6 01:22:13.349: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 74.598678ms I1106 01:22:15.425] Nov 6 01:22:15.425: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2.150439252s I1106 01:22:17.501] Nov 6 01:22:17.500: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4.225749022s I1106 01:22:19.576] Nov 6 01:22:19.575: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6.300689489s I1106 01:22:21.652] Nov 6 01:22:21.652: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8.376959366s I1106 01:22:23.727] Nov 6 01:22:23.727: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10.452272736s I1106 01:22:25.803] Nov 6 01:22:25.803: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12.527943409s I1106 01:22:27.880] Nov 6 01:22:27.880: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14.605094393s I1106 01:22:29.956] Nov 6 01:22:29.955: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 16.680608664s I1106 01:22:32.053] Nov 6 01:22:32.053: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 18.777998705s I1106 01:22:34.130] Nov 6 01:22:34.130: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 20.855029788s I1106 01:22:36.206] Nov 6 01:22:36.206: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 22.931119464s I1106 01:22:38.282] Nov 6 01:22:38.281: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 25.006632036s I1106 01:22:40.357] Nov 6 01:22:40.357: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 27.082282808s I1106 01:22:42.433] Nov 6 01:22:42.432: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 29.157590478s I1106 01:22:44.509] Nov 6 01:22:44.509: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 31.233812655s I1106 01:22:46.584] Nov 6 01:22:46.584: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 33.309235926s I1106 01:22:48.660] Nov 6 01:22:48.660: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 35.384814598s I1106 01:22:50.735] Nov 6 01:22:50.735: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 37.460509171s I1106 01:22:52.811] Nov 6 01:22:52.810: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 39.53572714s I1106 01:22:54.886] Nov 6 01:22:54.886: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 41.610949009s I1106 01:22:56.962] Nov 6 01:22:56.962: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 43.686982384s I1106 01:22:59.038] Nov 6 01:22:59.038: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 45.76300406s I1106 01:23:01.117] Nov 6 01:23:01.117: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 47.841933457s I1106 01:23:03.192] Nov 6 01:23:03.192: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 49.916836324s I1106 01:23:05.271] Nov 6 01:23:05.271: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 51.995853923s I1106 01:23:07.346] Nov 6 01:23:07.346: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 54.071434395s I1106 01:23:09.422] Nov 6 01:23:09.422: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 56.147139867s I1106 01:23:11.498] Nov 6 01:23:11.498: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 58.223007142s I1106 01:23:13.573] Nov 6 01:23:13.573: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.298533713s I1106 01:23:15.649] Nov 6 01:23:15.649: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.373920583s I1106 01:23:17.725] Nov 6 01:23:17.725: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.449814958s I1106 01:23:19.800] Nov 6 01:23:19.800: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.524930326s I1106 01:23:21.875] Nov 6 01:23:21.875: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.600450598s I1106 01:23:23.951] Nov 6 01:23:23.951: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.676028869s I1106 01:23:26.027] Nov 6 01:23:26.026: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.751593441s I1106 01:23:28.102] Nov 6 01:23:28.102: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.827416715s I1106 01:23:30.178] Nov 6 01:23:30.177: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.902685684s I1106 01:23:32.253] Nov 6 01:23:32.253: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.978345557s I1106 01:23:34.329] Nov 6 01:23:34.328: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m21.053750827s I1106 01:23:36.404] Nov 6 01:23:36.404: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m23.129282299s I1106 01:23:38.480] Nov 6 01:23:38.480: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m25.20481987s I1106 01:23:40.555] Nov 6 01:23:40.555: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m27.280022339s I1106 01:23:42.630] Nov 6 01:23:42.630: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m29.355336009s I1106 01:23:44.706] Nov 6 01:23:44.706: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m31.431009182s I1106 01:23:46.781] Nov 6 01:23:46.781: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m33.506269851s I1106 01:23:48.858] Nov 6 01:23:48.858: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m35.583335434s I1106 01:23:50.934] Nov 6 01:23:50.934: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m37.658832806s I1106 01:23:53.010] Nov 6 01:23:53.010: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m39.734848681s I1106 01:23:55.086] Nov 6 01:23:55.086: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m41.811007057s I1106 01:23:57.170] Nov 6 01:23:57.170: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m43.894983394s I1106 01:23:59.246] Nov 6 01:23:59.245: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m45.970588766s I1106 01:24:01.321] Nov 6 01:24:01.320: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.045739934s I1106 01:24:03.396] Nov 6 01:24:03.396: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.121494908s I1106 01:24:05.472] Nov 6 01:24:05.472: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.197524883s I1106 01:24:07.549] Nov 6 01:24:07.548: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.273628059s I1106 01:24:09.624] Nov 6 01:24:09.624: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.34910513s I1106 01:24:11.700] Nov 6 01:24:11.699: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.424616701s I1106 01:24:13.776] Nov 6 01:24:13.775: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.500763877s I1106 01:24:15.851] Nov 6 01:24:15.851: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.576223948s I1106 01:24:17.927] Nov 6 01:24:17.927: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.652451525s I1106 01:24:20.008] Nov 6 01:24:20.008: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.733312238s I1106 01:24:22.084] Nov 6 01:24:22.084: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.80897681s I1106 01:24:24.159] Nov 6 01:24:24.159: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.884247379s I1106 01:24:26.235] Nov 6 01:24:26.235: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.960005453s I1106 01:24:28.311] Nov 6 01:24:28.311: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m15.036093428s I1106 01:24:30.387] Nov 6 01:24:30.386: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m17.111776901s I1106 01:24:32.462] Nov 6 01:24:32.462: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m19.187244672s I1106 01:24:34.538] Nov 6 01:24:34.538: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m21.262962745s I1106 01:24:36.614] Nov 6 01:24:36.614: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m23.338897419s I1106 01:24:38.689] Nov 6 01:24:38.689: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m25.41441029s I1106 01:24:40.765] Nov 6 01:24:40.764: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m27.48969626s I1106 01:24:42.840] Nov 6 01:24:42.840: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m29.56512983s I1106 01:24:44.916] Nov 6 01:24:44.915: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m31.640784503s I1106 01:24:46.991] Nov 6 01:24:46.991: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m33.716391375s I1106 01:24:49.067] Nov 6 01:24:49.067: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m35.792208648s I1106 01:24:51.144] Nov 6 01:24:51.144: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m37.869538534s I1106 01:24:53.231] Nov 6 01:24:53.230: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m39.955637587s I1106 01:24:55.306] Nov 6 01:24:55.306: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.030953457s I1106 01:24:57.381] Nov 6 01:24:57.381: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.106114125s I1106 01:24:59.457] Nov 6 01:24:59.456: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.181673397s I1106 01:25:01.534] Nov 6 01:25:01.534: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.259233184s I1106 01:25:03.610] Nov 6 01:25:03.610: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.334830155s I1106 01:25:05.688] Nov 6 01:25:05.687: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.412684545s I1106 01:25:07.763] Nov 6 01:25:07.763: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.487847713s I1106 01:25:09.838] Nov 6 01:25:09.838: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.562997482s I1106 01:25:11.916] Nov 6 01:25:11.916: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.641510476s I1106 01:25:13.992] Nov 6 01:25:13.992: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.717043847s I1106 01:25:16.067] Nov 6 01:25:16.067: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.792447218s I1106 01:25:18.151] Nov 6 01:25:18.151: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.876382654s I1106 01:25:20.247] Nov 6 01:25:20.247: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.97181428s I1106 01:25:22.331] Nov 6 01:25:22.331: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m9.056034818s I1106 01:25:24.415] Nov 6 01:25:24.415: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m11.140533259s I1106 01:25:26.500] Nov 6 01:25:26.500: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m13.225435103s I1106 01:25:28.585] Nov 6 01:25:28.585: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m15.310353547s I1106 01:25:30.670] Nov 6 01:25:30.670: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m17.395340991s I1106 01:25:32.754] Nov 6 01:25:32.754: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m19.479452129s I1106 01:25:34.839] Nov 6 01:25:34.838: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m21.563706868s I1106 01:25:36.923] Nov 6 01:25:36.923: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m23.648086908s I1106 01:25:39.007] Nov 6 01:25:39.007: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m25.732150745s I1106 01:25:41.092] Nov 6 01:25:41.092: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m27.816859288s I1106 01:25:43.176] Nov 6 01:25:43.176: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m29.90158313s I1106 01:25:45.261] Nov 6 01:25:45.261: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m31.986208072s I1106 01:25:47.345] Nov 6 01:25:47.345: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.07040351s I1106 01:25:49.431] Nov 6 01:25:49.430: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.155698257s I1106 01:25:51.515] Nov 6 01:25:51.515: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.2404486s I1106 01:25:53.600] Nov 6 01:25:53.600: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.325124142s I1106 01:25:55.684] Nov 6 01:25:55.684: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.409376481s I1106 01:25:57.769] Nov 6 01:25:57.769: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.494341025s I1106 01:25:59.854] Nov 6 01:25:59.853: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.578736165s I1106 01:26:01.937] Nov 6 01:26:01.937: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.662374599s I1106 01:26:04.034] Nov 6 01:26:04.034: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.758953033s I1106 01:26:06.118] Nov 6 01:26:06.118: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.843456974s I1106 01:26:08.203] Nov 6 01:26:08.203: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.928297617s I1106 01:26:10.288] Nov 6 01:26:10.288: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m57.013347562s I1106 01:26:12.373] Nov 6 01:26:12.373: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m59.098214206s I1106 01:26:14.464] Nov 6 01:26:14.464: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m1.189186296s I1106 01:26:16.548] Nov 6 01:26:16.548: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m3.273416135s I1106 01:26:18.635] Nov 6 01:26:18.635: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m5.360486096s I1106 01:26:20.720] Nov 6 01:26:20.720: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m7.445118437s I1106 01:26:22.805] Nov 6 01:26:22.805: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m9.52992908s I1106 01:26:24.889] Nov 6 01:26:24.889: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m11.614090519s I1106 01:26:26.978] Nov 6 01:26:26.978: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m13.703135794s I1106 01:26:29.063] Nov 6 01:26:29.062: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m15.787708736s I1106 01:26:31.148] Nov 6 01:26:31.147: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m17.87269238s I1106 01:26:33.232] Nov 6 01:26:33.232: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m19.956969419s I1106 01:26:35.316] Nov 6 01:26:35.316: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.041377959s I1106 01:26:37.401] Nov 6 01:26:37.400: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.125661698s I1106 01:26:39.484] Nov 6 01:26:39.484: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.209520034s I1106 01:26:41.570] Nov 6 01:26:41.570: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.295390785s I1106 01:26:43.656] Nov 6 01:26:43.656: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.381430438s I1106 01:26:45.741] Nov 6 01:26:45.741: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.466019479s I1106 01:26:47.826] Nov 6 01:26:47.826: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.551230725s I1106 01:26:49.911] Nov 6 01:26:49.911: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.635825366s I1106 01:26:51.995] Nov 6 01:26:51.994: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.719724102s I1106 01:26:54.079] Nov 6 01:26:54.079: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.804463645s I1106 01:26:56.164] Nov 6 01:26:56.164: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.889153787s I1106 01:26:58.249] Nov 6 01:26:58.249: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.974045831s I1106 01:27:00.334] Nov 6 01:27:00.334: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m47.058930774s I1106 01:27:02.418] Nov 6 01:27:02.418: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m49.143395715s I1106 01:27:04.503] Nov 6 01:27:04.503: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m51.228142057s I1106 01:27:06.588] Nov 6 01:27:06.588: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m53.312863s I1106 01:27:08.672] Nov 6 01:27:08.672: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m55.397212539s I1106 01:27:10.757] Nov 6 01:27:10.757: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m57.481967582s I1106 01:27:12.841] Nov 6 01:27:12.841: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m59.566313621s I1106 01:27:14.926] Nov 6 01:27:14.926: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m1.651147764s I1106 01:27:17.011] Nov 6 01:27:17.010: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m3.735564304s I1106 01:27:19.095] Nov 6 01:27:19.095: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m5.819838643s I1106 01:27:21.179] Nov 6 01:27:21.179: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m7.903885426s I1106 01:27:23.264] Nov 6 01:27:23.263: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m9.988751408s I1106 01:27:25.348] Nov 6 01:27:25.348: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.072902293s I1106 01:27:27.432] Nov 6 01:27:27.432: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m14.157382586s I1106 01:27:29.517] Nov 6 01:27:29.517: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m16.24228259s I1106 01:27:31.602] Nov 6 01:27:31.602: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m18.3272497s I1106 01:27:33.687] Nov 6 01:27:33.687: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m20.411802514s I1106 01:27:35.771] Nov 6 01:27:35.771: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m22.496285234s I1106 01:27:37.857] Nov 6 01:27:37.856: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m24.581656767s I1106 01:27:39.941] Nov 6 01:27:39.941: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m26.666101701s I1106 01:27:42.026] Nov 6 01:27:42.026: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m28.751362946s I1106 01:27:44.112] Nov 6 01:27:44.111: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m30.836687099s I1106 01:27:46.197] Nov 6 01:27:46.196: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m32.921492155s I1106 01:27:48.281] Nov 6 01:27:48.280: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m35.005676613s I1106 01:27:50.365] Nov 6 01:27:50.365: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m37.090313181s I1106 01:27:52.450] Nov 6 01:27:52.450: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m39.174958055s I1106 01:27:54.534] Nov 6 01:27:54.534: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m41.259241034s I1106 01:27:56.619] Nov 6 01:27:56.618: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m43.34368752s I1106 01:27:58.703] Nov 6 01:27:58.703: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m45.428025012s I1106 01:28:00.795] Nov 6 01:28:00.795: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m47.519848461s I1106 01:28:02.881] Nov 6 01:28:02.880: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m49.605648476s I1106 01:28:04.965] Nov 6 01:28:04.965: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m51.69037219s I1106 01:28:07.050] Nov 6 01:28:07.050: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m53.775285711s I1106 01:28:09.135] Nov 6 01:28:09.135: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m55.860270939s I1106 01:28:11.220] Nov 6 01:28:11.220: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m57.945544076s I1106 01:28:13.305] Nov 6 01:28:13.305: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m0.030483116s I1106 01:28:15.390] Nov 6 01:28:15.390: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m2.114861659s I1106 01:28:17.474] Nov 6 01:28:17.474: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m4.199104507s I1106 01:28:19.558] Nov 6 01:28:19.558: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m6.283337361s I1106 01:28:21.643] Nov 6 01:28:21.643: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m8.368038225s I1106 01:28:23.727] Nov 6 01:28:23.727: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m10.452297492s I1106 01:28:25.812] Nov 6 01:28:25.812: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m12.537161669s I1106 01:28:27.898] Nov 6 01:28:27.898: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m14.62322036s I1106 01:28:29.984] Nov 6 01:28:29.983: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.708665853s I1106 01:28:32.068] Nov 6 01:28:32.068: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.793461148s I1106 01:28:34.154] Nov 6 01:28:34.153: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.878772553s I1106 01:28:36.255] Nov 6 01:28:36.255: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.979882772s I1106 01:28:38.340] Nov 6 01:28:38.339: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m25.064694885s I1106 01:28:40.424] Nov 6 01:28:40.424: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m27.149349203s I1106 01:28:42.509] Nov 6 01:28:42.509: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m29.233849126s I1106 01:28:44.594] Nov 6 01:28:44.594: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m31.31912046s I1106 01:28:46.679] Nov 6 01:28:46.678: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m33.403663495s I1106 01:28:48.765] Nov 6 01:28:48.765: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m35.490496451s I1106 01:28:50.850] Nov 6 01:28:50.850: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m37.575043498s I1106 01:28:52.935] Nov 6 01:28:52.935: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m39.660363855s I1106 01:28:55.020] Nov 6 01:28:55.020: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m41.745526518s I1106 01:28:57.109] Nov 6 01:28:57.108: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m43.833748107s I1106 01:28:59.195] Nov 6 01:28:59.194: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m45.919622786s I1106 01:29:01.279] Nov 6 01:29:01.279: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m48.004197861s I1106 01:29:03.364] Nov 6 01:29:03.364: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m50.089188846s I1106 01:29:05.449] Nov 6 01:29:05.449: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m52.174020634s I1106 01:29:07.535] Nov 6 01:29:07.534: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m54.259726335s I1106 01:29:09.624] Nov 6 01:29:09.623: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m56.348615363s I1106 01:29:11.708] Nov 6 01:29:11.708: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 6m58.433413368s I1106 01:29:13.793] Nov 6 01:29:13.793: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m0.51838438s I1106 01:29:15.878] Nov 6 01:29:15.878: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m2.602794494s I1106 01:29:17.963] Nov 6 01:29:17.962: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m4.687639116s I1106 01:29:20.059] Nov 6 01:29:20.059: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m6.784378027s I1106 01:29:22.144] Nov 6 01:29:22.143: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m8.868747357s I1106 01:29:24.255] Nov 6 01:29:24.255: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.980094081s I1106 01:29:26.341] Nov 6 01:29:26.340: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m13.06561723s I1106 01:29:28.426] Nov 6 01:29:28.426: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m15.151211385s I1106 01:29:30.511] Nov 6 01:29:30.510: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m17.235756738s I1106 01:29:32.596] Nov 6 01:29:32.596: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m19.321257903s I1106 01:29:34.681] Nov 6 01:29:34.681: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m21.405957368s I1106 01:29:36.766] Nov 6 01:29:36.766: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m23.490818039s I1106 01:29:38.851] Nov 6 01:29:38.851: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m25.575964618s I1106 01:29:40.936] Nov 6 01:29:40.936: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m27.661106102s I1106 01:29:43.021] Nov 6 01:29:43.021: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m29.746304491s I1106 01:29:45.106] Nov 6 01:29:45.106: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m31.831345585s I1106 01:29:47.192] Nov 6 01:29:47.192: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m33.916892387s I1106 01:29:49.277] Nov 6 01:29:49.277: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m36.001916491s I1106 01:29:51.362] Nov 6 01:29:51.362: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m38.087383904s I1106 01:29:53.447] Nov 6 01:29:53.447: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m40.172375818s I1106 01:29:55.533] Nov 6 01:29:55.533: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m42.258110542s I1106 01:29:57.618] Nov 6 01:29:57.618: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m44.343083267s I1106 01:29:59.703] Nov 6 01:29:59.703: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m46.428377698s I1106 01:30:01.788] Nov 6 01:30:01.788: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m48.513258632s I1106 01:30:03.877] Nov 6 01:30:03.877: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m50.602501602s I1106 01:30:05.963] Nov 6 01:30:05.963: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m52.687949849s I1106 01:30:08.056] Nov 6 01:30:08.056: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m54.781120857s I1106 01:30:10.141] Nov 6 01:30:10.141: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m56.866423414s I1106 01:30:12.239] Nov 6 01:30:12.239: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.964201363s I1106 01:30:14.324] Nov 6 01:30:14.324: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m1.049019527s I1106 01:30:16.413] Nov 6 01:30:16.413: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m3.138091725s I1106 01:30:18.498] Nov 6 01:30:18.498: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m5.2231146s I1106 01:30:20.584] Nov 6 01:30:20.583: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m7.308660583s I1106 01:30:22.669] Nov 6 01:30:22.668: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m9.393774968s I1106 01:30:24.754] Nov 6 01:30:24.754: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m11.47911596s I1106 01:30:26.840] Nov 6 01:30:26.840: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m13.564851159s I1106 01:30:28.925] Nov 6 01:30:28.925: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m15.650369362s I1106 01:30:31.012] Nov 6 01:30:31.012: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m17.73742888s I1106 01:30:33.098] Nov 6 01:30:33.098: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m19.823149794s I1106 01:30:35.185] Nov 6 01:30:35.185: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m21.910424223s I1106 01:30:37.270] Nov 6 01:30:37.270: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m23.994856437s I1106 01:30:39.356] Nov 6 01:30:39.355: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m26.080737166s I1106 01:30:41.441] Nov 6 01:30:41.441: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m28.166191796s I1106 01:30:43.526] Nov 6 01:30:43.526: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m30.250985627s I1106 01:30:45.611] Nov 6 01:30:45.611: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m32.336160265s I1106 01:30:47.696] Nov 6 01:30:47.696: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m34.421426408s I1106 01:30:49.781] Nov 6 01:30:49.781: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m36.506131052s I1106 01:30:51.866] Nov 6 01:30:51.865: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m38.5907676s I1106 01:30:53.951] Nov 6 01:30:53.951: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m40.67645696s I1106 01:30:56.058] Nov 6 01:30:56.057: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m42.782743371s I1106 01:30:58.143] Nov 6 01:30:58.143: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m44.867940537s I1106 01:31:00.240] Nov 6 01:31:00.240: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m46.964951891s I1106 01:31:02.325] Nov 6 01:31:02.325: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m49.050064065s I1106 01:31:04.410] Nov 6 01:31:04.410: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m51.135506646s I1106 01:31:06.496] Nov 6 01:31:06.496: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m53.220842731s I1106 01:31:08.581] Nov 6 01:31:08.580: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m55.305625916s I1106 01:31:10.666] Nov 6 01:31:10.666: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m57.391287512s I1106 01:31:12.751] Nov 6 01:31:12.751: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 8m59.476435309s I1106 01:31:14.836] Nov 6 01:31:14.836: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m1.560958006s I1106 01:31:16.921] Nov 6 01:31:16.921: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m3.646240512s I1106 01:31:19.009] Nov 6 01:31:19.008: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m5.733595938s I1106 01:31:21.093] Nov 6 01:31:21.093: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m7.818130848s I1106 01:31:23.178] Nov 6 01:31:23.178: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m9.903120165s I1106 01:31:25.265] Nov 6 01:31:25.265: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m11.990382703s I1106 01:31:27.351] Nov 6 01:31:27.350: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m14.075582831s I1106 01:31:29.436] Nov 6 01:31:29.435: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m16.160673262s I1106 01:31:31.521] Nov 6 01:31:31.520: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m18.245740597s I1106 01:31:33.606] Nov 6 01:31:33.606: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m20.330921037s I1106 01:31:35.691] Nov 6 01:31:35.690: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m22.415656879s I1106 01:31:37.775] Nov 6 01:31:37.775: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m24.500184523s I1106 01:31:39.861] Nov 6 01:31:39.860: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m26.585771078s I1106 01:31:41.945] Nov 6 01:31:41.945: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m28.670067329s I1106 01:31:44.042] Nov 6 01:31:44.041: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m30.766671872s I1106 01:31:46.127] Nov 6 01:31:46.127: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m32.852438041s I1106 01:31:48.213] Nov 6 01:31:48.212: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m34.93751501s I1106 01:31:50.298] Nov 6 01:31:50.298: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m37.023043286s I1106 01:31:52.383] Nov 6 01:31:52.383: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m39.107858661s I1106 01:31:54.468] Nov 6 01:31:54.468: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m41.193051943s I1106 01:31:56.553] Nov 6 01:31:56.553: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m43.277814726s I1106 01:31:58.638] Nov 6 01:31:58.637: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m45.362638414s I1106 01:32:00.724] Nov 6 01:32:00.724: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m47.449050416s I1106 01:32:02.809] Nov 6 01:32:02.809: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m49.534422215s I1106 01:32:04.895] Nov 6 01:32:04.895: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m51.620039221s I1106 01:32:06.980] Nov 6 01:32:06.980: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m53.705080125s I1106 01:32:09.065] Nov 6 01:32:09.065: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m55.789989433s I1106 01:32:11.160] Nov 6 01:32:11.160: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m57.884830316s I1106 01:32:13.250] Nov 6 01:32:13.250: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 9m59.974849469s I1106 01:32:15.335] Nov 6 01:32:15.334: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m2.059667488s I1106 01:32:17.420] Nov 6 01:32:17.419: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m4.144743113s I1106 01:32:19.505] Nov 6 01:32:19.505: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m6.229831641s I1106 01:32:21.590] Nov 6 01:32:21.590: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m8.314890574s I1106 01:32:23.674] Nov 6 01:32:23.674: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m10.399238705s I1106 01:32:25.759] Nov 6 01:32:25.759: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m12.484074044s I1106 01:32:27.844] Nov 6 01:32:27.843: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m14.568660084s I1106 01:32:29.928] Nov 6 01:32:29.927: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m16.652746525s I1106 01:32:32.033] Nov 6 01:32:32.033: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m18.757981921s I1106 01:32:34.121] Nov 6 01:32:34.121: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m20.846170399s I1106 01:32:36.205] Nov 6 01:32:36.205: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m22.929952349s I1106 01:32:38.293] Nov 6 01:32:38.292: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m25.017743831s I1106 01:32:40.377] Nov 6 01:32:40.377: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m27.102076593s I1106 01:32:42.462] Nov 6 01:32:42.462: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m29.187212064s I1106 01:32:44.546] Nov 6 01:32:44.546: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m31.271531032s I1106 01:32:46.631] Nov 6 01:32:46.631: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m33.355930405s I1106 01:32:48.717] Nov 6 01:32:48.716: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m35.441708692s I1106 01:32:50.801] Nov 6 01:32:50.800: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m37.525635868s I1106 01:32:52.885] Nov 6 01:32:52.885: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m39.610068252s I1106 01:32:54.969] Nov 6 01:32:54.969: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m41.69441774s I1106 01:32:57.054] Nov 6 01:32:57.054: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m43.778953032s I1106 01:32:59.138] Nov 6 01:32:59.138: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m45.863398427s I1106 01:33:01.223] Nov 6 01:33:01.223: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m47.948066127s I1106 01:33:03.307] Nov 6 01:33:03.307: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m50.032093226s I1106 01:33:05.392] Nov 6 01:33:05.391: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m52.116597432s I1106 01:33:07.478] Nov 6 01:33:07.478: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m54.203243957s I1106 01:33:09.562] Nov 6 01:33:09.562: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m56.287412468s I1106 01:33:11.647] Nov 6 01:33:11.646: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 10m58.371612982s I1106 01:33:13.731] Nov 6 01:33:13.730: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m0.455637499s I1106 01:33:15.815] Nov 6 01:33:15.815: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m2.539969721s I1106 01:33:17.899] Nov 6 01:33:17.899: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m4.624473348s I1106 01:33:19.984] Nov 6 01:33:19.984: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m6.709362582s I1106 01:33:22.069] Nov 6 01:33:22.068: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m8.793650814s I1106 01:33:24.153] Nov 6 01:33:24.153: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m10.878318453s I1106 01:33:26.238] Nov 6 01:33:26.238: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m12.962968495s I1106 01:33:28.322] Nov 6 01:33:28.322: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m15.047498339s I1106 01:33:30.406] Nov 6 01:33:30.406: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m17.131421182s I1106 01:33:32.491] Nov 6 01:33:32.491: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m19.216409837s I1106 01:33:34.576] Nov 6 01:33:34.575: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m21.30078799s I1106 01:33:36.661] Nov 6 01:33:36.661: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m23.385841852s I1106 01:33:38.745] Nov 6 01:33:38.745: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m25.470509314s I1106 01:33:40.830] Nov 6 01:33:40.830: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m27.555158679s I1106 01:33:42.915] Nov 6 01:33:42.915: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m29.639848548s I1106 01:33:44.999] Nov 6 01:33:44.999: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m31.72451712s I1106 01:33:47.084] Nov 6 01:33:47.083: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m33.808757892s I1106 01:33:49.168] Nov 6 01:33:49.168: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m35.893130468s I1106 01:33:51.253] Nov 6 01:33:51.253: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m37.977978451s I1106 01:33:53.341] Nov 6 01:33:53.341: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m40.065986261s I1106 01:33:55.426] Nov 6 01:33:55.426: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m42.151146552s I1106 01:33:57.510] Nov 6 01:33:57.510: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m44.235469741s I1106 01:33:59.595] Nov 6 01:33:59.595: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m46.320155836s I1106 01:34:01.679] Nov 6 01:34:01.679: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m48.404519632s I1106 01:34:03.764] Nov 6 01:34:03.764: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m50.489257233s I1106 01:34:05.849] Nov 6 01:34:05.848: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m52.573573534s I1106 01:34:07.932] Nov 6 01:34:07.932: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m54.657571337s I1106 01:34:10.016] Nov 6 01:34:10.016: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m56.741431741s I1106 01:34:12.104] Nov 6 01:34:12.104: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 11m58.829234078s I1106 01:34:14.189] Nov 6 01:34:14.189: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m0.914161496s I1106 01:34:16.273] Nov 6 01:34:16.273: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m2.998440013s I1106 01:34:18.358] Nov 6 01:34:18.358: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m5.083333237s I1106 01:34:20.444] Nov 6 01:34:20.444: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m7.168821269s I1106 01:34:22.528] Nov 6 01:34:22.528: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m9.252916794s I1106 01:34:24.612] Nov 6 01:34:24.612: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m11.337198123s I1106 01:34:26.697] Nov 6 01:34:26.697: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m13.421878258s I1106 01:34:28.781] Nov 6 01:34:28.781: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m15.506477295s I1106 01:34:30.867] Nov 6 01:34:30.867: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m17.591965342s I1106 01:34:32.956] Nov 6 01:34:32.956: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m19.681240019s I1106 01:34:35.041] Nov 6 01:34:35.041: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m21.766079267s I1106 01:34:37.126] Nov 6 01:34:37.125: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m23.850692717s I1106 01:34:39.210] Nov 6 01:34:39.210: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m25.935114668s I1106 01:34:41.295] Nov 6 01:34:41.294: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m28.019556822s I1106 01:34:43.379] Nov 6 01:34:43.379: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m30.104295781s I1106 01:34:45.463] Nov 6 01:34:45.463: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m32.188504639s I1106 01:34:47.548] Nov 6 01:34:47.548: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m34.273274205s I1106 01:34:49.633] Nov 6 01:34:49.632: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m36.35759937s I1106 01:34:51.717] Nov 6 01:34:51.716: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m38.441601335s I1106 01:34:53.801] Nov 6 01:34:53.801: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m40.526031606s I1106 01:34:55.885] Nov 6 01:34:55.885: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m42.610002777s I1106 01:34:57.970] Nov 6 01:34:57.969: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m44.694556355s I1106 01:35:00.068] Nov 6 01:35:00.067: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m46.792660435s I1106 01:35:02.154] Nov 6 01:35:02.154: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m48.879054632s I1106 01:35:04.240] Nov 6 01:35:04.240: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m50.964905328s I1106 01:35:06.325] Nov 6 01:35:06.324: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m53.049729519s I1106 01:35:08.409] Nov 6 01:35:08.409: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m55.134382112s I1106 01:35:10.495] Nov 6 01:35:10.494: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m57.219770913s I1106 01:35:12.579] Nov 6 01:35:12.579: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 12m59.30425311s I1106 01:35:14.664] Nov 6 01:35:14.664: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m1.389170613s I1106 01:35:16.749] Nov 6 01:35:16.749: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m3.474397621s I1106 01:35:18.835] Nov 6 01:35:18.835: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m5.560060935s I1106 01:35:20.919] Nov 6 01:35:20.919: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m7.644235841s I1106 01:35:23.004] Nov 6 01:35:23.003: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m9.728655351s I1106 01:35:25.089] Nov 6 01:35:25.088: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m11.813569368s I1106 01:35:27.173] Nov 6 01:35:27.172: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m13.89760078s I1106 01:35:29.257] Nov 6 01:35:29.257: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m15.9822324s I1106 01:35:31.342] Nov 6 01:35:31.342: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m18.066963424s I1106 01:35:33.426] Nov 6 01:35:33.426: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m20.151349547s I1106 01:35:35.510] Nov 6 01:35:35.510: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m22.235560472s I1106 01:35:37.594] Nov 6 01:35:37.594: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m24.319507097s I1106 01:35:39.679] Nov 6 01:35:39.678: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m26.403645727s I1106 01:35:41.763] Nov 6 01:35:41.762: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m28.487749259s I1106 01:35:43.847] Nov 6 01:35:43.847: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m30.572392097s I1106 01:35:45.931] Nov 6 01:35:45.931: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m32.656328633s I1106 01:35:48.035] Nov 6 01:35:48.035: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m34.760366318s I1106 01:35:50.120] Nov 6 01:35:50.119: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m36.844685062s I1106 01:35:52.203] Nov 6 01:35:52.203: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m38.928528005s I1106 01:35:54.287] Nov 6 01:35:54.287: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m41.012483951s I1106 01:35:56.372] Nov 6 01:35:56.372: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m43.096812103s I1106 01:35:58.456] Nov 6 01:35:58.456: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m45.181395059s I1106 01:36:00.542] Nov 6 01:36:00.541: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m47.266631022s I1106 01:36:02.628] Nov 6 01:36:02.628: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m49.353100197s I1106 01:36:04.712] Nov 6 01:36:04.712: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m51.437235557s I1106 01:36:06.797] Nov 6 01:36:06.796: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m53.521777123s I1106 01:36:08.880] Nov 6 01:36:08.880: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m55.605542185s I1106 01:36:10.965] Nov 6 01:36:10.964: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m57.689737853s I1106 01:36:13.049] Nov 6 01:36:13.049: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 13m59.774565228s I1106 01:36:15.135] Nov 6 01:36:15.135: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m1.859891709s I1106 01:36:17.220] Nov 6 01:36:17.220: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m3.944874091s I1106 01:36:19.304] Nov 6 01:36:19.304: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m6.029524872s I1106 01:36:21.389] Nov 6 01:36:21.389: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m8.114294456s I1106 01:36:23.473] Nov 6 01:36:23.473: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m10.198416438s I1106 01:36:25.558] Nov 6 01:36:25.558: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m12.282905325s I1106 01:36:27.643] Nov 6 01:36:27.643: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m14.367880419s I1106 01:36:29.728] Nov 6 01:36:29.728: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m16.453442418s I1106 01:36:31.817] Nov 6 01:36:31.816: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m18.541778841s I1106 01:36:33.901] Nov 6 01:36:33.901: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m20.625961935s I1106 01:36:35.985] Nov 6 01:36:35.985: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m22.710206133s I1106 01:36:38.070] Nov 6 01:36:38.070: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m24.795128937s I1106 01:36:40.155] Nov 6 01:36:40.155: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m26.880003744s I1106 01:36:42.240] Nov 6 01:36:42.240: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m28.965011154s I1106 01:36:44.324] Nov 6 01:36:44.324: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m31.049379161s I1106 01:36:46.410] Nov 6 01:36:46.409: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m33.134542377s I1106 01:36:48.494] Nov 6 01:36:48.493: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m35.218793988s I1106 01:36:50.578] Nov 6 01:36:50.577: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m37.302527197s I1106 01:36:52.662] Nov 6 01:36:52.662: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m39.387004415s I1106 01:36:54.755] Nov 6 01:36:54.755: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m41.479812996s I1106 01:36:56.840] Nov 6 01:36:56.840: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m43.564834522s I1106 01:36:58.924] Nov 6 01:36:58.924: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m45.649511847s I1106 01:37:01.017] Nov 6 01:37:01.017: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m47.741874432s I1106 01:37:03.101] Nov 6 01:37:03.101: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m49.826104358s I1106 01:37:05.185] Nov 6 01:37:05.185: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m51.910127886s I1106 01:37:07.270] Nov 6 01:37:07.269: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m53.994532818s I1106 01:37:09.353] Nov 6 01:37:09.353: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m56.07848115s I1106 01:37:11.444] Nov 6 01:37:11.444: INFO: Pod "azuredisk-volume-tester-qtf4g": Phase="Pending", Reason="", readiness=false. Elapsed: 14m58.169403835s I1106 01:37:13.445] Nov 6 01:37:13.444: INFO: Unexpected error occurred: Gave up after waiting 15m0s for pod "azuredisk-volume-tester-qtf4g" to be "Error status code" I1106 01:37:13.445] Nov 6 01:37:13.445: INFO: deleting Pod "azuredisk-4885"/"azuredisk-volume-tester-qtf4g" I1106 01:37:13.529] Nov 6 01:37:13.528: INFO: Pod azuredisk-volume-tester-qtf4g has the following logs: I1106 01:37:13.529] STEP: Deleting pod azuredisk-volume-tester-qtf4g in namespace azuredisk-4885 I1106 01:37:13.714] STEP: validating provisioned PV I1106 01:37:13.714] Nov 6 01:37:13.714: INFO: Unexpected error occurred: resource name may not be empty I1106 01:37:13.715] Nov 6 01:37:13.714: INFO: deleting StorageClass azuredisk-4885-disk.csi.azure.com-dynamic-sc-n7b82 I1106 01:37:13.813] [AfterEach] [multi-az] I1106 01:37:13.814] /go/src/sigs.k8s.io/azuredisk-csi-driver/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:151 I1106 01:37:13.814] STEP: Collecting events from namespace "azuredisk-4885". I1106 01:37:13.897] STEP: Found 6 events. I1106 01:37:13.897] Nov 6 01:37:13.897: INFO: At 2019-11-06 01:22:13 +0000 UTC - event for pvc-zcktj: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding I1106 01:37:13.897] Nov 6 01:37:13.897: INFO: At 2019-11-06 01:22:13 +0000 UTC - event for pvc-zcktj: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator I1106 01:37:13.898] Nov 6 01:37:13.897: INFO: At 2019-11-06 01:22:13 +0000 UTC - event for pvc-zcktj: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } Provisioning: External provisioner is provisioning volume for claim "azuredisk-4885/pvc-zcktj" I1106 01:37:13.898] Nov 6 01:37:13.897: INFO: At 2019-11-06 01:22:23 +0000 UTC - event for pvc-zcktj: {disk.csi.azure.com_csi-azuredisk-controller-59bf945f54-k2p5m_71d5eefc-0024-11ea-a712-66d7d8b096eb } ProvisioningFailed: failed to provision volume with StorageClass "azuredisk-4885-disk.csi.azure.com-dynamic-sc-n7b82": rpc error: code = DeadlineExceeded desc = context deadline exceeded I1106 01:37:13.898] Nov 6 01:37:13.897: INFO: At 2019-11-06 01:32:13 +0000 UTC - event for azuredisk-volume-tester-qtf4g: {default-scheduler } FailedScheduling: timed out waiting for the condition I1106 01:37:13.898] Nov 6 01:37:13.897: INFO: At 2019-11-06 01:37:13 +0000 UTC - event for azuredisk-volume-tester-qtf4g: {default-scheduler } FailedScheduling: skip schedule deleting pod: azuredisk-4885/azuredisk-volume-tester-qtf4g I1106 01:37:13.981] Nov 6 01:37:13.981: INFO: POD NODE PHASE GRACE CONDITIONS I1106 01:37:13.981] Nov 6 01:37:13.981: INFO: I1106 01:37:14.230] Nov 6 01:37:14.230: INFO: I1106 01:37:14.231] Logging node info for node k8s-agentpool-73731178-vmss000000 I1106 01:37:14.318] Nov 6 01:37:14.314: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000000,UID:e9bc0b16-6756-4155-b49c-e223c0ba9499,ResourceVersion:23908,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-1,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000000"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:18 +0000 UTC 2019-11-05 23:28:18 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:36:21 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:36:21 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:36:21 +0000 UTC 2019-11-05 23:27:30 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:36:21 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.4} {Hostname k8s-agentpool-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:956ad861ae4a42099801f8e840b4e502,SystemUUID:439CF4B9-2B9F-B74E-9ED7-7379FD8BD0DF,BootID:bd3476e5-4fd4-4437-9b56-54fbe38a3a49,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1] 121711221} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/metrics-server-amd64@sha256:49a9f12f7067d11f42c803dbe61ed2c1299959ad85cb315b25ff7eef8e6b8892 k8s.gcr.io/metrics-server-amd64:v0.2.1] 42541759} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/disks/pvc-4f5bb48a-bfb9-4847-9099-b2d2110a7312],VolumesAttached:[],Config:nil,},} I1106 01:37:14.318] Nov 6 01:37:14.315: INFO: I1106 01:37:14.318] Logging kubelet events for node k8s-agentpool-73731178-vmss000000 I1106 01:37:14.398] Nov 6 01:37:14.398: INFO: I1106 01:37:14.398] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000000 I1106 01:37:14.487] Nov 6 01:37:14.487: INFO: kubernetes-dashboard-66dd8b8df7-4rnsp started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:37:14.488] Nov 6 01:37:14.487: INFO: Container kubernetes-dashboard ready: true, restart count 1 I1106 01:37:14.488] Nov 6 01:37:14.487: INFO: csi-azuredisk-node-g6wbm started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 01:37:14.488] Nov 6 01:37:14.487: INFO: Container azuredisk ready: true, restart count 0 I1106 01:37:14.488] Nov 6 01:37:14.487: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:37:14.488] Nov 6 01:37:14.487: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 01:37:14.488] Nov 6 01:37:14.487: INFO: blobfuse-flexvol-installer-cvgkv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:14.488] Nov 6 01:37:14.487: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 01:37:14.489] Nov 6 01:37:14.487: INFO: azure-ip-masq-agent-vn5zc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:14.489] Nov 6 01:37:14.487: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:37:14.489] Nov 6 01:37:14.487: INFO: keyvault-flexvolume-xr7v6 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:14.489] Nov 6 01:37:14.487: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 01:37:14.489] Nov 6 01:37:14.487: INFO: metrics-server-864ffbc5c-kb9cz started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:14.489] Nov 6 01:37:14.487: INFO: Container metrics-server ready: true, restart count 0 I1106 01:37:14.489] Nov 6 01:37:14.487: INFO: kube-proxy-jnqp8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:14.490] Nov 6 01:37:14.487: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:37:14.763] Nov 6 01:37:14.763: INFO: I1106 01:37:14.763] Latency metrics for node k8s-agentpool-73731178-vmss000000 I1106 01:37:14.763] Nov 6 01:37:14.763: INFO: I1106 01:37:14.763] Logging node info for node k8s-agentpool-73731178-vmss000001 I1106 01:37:14.850] Nov 6 01:37:14.847: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-agentpool-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-agentpool-73731178-vmss000001,UID:ab75ba9d-ec23-4ff7-ae5a-d1a19974c05d,ResourceVersion:23910,Generation:0,CreationTimestamp:2019-11-05 23:27:31 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{agentpool: agentpool,beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_D4s_v3,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: agent,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-agentpool-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: agent,node-role.kubernetes.io/agent: ,storageprofile: managed,storagetier: Premium_LRS,topology.disk.csi.azure.com/zone: eastus2-2,},Annotations:map[string]string{csi.volume.kubernetes.io/nodeid: {"disk.csi.azure.com":"k8s-agentpool-73731178-vmss000001"},node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.5.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-agentpool-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16797044736 0} {} 16403364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-csi-disk.csi.azure.com: {{8 0} {} 8 DecimalSI},cpu: {{4 0} {} 4 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{16010612736 0} {} 15635364Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:17 +0000 UTC 2019-11-05 23:28:17 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:36:21 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:36:21 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:36:21 +0000 UTC 2019-11-05 23:27:31 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:36:21 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.248.0.5} {Hostname k8s-agentpool-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f0eae5e73d0f4ccb82dd0f22701c288f,SystemUUID:7E54C533-AED3-744D-8D17-EFF5E62EA06D,BootID:6d58e5a6-45fb-4a41-a491-bc2f3799f411,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[k8sprowinternal.azurecr.io/azuredisk-csi@sha256:209b5e3501b93135a3e5715553aeb99d41dc7fab732b42161d48b00e40772a93 k8sprowinternal.azurecr.io/azuredisk-csi:e2e-9f289d4c7792de742a1ded20837778e2acb91093] 286926836} {[gcr.io/kubernetes-helm/tiller@sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1 gcr.io/kubernetes-helm/tiller:v2.11.0] 71821984} {[quay.io/k8scsi/csi-provisioner@sha256:d657c839dce87324fe2b677302913f9386f885f8746be7bea0ced5b0844e3433 quay.io/k8scsi/csi-provisioner:v1.3.1] 50596998} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0] 46226754} {[quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1] 45874691} {[quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb quay.io/k8scsi/csi-snapshotter:v1.1.0] 44325352} {[k8s.gcr.io/coredns@sha256:e83beb5e43f8513fa735e77ffc5859640baea30a882a11cc75c4c3244a737d3c k8s.gcr.io/coredns:1.5.0] 42488424} {[mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume@sha256:4fd30d43947d4a54fc89ead7985beecfd3c9b2a93a0655a373b1608ab90bd5af mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7] 22909487} {[quay.io/k8scsi/livenessprobe@sha256:8c9c8a0f330acc2e558ae6624309447d02522e76aa35af23fa19b88abf4381cb quay.io/k8scsi/livenessprobe:v1.0.2] 17415381} {[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0] 15815995} {[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0] 14967303} {[mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume@sha256:23d8c6033f02a1ecad05127ebdc931bb871264228661bc122704b0974e4d9fdd mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8] 1159025} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:37:14.851] Nov 6 01:37:14.847: INFO: I1106 01:37:14.851] Logging kubelet events for node k8s-agentpool-73731178-vmss000001 I1106 01:37:14.931] Nov 6 01:37:14.931: INFO: I1106 01:37:14.932] Logging pods the kubelet thinks is on node k8s-agentpool-73731178-vmss000001 I1106 01:37:15.022] Nov 6 01:37:15.022: INFO: csi-azuredisk-node-ml68k started at 2019-11-05 23:30:57 +0000 UTC (0+3 container statuses recorded) I1106 01:37:15.023] Nov 6 01:37:15.022: INFO: Container azuredisk ready: true, restart count 0 I1106 01:37:15.023] Nov 6 01:37:15.022: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:37:15.023] Nov 6 01:37:15.022: INFO: Container node-driver-registrar ready: true, restart count 0 I1106 01:37:15.023] Nov 6 01:37:15.022: INFO: csi-azuredisk-controller-59bf945f54-k2p5m started at 2019-11-05 23:30:58 +0000 UTC (0+6 container statuses recorded) I1106 01:37:15.023] Nov 6 01:37:15.022: INFO: Container azuredisk ready: true, restart count 0 I1106 01:37:15.023] Nov 6 01:37:15.022: INFO: Container cluster-driver-registrar ready: true, restart count 0 I1106 01:37:15.024] Nov 6 01:37:15.022: INFO: Container csi-attacher ready: true, restart count 0 I1106 01:37:15.024] Nov 6 01:37:15.022: INFO: Container csi-provisioner ready: true, restart count 0 I1106 01:37:15.024] Nov 6 01:37:15.022: INFO: Container csi-snapshotter ready: true, restart count 0 I1106 01:37:15.024] Nov 6 01:37:15.022: INFO: Container liveness-probe ready: true, restart count 0 I1106 01:37:15.024] Nov 6 01:37:15.022: INFO: blobfuse-flexvol-installer-589vv started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:15.024] Nov 6 01:37:15.022: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 I1106 01:37:15.024] Nov 6 01:37:15.022: INFO: coredns-7f68dcdbdb-f98nq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:15.025] Nov 6 01:37:15.022: INFO: Container coredns ready: true, restart count 0 I1106 01:37:15.025] Nov 6 01:37:15.022: INFO: azure-ip-masq-agent-6qqgc started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:15.025] Nov 6 01:37:15.022: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:37:15.025] Nov 6 01:37:15.022: INFO: keyvault-flexvolume-7tztj started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:15.025] Nov 6 01:37:15.022: INFO: Container keyvault-flexvolume ready: true, restart count 0 I1106 01:37:15.025] Nov 6 01:37:15.022: INFO: kube-proxy-z4hf8 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:15.025] Nov 6 01:37:15.022: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:37:15.026] Nov 6 01:37:15.022: INFO: tiller-deploy-54c96cb5df-wlzbj started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:37:15.026] Nov 6 01:37:15.022: INFO: Container tiller ready: true, restart count 0 I1106 01:37:15.294] Nov 6 01:37:15.293: INFO: I1106 01:37:15.294] Latency metrics for node k8s-agentpool-73731178-vmss000001 I1106 01:37:15.294] Nov 6 01:37:15.293: INFO: I1106 01:37:15.294] Logging node info for node k8s-master-73731178-vmss000000 I1106 01:37:15.380] Nov 6 01:37:15.377: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000000,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000000,UID:1f765350-accc-4e67-898b-e4d84be84901,ResourceVersion:23958,Generation:0,CreationTimestamp:2019-11-05 23:27:30 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000000,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/0,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:36:37 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:36:37 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:36:37 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:36:37 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.4} {Hostname k8s-master-73731178-vmss000000}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:836af7329e85492184d73f1ea7f63a4e,SystemUUID:D1C68207-4499-C24D-B9D6-ADA0554A1BE5,BootID:a29dde5d-b4dc-483e-a50e-76e79359d759,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:37:15.380] Nov 6 01:37:15.378: INFO: I1106 01:37:15.380] Logging kubelet events for node k8s-master-73731178-vmss000000 I1106 01:37:15.462] Nov 6 01:37:15.462: INFO: I1106 01:37:15.462] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000000 I1106 01:37:15.550] Nov 6 01:37:15.550: INFO: kube-proxy-2fwv9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:15.550] Nov 6 01:37:15.550: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:37:15.551] Nov 6 01:37:15.550: INFO: kube-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:37:15.551] Nov 6 01:37:15.550: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:37:15.551] Nov 6 01:37:15.550: INFO: kube-scheduler-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:37:15.551] Nov 6 01:37:15.550: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:37:15.551] Nov 6 01:37:15.550: INFO: cloud-controller-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:37:15.551] Nov 6 01:37:15.550: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:37:15.551] Nov 6 01:37:15.550: INFO: kube-addon-manager-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:37:15.552] Nov 6 01:37:15.550: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:37:15.552] Nov 6 01:37:15.550: INFO: kube-apiserver-k8s-master-73731178-vmss000000 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:37:15.552] Nov 6 01:37:15.550: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:37:15.552] Nov 6 01:37:15.550: INFO: azure-ip-masq-agent-xmkx2 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:15.552] Nov 6 01:37:15.550: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:37:15.825] Nov 6 01:37:15.825: INFO: I1106 01:37:15.826] Latency metrics for node k8s-master-73731178-vmss000000 I1106 01:37:15.826] Nov 6 01:37:15.825: INFO: I1106 01:37:15.826] Logging node info for node k8s-master-73731178-vmss000001 I1106 01:37:15.912] Nov 6 01:37:15.909: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000001,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000001,UID:442cf114-6b0a-4c80-a9e5-be62e184f94c,ResourceVersion:23907,Generation:0,CreationTimestamp:2019-11-05 23:27:42 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000001,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/1,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:19 +0000 UTC 2019-11-05 23:28:19 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:36:20 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:36:20 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:36:20 +0000 UTC 2019-11-05 23:27:36 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:36:20 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.5} {Hostname k8s-master-73731178-vmss000001}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1a9da6632c314858a31bccaea0be0f50,SystemUUID:8F48A76E-30E1-B948-89B2-33C0048059B4,BootID:1597124c-68a3-452c-ae03-6cfe9bc1e57f,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:37:15.912] Nov 6 01:37:15.910: INFO: I1106 01:37:15.912] Logging kubelet events for node k8s-master-73731178-vmss000001 I1106 01:37:15.993] Nov 6 01:37:15.993: INFO: I1106 01:37:15.993] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000001 I1106 01:37:16.087] Nov 6 01:37:16.087: INFO: kube-scheduler-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:37:16.087] Nov 6 01:37:16.087: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:37:16.088] Nov 6 01:37:16.087: INFO: cloud-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:37:16.088] Nov 6 01:37:16.087: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:37:16.088] Nov 6 01:37:16.087: INFO: kube-addon-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:37:16.088] Nov 6 01:37:16.087: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:37:16.088] Nov 6 01:37:16.087: INFO: kube-apiserver-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:37:16.088] Nov 6 01:37:16.087: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:37:16.088] Nov 6 01:37:16.087: INFO: kube-controller-manager-k8s-master-73731178-vmss000001 started at 2019-11-05 23:27:30 +0000 UTC (0+1 container statuses recorded) I1106 01:37:16.089] Nov 6 01:37:16.087: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:37:16.089] Nov 6 01:37:16.087: INFO: azure-ip-masq-agent-825g9 started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:16.089] Nov 6 01:37:16.087: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:37:16.089] Nov 6 01:37:16.087: INFO: kube-proxy-8924t started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:16.089] Nov 6 01:37:16.087: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:37:16.357] Nov 6 01:37:16.356: INFO: I1106 01:37:16.357] Latency metrics for node k8s-master-73731178-vmss000001 I1106 01:37:16.357] Nov 6 01:37:16.356: INFO: I1106 01:37:16.357] Logging node info for node k8s-master-73731178-vmss000002 I1106 01:37:16.443] Nov 6 01:37:16.441: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000002,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000002,UID:6cf1398e-1b6b-4537-837d-9ffceb9a4f00,ResourceVersion:23966,Generation:0,CreationTimestamp:2019-11-05 23:27:32 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000002,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.6.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/2,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:27:55 +0000 UTC 2019-11-05 23:27:55 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:36:41 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:36:41 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:36:41 +0000 UTC 2019-11-05 23:27:25 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:36:41 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.6} {Hostname k8s-master-73731178-vmss000002}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7964689c8ba4f448e6f435b3d4fefac,SystemUUID:9369535A-87BF-1E4B-86DF-5D1A23713C9F,BootID:74f93904-298f-454d-8df6-8d4bba193331,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:37:16.444] Nov 6 01:37:16.441: INFO: I1106 01:37:16.444] Logging kubelet events for node k8s-master-73731178-vmss000002 I1106 01:37:16.526] Nov 6 01:37:16.526: INFO: I1106 01:37:16.526] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000002 I1106 01:37:16.615] Nov 6 01:37:16.615: INFO: azure-ip-masq-agent-74xks started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:16.615] Nov 6 01:37:16.615: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:37:16.615] Nov 6 01:37:16.615: INFO: kube-proxy-t958f started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:16.616] Nov 6 01:37:16.615: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:37:16.616] Nov 6 01:37:16.615: INFO: kube-addon-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:18 +0000 UTC (0+1 container statuses recorded) I1106 01:37:16.616] Nov 6 01:37:16.615: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:37:16.616] Nov 6 01:37:16.615: INFO: kube-apiserver-k8s-master-73731178-vmss000002 started at 2019-11-05 23:28:42 +0000 UTC (0+1 container statuses recorded) I1106 01:37:16.616] Nov 6 01:37:16.615: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:37:16.616] Nov 6 01:37:16.615: INFO: kube-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:37:16.617] Nov 6 01:37:16.615: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:37:16.617] Nov 6 01:37:16.615: INFO: kube-scheduler-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:37:16.617] Nov 6 01:37:16.615: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:37:16.617] Nov 6 01:37:16.615: INFO: cloud-controller-manager-k8s-master-73731178-vmss000002 started at 2019-11-05 23:27:19 +0000 UTC (0+1 container statuses recorded) I1106 01:37:16.617] Nov 6 01:37:16.615: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:37:16.895] Nov 6 01:37:16.894: INFO: I1106 01:37:16.895] Latency metrics for node k8s-master-73731178-vmss000002 I1106 01:37:16.895] Nov 6 01:37:16.894: INFO: I1106 01:37:16.895] Logging node info for node k8s-master-73731178-vmss000003 I1106 01:37:16.981] Nov 6 01:37:16.979: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000003,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000003,UID:54efc1b0-183c-4153-b804-31d0d42ce204,ResourceVersion:23961,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-2,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000003,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/3,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284359168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497927168 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:02 +0000 UTC 2019-11-05 23:28:02 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:36:38 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:36:38 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:36:38 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:36:38 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{Hostname k8s-master-73731178-vmss000003} {InternalIP 10.240.0.7}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a448072d2d27400fa2252a0cb3c8ff37,SystemUUID:98F6A517-FFCA-8E4D-A914-52A5F1482433,BootID:50c0f9e6-7c4d-45ec-8984-248ea540d637,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:37:16.982] Nov 6 01:37:16.979: INFO: I1106 01:37:16.982] Logging kubelet events for node k8s-master-73731178-vmss000003 I1106 01:37:17.063] Nov 6 01:37:17.063: INFO: I1106 01:37:17.064] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000003 I1106 01:37:17.153] Nov 6 01:37:17.153: INFO: cloud-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:37:17.154] Nov 6 01:37:17.153: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:37:17.154] Nov 6 01:37:17.153: INFO: kube-addon-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:43 +0000 UTC (0+1 container statuses recorded) I1106 01:37:17.154] Nov 6 01:37:17.153: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:37:17.154] Nov 6 01:37:17.153: INFO: kube-apiserver-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:37:17.154] Nov 6 01:37:17.153: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:37:17.154] Nov 6 01:37:17.153: INFO: kube-controller-manager-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:37:17.155] Nov 6 01:37:17.153: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:37:17.155] Nov 6 01:37:17.153: INFO: kube-scheduler-k8s-master-73731178-vmss000003 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:37:17.155] Nov 6 01:37:17.153: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:37:17.155] Nov 6 01:37:17.153: INFO: azure-ip-masq-agent-4nshf started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:17.155] Nov 6 01:37:17.153: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:37:17.156] Nov 6 01:37:17.153: INFO: kube-proxy-qm7rq started at 2019-11-05 23:27:51 +0000 UTC (0+1 container statuses recorded) I1106 01:37:17.156] Nov 6 01:37:17.153: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:37:17.448] Nov 6 01:37:17.447: INFO: I1106 01:37:17.448] Latency metrics for node k8s-master-73731178-vmss000003 I1106 01:37:17.448] Nov 6 01:37:17.447: INFO: I1106 01:37:17.448] Logging node info for node k8s-master-73731178-vmss000004 I1106 01:37:17.535] Nov 6 01:37:17.533: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:k8s-master-73731178-vmss000004,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/k8s-master-73731178-vmss000004,UID:4a582f8b-6cf2-4e91-8770-fde6f9c22194,ResourceVersion:23955,Generation:0,CreationTimestamp:2019-11-05 23:27:29 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/instance-type: Standard_DS2_v2,beta.kubernetes.io/os: linux,failure-domain.beta.kubernetes.io/region: eastus2,failure-domain.beta.kubernetes.io/zone: eastus2-1,kubernetes.azure.com/cluster: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973,kubernetes.azure.com/role: master,kubernetes.io/arch: amd64,kubernetes.io/hostname: k8s-master-73731178-vmss000004,kubernetes.io/os: linux,kubernetes.io/role: master,node-role.kubernetes.io/master: ,},Annotations:map[string]string{node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUse_ExternalID:,ProviderID:azure:///subscriptions/940f88ce-a64b-4e73-a258-9931349b9789/resourceGroups/kubetest-07e0acb7-0020-11ea-802a-02428e4d9973/providers/Microsoft.Compute/virtualMachineScaleSets/k8s-master-73731178-vmss/virtualMachines/4,Unschedulable:false,Taints:[{node-role.kubernetes.io/master true NoSchedule }],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{31036776448 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{7284363264 0} {} 7113636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {} 2 DecimalSI},ephemeral-storage: {{27933098757 0} {} 27933098757 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{6497931264 0} {} 6345636Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-11-05 23:28:32 +0000 UTC 2019-11-05 23:28:32 +0000 UTC RouteCreated RouteController created a route} {MemoryPressure False 2019-11-06 01:36:36 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-11-06 01:36:36 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-11-06 01:36:36 +0000 UTC 2019-11-05 23:27:23 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-11-06 01:36:36 +0000 UTC 2019-11-05 23:27:48 +0000 UTC KubeletReady kubelet is posting ready status. AppArmor enabled}],Addresses:[{InternalIP 10.240.0.8} {Hostname k8s-master-73731178-vmss000004}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:252c632059f2483d87e2d8d689053e48,SystemUUID:5BBFFB00-FBAB-0F4A-8F63-6B99DE219F64,BootID:165ca62a-8171-48e8-92f7-3ad786cb6b9a,KernelVersion:4.15.0-1061-azure,OSImage:Ubuntu 16.04.6 LTS,ContainerRuntimeVersion:docker://3.0.6,KubeletVersion:v1.15.0,KubeProxyVersion:v1.15.0,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcrio.azureedge.net/google_containers/hyperkube-amd64@sha256:7f66ed6bd11edd309dad15db1dc906f89035cc9d9ae705c65c98264c775b9a8f gcrio.azureedge.net/google_containers/hyperkube-amd64:v1.15.0] 593352254} {[gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64@sha256:d2397a13afbf962153355d029a62c7b7175c6c525faadce790671280475f5c02 gcrio.azureedge.net/google_containers/cloud-controller-manager-amd64:v1.15.0] 142865982} {[k8s.gcr.io/kube-addon-manager-amd64@sha256:382c220b3531d9f95bf316a16b7282cc2ef929cd8a89a9dd3f5933edafc41a8e k8s.gcr.io/kube-addon-manager-amd64:v9.0.1] 83076194} {[k8s.gcr.io/ip-masq-agent-amd64@sha256:269e0fb9d53fd37f7a135d6a55ea265a67279ba218aa148323f015cf70167340 k8s.gcr.io/ip-masq-agent-amd64:v2.3.0] 50144412} {[k8s.gcr.io/pause-amd64@sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610 k8s.gcr.io/pause-amd64:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},} I1106 01:37:17.536] Nov 6 01:37:17.533: INFO: I1106 01:37:17.536] Logging kubelet events for node k8s-master-73731178-vmss000004 I1106 01:37:17.617] Nov 6 01:37:17.617: INFO: I1106 01:37:17.618] Logging pods the kubelet thinks is on node k8s-master-73731178-vmss000004 I1106 01:37:17.706] Nov 6 01:37:17.706: INFO: kube-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:37:17.706] Nov 6 01:37:17.706: INFO: Container kube-controller-manager ready: true, restart count 0 I1106 01:37:17.707] Nov 6 01:37:17.706: INFO: kube-scheduler-k8s-master-73731178-vmss000004 started at 2019-11-05 23:28:31 +0000 UTC (0+1 container statuses recorded) I1106 01:37:17.707] Nov 6 01:37:17.706: INFO: Container kube-scheduler ready: true, restart count 0 I1106 01:37:17.707] Nov 6 01:37:17.706: INFO: azure-ip-masq-agent-rh9pr started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:37:17.707] Nov 6 01:37:17.706: INFO: Container azure-ip-masq-agent ready: true, restart count 0 I1106 01:37:17.707] Nov 6 01:37:17.706: INFO: kube-proxy-rk5r6 started at 2019-11-05 23:27:52 +0000 UTC (0+1 container statuses recorded) I1106 01:37:17.707] Nov 6 01:37:17.706: INFO: Container kube-proxy ready: true, restart count 0 I1106 01:37:17.708] Nov 6 01:37:17.706: INFO: cloud-controller-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:37:17.708] Nov 6 01:37:17.706: INFO: Container cloud-controller-manager ready: true, restart count 0 I1106 01:37:17.708] Nov 6 01:37:17.706: INFO: kube-addon-manager-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:37:17.708] Nov 6 01:37:17.706: INFO: Container kube-addon-manager ready: true, restart count 0 I1106 01:37:17.708] Nov 6 01:37:17.706: INFO: kube-apiserver-k8s-master-73731178-vmss000004 started at 2019-11-05 23:27:17 +0000 UTC (0+1 container statuses recorded) I1106 01:37:17.709] Nov 6 01:37:17.706: INFO: Container kube-apiserver ready: true, restart count 0 I1106 01:37:17.973] Nov 6 01:37:17.973: INFO: I1106 01:37:17.973] Latency metrics for node k8s-master-73731178-vmss000004 I1106 01:37:17.973] Nov 6 01:37:17.973: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready I1106 01:37:18.058] STEP: Destroying namespace "azuredisk-4885" for this suite. I1106 01:37:32.321] Nov 6 01:37:32.320: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered I1106 01:37:35.493] Nov 6 01:37:35.492: INFO: namespace azuredisk-4885 deletion completed in 17.434425223s I1106 01:37:35.493] I1106 01:37:35.493] • Failure [923.080 seconds] I1106 01:37:35.493] [azuredisk-csi-e2e] Dynamic Provisioning I1106 01:37:35.493] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:33 I1106 01:37:35.493] [multi-az] I1106 01:37:35.493] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:40 I1106 01:37:35.494] should create a volume on demand and mount it as readOnly in a pod [It] I1106 01:37:35.494] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning.go:126 I1106 01:37:35.494] I1106 01:37:35.494] Unexpected error: I1106 01:37:35.494] <*errors.errorString | 0xc000bc01c0>: { I1106 01:37:35.494] s: "Gave up after waiting 15m0s for pod \"azuredisk-volume-tester-qtf4g\" to be \"Error status code\"", I1106 01:37:35.494] } I1106 01:37:35.495] Gave up after waiting 15m0s for pod "azuredisk-volume-tester-qtf4g" to be "Error status code" I1106 01:37:35.495] occurred I1106 01:37:35.495] I1106 01:37:35.495] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:553 I1106 01:37:35.495] ------------------------------ I1106 01:37:35.495] 2019/11/06 01:37:35 Uninstalling Azure Disk CSI Driver... I1106 01:37:35.495] make[1]: Entering directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1106 01:37:35.497] helm delete --purge azuredisk-csi-driver I1106 01:37:43.578] release "azuredisk-csi-driver" deleted I1106 01:37:43.579] make[1]: Leaving directory '/go/src/sigs.k8s.io/azuredisk-csi-driver' I1106 01:37:43.580] 2019/11/06 01:37:43 Azure Disk CSI Driver uninstalled I1106 01:37:43.582] I1106 01:37:43.582] I1106 01:37:43.582] Summarizing 14 Failures: I1106 01:37:43.582] I1106 01:37:43.582] [Fail] [azuredisk-csi-e2e] Dynamic Provisioning [single-az] [It] should create a raw block volume on demand I1106 01:37:43.583] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1106 01:37:43.583] I1106 01:37:43.583] [Fail] [azuredisk-csi-e2e] Dynamic Provisioning [single-az] [It] should create multiple PV objects, bind to PVCs and attach all to different pods on the same node I1106 01:37:43.583] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1106 01:37:43.583] I1106 01:37:43.583] [Fail] [azuredisk-csi-e2e] Dynamic Provisioning [single-az] [It] should create a volume on demand and mount it as readOnly in a pod I1106 01:37:43.584] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1106 01:37:43.584] I1106 01:37:43.584] [Fail] [azuredisk-csi-e2e] Dynamic Provisioning [single-az] [It] [env] should retain PV with reclaimPolicy "Retain" I1106 01:37:43.584] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1106 01:37:43.584] I1106 01:37:43.584] [Fail] [azuredisk-csi-e2e] Dynamic Provisioning [single-az] [It] should delete PV with reclaimPolicy "Delete" I1106 01:37:43.584] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1106 01:37:43.585] I1106 01:37:43.585] [Fail] [azuredisk-csi-e2e] Dynamic Provisioning [multi-az] [It] should delete PV with reclaimPolicy "Delete" I1106 01:37:43.585] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1106 01:37:43.585] I1106 01:37:43.585] [Fail] [azuredisk-csi-e2e] [single-az] Pre-Provisioned [It] [env] should use a pre-provisioned volume and mount it as readOnly in a pod I1106 01:37:43.585] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:553 I1106 01:37:43.586] I1106 01:37:43.586] [Fail] [azuredisk-csi-e2e] Dynamic Provisioning [multi-az] [It] should create a deployment object, write and read to it, delete the pod and write and read to it again I1106 01:37:43.586] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:434 I1106 01:37:43.586] I1106 01:37:43.586] [Fail] [azuredisk-csi-e2e] Dynamic Provisioning [single-az] [It] should create a volume on demand I1106 01:37:43.587] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1106 01:37:43.587] I1106 01:37:43.587] [Fail] [azuredisk-csi-e2e] Dynamic Provisioning [multi-az] [It] should create a volume on demand I1106 01:37:43.587] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:529 I1106 01:37:43.587] I1106 01:37:43.587] [Fail] [azuredisk-csi-e2e] Dynamic Provisioning [single-az] [It] should create a deployment object, write and read to it, delete the pod and write and read to it again I1106 01:37:43.587] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1106 01:37:43.588] I1106 01:37:43.588] [Panic!] [azuredisk-csi-e2e] [single-az] Pre-Provisioned [It] [env] should use a pre-provisioned volume and retain PV with reclaimPolicy "Retain" I1106 01:37:43.588] /usr/local/go/src/runtime/panic.go:82 I1106 01:37:43.588] I1106 01:37:43.588] [Fail] [azuredisk-csi-e2e] Dynamic Provisioning [multi-az] [It] [env] should retain PV with reclaimPolicy "Retain" I1106 01:37:43.588] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:278 I1106 01:37:43.588] I1106 01:37:43.589] [Fail] [azuredisk-csi-e2e] Dynamic Provisioning [multi-az] [It] should create a volume on demand and mount it as readOnly in a pod I1106 01:37:43.589] /go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:553 I1106 01:37:43.589] I1106 01:37:43.589] Ran 16 of 16 Specs in 7692.234 seconds I1106 01:37:43.589] FAIL! -- 2 Passed | 14 Failed | 0 Pending | 0 Skipped I1106 01:37:43.589] --- FAIL: TestE2E (7692.23s) I1106 01:37:43.589] FAIL I1106 01:37:43.589] FAIL sigs.k8s.io/azuredisk-csi-driver/test/e2e 7692.286s W1106 01:37:43.727] make: *** [Makefile:59: e2e-test] Error 1 W1106 01:37:43.728] 2019/11/06 01:37:43 process.go:155: Step 'make e2e-test' finished in 2h9m0.874450582s W1106 01:37:43.728] 2019/11/06 01:37:43 azure.go:912: Skippng DumpClusterLogs due to CCM not being enabled. W1106 01:37:43.728] 2019/11/06 01:37:43 azure.go:906: Deleting resource group: kubetest-07e0acb7-0020-11ea-802a-02428e4d9973. W1106 01:47:54.399] 2019/11/06 01:47:54 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W1106 01:47:54.400] 2019/11/06 01:47:54 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}" W1106 01:47:55.055] 2019/11/06 01:47:55 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 656.011948ms W1106 01:47:55.056] 2019/11/06 01:47:55 main.go:319: Something went wrong: encountered 1 errors: [error during make e2e-test: exit status 2] W1106 01:47:55.057] Traceback (most recent call last): W1106 01:47:55.058] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in W1106 01:47:55.058] main(parse_args()) W1106 01:47:55.058] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main W1106 01:47:55.058] mode.start(runner_args) W1106 01:47:55.058] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start W1106 01:47:55.059] check_env(env, self.command, *args) W1106 01:47:55.059] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W1106 01:47:55.059] subprocess.check_call(cmd, env=env) W1106 01:47:55.059] File "/usr/lib/python2.7/subprocess.py", line 190, in check_call W1106 01:47:55.059] raise CalledProcessError(retcode, cmd) W1106 01:47:55.060] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=1', '--acsengine-agentpoolcount=2', '--acsengine-admin-username=azureuser', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.16', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_D4s_v3', '--acsengine-location=eastus2', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/da4b9f5e9696ab00a5b1ac08606218f9f352d324/tests/k8s-azure/manifest/linux-vmss-multi-zones.json', '--acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.39.1/aks-engine-v0.39.1-linux-amd64.tar.gz', '--test-azure-disk-csi-driver=True', '--test_args=--ginkgo.focus=\\[multi-az\\]', '--timeout=420m')' returned non-zero exit status 1 E1106 01:47:55.065] Command failed I1106 01:47:55.065] process 682 exited with code 1 after 167.7m E1106 01:47:55.065] FAIL: chewong-pull-azuredisk-csi-driver-e2e-multi-az I1106 01:47:55.065] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1106 01:47:55.901] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I1106 01:47:55.935] process 19779 exited with code 0 after 0.0m I1106 01:47:55.935] Call: gcloud config get-value account I1106 01:47:56.204] process 19791 exited with code 0 after 0.0m I1106 01:47:56.204] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I1106 01:47:56.204] Upload result and artifacts... I1106 01:47:56.204] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191852367847362560 I1106 01:47:56.205] Call: gsutil ls gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191852367847362560/artifacts W1106 01:47:57.366] CommandException: One or more URLs matched no objects. E1106 01:47:57.441] Command failed I1106 01:47:57.441] process 19803 exited with code 1 after 0.0m W1106 01:47:57.441] Remote dir gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191852367847362560/artifacts not exist yet I1106 01:47:57.441] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191852367847362560/artifacts I1106 01:47:58.862] process 19947 exited with code 0 after 0.0m I1106 01:47:58.863] Call: git rev-parse HEAD I1106 01:47:58.866] process 20476 exited with code 0 after 0.0m I1106 01:47:58.866] Call: git rev-parse HEAD I1106 01:47:58.870] process 20477 exited with code 0 after 0.0m I1106 01:47:58.871] Call: gsutil stat gs://kubernetes-upstream/pr-logs/directory/chewong-pull-azuredisk-csi-driver-e2e-multi-az/jobResultsCache.json I1106 01:47:59.703] process 20478 exited with code 0 after 0.0m I1106 01:47:59.704] Call: gsutil -q cat 'gs://kubernetes-upstream/pr-logs/directory/chewong-pull-azuredisk-csi-driver-e2e-multi-az/jobResultsCache.json#1572990975299217' I1106 01:48:00.736] process 20622 exited with code 0 after 0.0m I1106 01:48:00.736] Call: gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1572990975299217 cp /tmp/gsutil_fyndKG gs://kubernetes-upstream/pr-logs/directory/chewong-pull-azuredisk-csi-driver-e2e-multi-az/jobResultsCache.json I1106 01:48:02.134] process 20768 exited with code 0 after 0.0m I1106 01:48:02.135] Call: gsutil stat gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/jobResultsCache.json I1106 01:48:02.910] process 20948 exited with code 0 after 0.0m I1106 01:48:02.911] Call: gsutil -q cat 'gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/jobResultsCache.json#1572990978412516' I1106 01:48:04.063] process 21092 exited with code 0 after 0.0m I1106 01:48:04.064] Call: gsutil -q -h Content-Type:application/json -h x-goog-if-generation-match:1572990978412516 cp /tmp/gsutil_j9QkNO gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/jobResultsCache.json I1106 01:48:05.352] process 21238 exited with code 0 after 0.0m I1106 01:48:05.352] Call: gsutil -q -h Content-Type:application/json cp /tmp/gsutil_bWpW37 gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/1191852367847362560/finished.json I1106 01:48:06.579] process 21418 exited with code 0 after 0.0m I1106 01:48:06.580] Call: gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_jr8Rnj gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_azuredisk-csi-driver/180/chewong-pull-azuredisk-csi-driver-e2e-multi-az/latest-build.txt I1106 01:48:08.022] process 21598 exited with code 0 after 0.0m I1106 01:48:08.023] Call: gsutil -q -h Content-Type:text/plain -h 'Cache-Control:private, max-age=0, no-transform' cp /tmp/gsutil_BGnnQG gs://kubernetes-upstream/pr-logs/directory/chewong-pull-azuredisk-csi-driver-e2e-multi-az/latest-build.txt I1106 01:48:09.223] process 21778 exited with code 0 after 0.0m